Jun 09 09:32:56.079104 ip-10-0-135-66 systemd[1]: Starting Kubernetes Kubelet...
Jun 09 09:32:56.483089 ip-10-0-135-66 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 09:32:56.483089 ip-10-0-135-66 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 09 09:32:56.483089 ip-10-0-135-66 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 09:32:56.483089 ip-10-0-135-66 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 09 09:32:56.483089 ip-10-0-135-66 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 09:32:56.483748 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.483142    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 09 09:32:56.489445 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489425    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.489445 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489440    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.489445 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489444    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.489445 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489447    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489450    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489453    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489456    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489459    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489462    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489464    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489467    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489470    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489472    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489475    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489478    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489481    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489483    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489486    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489489    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489492    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489494    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489501    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489504    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.489560 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489507    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489509    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489512    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489514    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489517    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489520    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489523    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489525    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489527    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489530    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489532    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489535    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489538    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489540    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489544    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489547    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489550    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489553    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489557    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489560    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.490059 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489563    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489566    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489569    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489571    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489574    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489577    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489582    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489585    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489588    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489591    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489594    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489596    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489599    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489602    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489604    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489606    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489609    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489611    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489614    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.490547 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489617    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489619    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489622    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489624    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489627    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489630    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489633    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489636    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489639    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489641    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489644    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489647    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489650    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489652    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489655    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489658    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489660    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489663    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489665    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489668    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.491033 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489671    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489673    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489676    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489678    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489683    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489687    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489690    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489693    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489696    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489698    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489701    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489703    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489706    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489708    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489712    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.489715    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490406    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490413    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490417    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.491539 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490420    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490423    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490427    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490429    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490433    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490436    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490438    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490441    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490444    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490446    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490451    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490455    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490457    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490460    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490463    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490465    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490467    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490470    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490473    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.492005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490476    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490478    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490481    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490483    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490486    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490488    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490491    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490494    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490496    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490499    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490501    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490505    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490508    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490511    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490514    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490516    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490519    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490521    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490524    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490527    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.492472 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490529    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490532    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490534    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490537    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490539    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490542    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490544    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490547    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490550    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490552    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490555    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490558    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490561    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490564    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490566    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490569    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490572    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490575    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490578    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490580    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.492969 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490583    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490585    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490588    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490591    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490594    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490596    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490599    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490601    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490604    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490607    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490609    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490615    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490618    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490621    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490624    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490626    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490629    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490632    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490635    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.493474 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490638    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490640    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490642    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490645    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490647    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490650    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490658    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490661    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490664    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490667    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490670    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490673    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490675    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490678    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490681    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490683    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490686    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.490689    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491028    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.493946 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491034    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491038    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491041    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491044    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491046    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491049    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491052    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491054    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491057    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491059    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491062    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491064    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491067    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491071    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491075    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491078    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491081    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491083    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491086    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.494405 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491089    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491091    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491094    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491097    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491100    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491102    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491105    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491108    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491110    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491113    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491117    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491120    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491122    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491125    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491128    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491130    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491133    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491136    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491138    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491141    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.494900 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491143    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491146    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491148    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491150    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491153    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491156    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491158    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491160    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491163    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491166    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491169    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491171    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491174    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491177    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491179    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491182    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491185    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491188    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491190    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491193    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.495454 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491196    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491199    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491203    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491208    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491211    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491214    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491217    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491220    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491223    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491225    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491228    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491231    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491233    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491236    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491238    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491241    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491243    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491246    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491248    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491251    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.495971 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491254    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491256    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491259    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491262    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491264    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491267    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491270    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491274    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491277    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491279    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491282    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491285    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491287    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491290    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491295    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491297    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491300    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491302    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.491305    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491370    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jun 09 09:32:56.496476 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491376    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491382    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491386    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491390    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491393    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491397    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491401    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491404    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491407    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491410    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491414    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491417    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491420    2563 flags.go:64] FLAG: --cgroup-root=""
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491422    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491425    2563 flags.go:64] FLAG: --client-ca-file=""
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491428    2563 flags.go:64] FLAG: --cloud-provider="external"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491431    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491436    2563 flags.go:64] FLAG: --cluster-domain=""
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491439    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491444    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491447    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491451    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491454    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 09 09:32:56.496978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491457    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491460    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491464    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491468    2563 flags.go:64] FLAG: --contention-profiling="false"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491471    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491474    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491477    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491479    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491483    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491486    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491489    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491492    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491495    2563 flags.go:64] FLAG: --enable-server="true"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491497    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491501    2563 flags.go:64] FLAG: --event-burst="100"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491504    2563 flags.go:64] FLAG: --event-qps="50"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491507    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491510    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491513    2563 flags.go:64] FLAG: --eviction-hard=""
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491516    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491519    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491522    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491525    2563 flags.go:64] FLAG: --eviction-soft=""
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491528    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491531    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 09 09:32:56.497565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491533    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491536    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491539    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491543    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491547    2563 flags.go:64] FLAG: --feature-gates=""
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491550    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491554    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491557    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491560    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491563    2563 flags.go:64] FLAG: --healthz-port="10248"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491567    2563 flags.go:64] FLAG: --help="false"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491570    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491573    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491576    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491579    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491582    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491585    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491588    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491591    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491594    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491596    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491599    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491602    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491605    2563 flags.go:64] FLAG: --kube-reserved=""
Jun 09 09:32:56.498228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491608    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491610    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491613    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491616    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491619    2563 flags.go:64] FLAG: --lock-file=""
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491621    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491624    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491627    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491632    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491635    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491638    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491642    2563 flags.go:64] FLAG: --logging-format="text"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491645    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491648    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491651    2563 flags.go:64] FLAG: --manifest-url=""
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491654    2563 flags.go:64] FLAG: --manifest-url-header=""
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491658    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491661    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491666    2563 flags.go:64] FLAG: --max-pods="110"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491669    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491672    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491674    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491677    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491680    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491683    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 09 09:32:56.499209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491686    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491692    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491695    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491698    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491701    2563 flags.go:64] FLAG: --pod-cidr=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491705    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491710    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491713    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491716    2563 flags.go:64] FLAG: --pods-per-core="0"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491718    2563 flags.go:64] FLAG: --port="10250"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491722    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491725    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03ea03a73595dc22d"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491728    2563 flags.go:64] FLAG: --qos-reserved=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491731    2563 flags.go:64] FLAG: --read-only-port="10255"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491733    2563 flags.go:64] FLAG: --register-node="true"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491736    2563 flags.go:64] FLAG: --register-with-taints=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491740    2563 flags.go:64] FLAG: --registry-burst="10"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491743    2563 flags.go:64] FLAG: --registry-qps="5"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491750    2563 flags.go:64] FLAG: --reserved-cpus=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491752    2563 flags.go:64] FLAG: --reserved-memory=""
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491756    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491760    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491763    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491766    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491769    2563 flags.go:64] FLAG: --runonce="false"
Jun 09 09:32:56.499852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491771    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491776    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491779    2563 flags.go:64] FLAG: --seccomp-default="false"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491781    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491784    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491787    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491790    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491793    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491796    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491799    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491802    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491805    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491808    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491811    2563 flags.go:64] FLAG: --system-cgroups=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491814    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491835    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491838    2563 flags.go:64] FLAG: --tls-cert-file=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.491841    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492201    2563 flags.go:64] FLAG: --tls-min-version=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492205    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492208    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492210    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492213    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492216    2563 flags.go:64] FLAG: --v="2"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492222    2563 flags.go:64] FLAG: --version="false"
Jun 09 09:32:56.500459 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492228    2563 flags.go:64] FLAG: --vmodule=""
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492231    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492235    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492340    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492344    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492347    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492350    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492353    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492357    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492360    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492363    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492365    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492368    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492371    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492373    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492376    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492378    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492381    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492383    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492386    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.501080 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492388    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492391    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492394    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492396    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492399    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492401    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492404    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492407    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492409    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492412    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492415    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492417    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492421    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492423    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492426    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492430    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492433    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492436    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492439    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492441    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.501588 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492445    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492448    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492450    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492453    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492455    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492458    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492460    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492465    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492468    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492471    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492474    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492477    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492479    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492482    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492485    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492488    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492490    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492494    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492498    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.502136 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492501    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492504    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492506    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492509    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492512    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492515    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492517    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492520    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492522    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492525    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492527    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492530    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492533    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492536    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492539    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492541    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492544    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492546    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492548    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492551    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.502602 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492553    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492556    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492558    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492561    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492563    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492566    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492568    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492571    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492573    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492576    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492578    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492581    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492583    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492586    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492588    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492591    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492593    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492596    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492599    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492601    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.503682 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492604    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492607    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.492609    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.492614    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.500443    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.500457    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.501288    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.501297    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501353    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501358    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501361    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501365    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501368    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501371    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501374    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.504185 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501377    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501379    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501383    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501385    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501388    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501390    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501393    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501396    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501399    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501408    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501411    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501414    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501416    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501419    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501422    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501425    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501427    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501430    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501432    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.504563 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501435    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501439    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501442    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501446    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501449    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501452    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501455    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501458    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501461    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501463    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501466    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501469    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501471    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501474    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501476    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501479    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501482    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501484    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501487    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501490    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.505031 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501493    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501496    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501499    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501501    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501504    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501506    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501510    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501514    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501517    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501520    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501523    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501526    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501528    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501531    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501534    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501537    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501540    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501542    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501545    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.505573 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501548    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501550    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501553    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501555    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501558    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501560    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501563    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501566    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501570    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501573    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501576    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501579    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501581    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501584    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501588    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501591    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501594    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501597    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501600    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.506152 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501603    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501605    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501608    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501611    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501613    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501616    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501619    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501621    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501624    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501627    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501629    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501632    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501634    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501637    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501639    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.506627 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.501644    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501753    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501758    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501761    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501764    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501767    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501769    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501772    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501774    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501778    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501782    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501785    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501787    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501791    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501793    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501796    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501798    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501801    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501803    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501806    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 09:32:56.507013 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501809    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501811    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501814    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501816    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501819    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501836    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501840    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501843    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501846    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501849    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501852    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501855    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501857    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501860    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501862    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501865    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501867    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501870    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501872    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 09:32:56.507507 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501874    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501877    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501881    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501884    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501887    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501890    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501892    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501895    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501898    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501901    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501903    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501906    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501908    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501911    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501914    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501916    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501919    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501921    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501925    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 09:32:56.507975 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501928    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501931    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501934    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501937    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501940    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501942    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501945    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501947    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501950    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501952    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501957    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501960    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501962    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501965    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501967    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501970    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501972    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501974    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501978    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 09:32:56.508423 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501980    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501984    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501986    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501989    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501991    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501994    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501996    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.501999    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502001    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502004    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502006    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502009    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502012    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502014    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502017    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502019    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502022    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502024    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502027    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502029    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502032    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 09:32:56.508922 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:56.502034    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.502039    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.502131    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.506476    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.507979    2563 server.go:1019] "Starting client certificate rotation"
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.508075    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 09:32:56.509426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.508131    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 09:32:56.511003 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.510990    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 09:32:56.513876 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.513849    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 09:32:56.524027 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.524004    2563 log.go:25] "Validated CRI v1 runtime API"
Jun 09 09:32:56.526529 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.526512    2563 log.go:25] "Validated CRI v1 image API"
Jun 09 09:32:56.528023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.527998    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 09 09:32:56.531391 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.531372    2563 fs.go:135] Filesystem UUIDs: map[682dedb8-1d18-40b7-87c2-f2a92fc30644:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de2e2dfd-7fe4-4238-b5e5-9ba1005f89db:/dev/nvme0n1p4]
Jun 09 09:32:56.531467 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.531391    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 09 09:32:56.538162 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.538052    2563 manager.go:216] Machine: {Timestamp:2026-06-09 09:32:56.536142564 +0000 UTC m=+0.343647290 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104862 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f264a2c064d3d4286de65f0af693e SystemUUID:ec2f264a-2c06-4d3d-4286-de65f0af693e BootID:b012f023-2e06-418f-9ff0-c76604ebcd01 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:53:a0:77:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:53:a0:77:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:94:7c:45:98:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 09 09:32:56.538162 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.538150    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 09 09:32:56.538301 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.538219    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 09 09:32:56.539377 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.539360    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 09:32:56.541484 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.541461    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 09 09:32:56.541603 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.541486    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 09 09:32:56.542638 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.542628    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jun 09 09:32:56.542671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.542641    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jun 09 09:32:56.542671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.542648    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 09:32:56.543712 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.543703    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 09:32:56.544401 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.544392    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 09 09:32:56.547960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.547950    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 09:32:56.548067 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548058    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 09 09:32:56.548099 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548085    2563 kubelet.go:486] "Attempting to sync node with API server"
Jun 09 09:32:56.548099 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548094    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 09 09:32:56.548154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548104    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 09 09:32:56.548154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548113    2563 kubelet.go:398] "Adding apiserver pod source"
Jun 09 09:32:56.548154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548122    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 09 09:32:56.548411 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548399    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 09:32:56.548454 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.548426    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 09:32:56.551763 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.551747    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 09 09:32:56.553158 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.553145    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 09 09:32:56.553206 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.553174    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 09 09:32:56.554111 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554099    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554115    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554121    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554127    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554139    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554148    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 09 09:32:56.554156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554158    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 09 09:32:56.554308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554163    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 09 09:32:56.554308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554169    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 09 09:32:56.554308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554175    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 09 09:32:56.554308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554188    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 09 09:32:56.554308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.554194    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 09 09:32:56.555474 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.555464    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 09 09:32:56.555513 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.555476    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 09 09:32:56.558567 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558553    2563 server.go:1268] "Started kubelet"
Jun 09 09:32:56.558713 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558691    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngrtg"
Jun 09 09:32:56.558773 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558716    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 09 09:32:56.558852 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.558817    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 09 09:32:56.558912 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558736    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 09 09:32:56.558912 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558881    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 09 09:32:56.559030 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.559009    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 09 09:32:56.559078 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.558850    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 09 09:32:56.559396 ip-10-0-135-66 systemd[1]: Started Kubernetes Kubelet.
Jun 09 09:32:56.561195 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.561180    2563 server.go:310] "Adding debug handlers to kubelet server"
Jun 09 09:32:56.562901 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.562886    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 09 09:32:56.565136 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.565117    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 09 09:32:56.566395 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.566380    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngrtg"
Jun 09 09:32:56.566868 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.565883    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-66.ec2.internal.18b75fdc189a37ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-66.ec2.internal,UID:ip-10-0-135-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-66.ec2.internal,},FirstTimestamp:2026-06-09 09:32:56.558524333 +0000 UTC m=+0.366029056,LastTimestamp:2026-06-09 09:32:56.558524333 +0000 UTC m=+0.366029056,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-66.ec2.internal,}"
Jun 09 09:32:56.567487 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.567468    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 09 09:32:56.567487 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.567477    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 09 09:32:56.567731 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.567715    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:56.567961 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.567937    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 09 09:32:56.567961 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.567939    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 09 09:32:56.568091 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.567970    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 09 09:32:56.568091 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568053    2563 reconstruct.go:97] "Volume reconstruction finished"
Jun 09 09:32:56.568091 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568063    2563 reconciler.go:29] "Reconciler: start to sync state"
Jun 09 09:32:56.568378 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568347    2563 factory.go:55] Registering systemd factory
Jun 09 09:32:56.568378 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568368    2563 factory.go:223] Registration of the systemd container factory successfully
Jun 09 09:32:56.568592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568578    2563 factory.go:153] Registering CRI-O factory
Jun 09 09:32:56.568669 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568595    2563 factory.go:223] Registration of the crio container factory successfully
Jun 09 09:32:56.568669 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568647    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 09 09:32:56.568752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568671    2563 factory.go:103] Registering Raw factory
Jun 09 09:32:56.568752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.568698    2563 manager.go:1196] Started watching for new ooms in manager
Jun 09 09:32:56.569110 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.569098    2563 manager.go:349] Starting recovery of all containers
Jun 09 09:32:56.573865 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.573655    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:56.576603 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.576463    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.580201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.580185    2563 manager.go:354] Recovery completed
Jun 09 09:32:56.584464 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.584452    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.586048 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586033    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.586112 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586063    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.586112 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586079    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.586543 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586532    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 09 09:32:56.586543 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586538    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.586612 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586542    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 09 09:32:56.586612 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.586565    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 09:32:56.587190 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587174    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.587235 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587201    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.587235 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587211    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.587589 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587577    2563 policy_none.go:49] "None policy: Start"
Jun 09 09:32:56.587620 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587593    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 09 09:32:56.587620 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.587602    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 09 09:32:56.588673 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.588662    2563 policy_none.go:47] "Start"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624021    2563 manager.go:337] "Starting Device Plugin manager"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.624045    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624054    2563 server.go:87] "Starting device plugin registration server"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624285    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624294    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624393    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624484    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.624494    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.625112    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 09 09:32:56.636268 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.625149    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:56.637209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.637185    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 09 09:32:56.638299 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.638287    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 09 09:32:56.638343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.638317    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 09 09:32:56.638343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.638333    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 09 09:32:56.638423 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.638361    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 09 09:32:56.641045 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.641024    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:56.725344 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.725328    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.726240 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.726226    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.726299 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.726257    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.726299 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.726270    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.726299 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.726288    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.735201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.735163    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.735201 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.735183    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-66.ec2.internal\": node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:56.738443 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.738426    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"]
Jun 09 09:32:56.738495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.738478    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.739978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.739958    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.740057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.739985    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.740057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.739995    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.741343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.741330    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.741440 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.741426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.741483 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.741460    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.742024 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742005    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.742113 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742038    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.742113 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742054    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.742186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742116    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.742186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742133    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.742186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.742142    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.743253 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.743239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.743302 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.743264    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 09:32:56.744247 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.744235    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 09:32:56.744305 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.744263    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 09:32:56.744305 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.744273    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeHasSufficientPID"
Jun 09 09:32:56.750052 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.750026    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:56.763346 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.763332    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.767064 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.767043    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-66.ec2.internal\" not found" node="ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.769142 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.769127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.769192 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.769152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fb097f239e19efddd2e39d86ec19ca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"14fb097f239e19efddd2e39d86ec19ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.769192 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.769168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.850578 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.850553    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:56.869730 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fb097f239e19efddd2e39d86ec19ca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"14fb097f239e19efddd2e39d86ec19ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.869730 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869725    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/14fb097f239e19efddd2e39d86ec19ca-config\") pod \"kube-apiserver-proxy-ip-10-0-135-66.ec2.internal\" (UID: \"14fb097f239e19efddd2e39d86ec19ca\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.869860 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.869860 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.869860 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869796    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.869860 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:56.869820    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b52206449a4d0db0305a3ff5a05ef557-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal\" (UID: \"b52206449a4d0db0305a3ff5a05ef557\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:56.951137 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:56.951111    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.051801 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.051745    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.066900 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.066874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:57.071479 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.071463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:57.152431 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.152406    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.252889 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.252856    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.353348 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.353299    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.453786 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.453763    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.507244 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.507225    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 09 09:32:57.507821 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.507359    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 09:32:57.507821 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.507384    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 09:32:57.554769 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.554747    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.568891 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.568859    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 09:27:56 +0000 UTC" deadline="2028-01-30 12:10:15.614542284 +0000 UTC"
Jun 09 09:32:57.568891 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.568889    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14402h37m18.04565578s"
Jun 09 09:32:57.607080 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.607065    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:57.617681 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:57.617653    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14fb097f239e19efddd2e39d86ec19ca.slice/crio-df0588e64e7a3be692c07921821a466e417c7f45adbc0532e068f56987b47cd7 WatchSource:0}: Error finding container df0588e64e7a3be692c07921821a466e417c7f45adbc0532e068f56987b47cd7: Status 404 returned error can't find the container with id df0588e64e7a3be692c07921821a466e417c7f45adbc0532e068f56987b47cd7
Jun 09 09:32:57.618016 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:57.617999    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52206449a4d0db0305a3ff5a05ef557.slice/crio-5c6bb5237faff7c0ee913d9fe3de0305046ba8d9663765b4a2e334d6fa2bb4bd WatchSource:0}: Error finding container 5c6bb5237faff7c0ee913d9fe3de0305046ba8d9663765b4a2e334d6fa2bb4bd: Status 404 returned error can't find the container with id 5c6bb5237faff7c0ee913d9fe3de0305046ba8d9663765b4a2e334d6fa2bb4bd
Jun 09 09:32:57.623470 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.623051    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 09:32:57.641116 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.641079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" event={"ID":"14fb097f239e19efddd2e39d86ec19ca","Type":"ContainerStarted","Data":"df0588e64e7a3be692c07921821a466e417c7f45adbc0532e068f56987b47cd7"}
Jun 09 09:32:57.642194 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.642176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"b52206449a4d0db0305a3ff5a05ef557","Type":"ContainerStarted","Data":"5c6bb5237faff7c0ee913d9fe3de0305046ba8d9663765b4a2e334d6fa2bb4bd"}
Jun 09 09:32:57.655317 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:57.655299    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-66.ec2.internal\" not found"
Jun 09 09:32:57.702417 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.702399    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:57.768496 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.768475    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:57.780112 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.780093    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 09:32:57.781254 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.781232    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal"
Jun 09 09:32:57.790369 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:57.790354    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 09:32:58.435055 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.435019    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:58.548819 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.548786    2563 apiserver.go:52] "Watching apiserver"
Jun 09 09:32:58.558150 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.558126    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 09 09:32:58.558529 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.558502    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2tknl","kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6","openshift-image-registry/node-ca-s647z","openshift-multus/multus-tgtqb","openshift-network-diagnostics/network-check-target-jzv6f","openshift-ovn-kubernetes/ovnkube-node-lwgk2","kube-system/global-pull-secret-syncer-znq7n","openshift-cluster-node-tuning-operator/tuned-4b6mh","openshift-dns/node-resolver-hc2xf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal","openshift-multus/multus-additional-cni-plugins-8hxlj","openshift-multus/network-metrics-daemon-kcrvz","openshift-network-operator/iptables-alerter-xxhd5"]
Jun 09 09:32:58.561182 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.561164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.563279 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.563258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.563374 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.563356    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:32:58.563644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.563622    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.563644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.563638    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.563781 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.563711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 09 09:32:58.564155 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.564123    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 09 09:32:58.564155 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.564150    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 09 09:32:58.564323 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.564178    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 09 09:32:58.564323 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.564217    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d6sgl\""
Jun 09 09:32:58.565446 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.565427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.567488 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.567473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.568008 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.567606    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 09 09:32:58.568008 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.567715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bdrmr\""
Jun 09 09:32:58.568008 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.567855    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 09 09:32:58.568008 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.567937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.568289 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.568256    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.569718 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.569690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 09 09:32:58.569847 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.569808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.569942 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.569910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fg5tf\""
Jun 09 09:32:58.569942 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.569925    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.570152 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.570136    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.572946 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.572321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.572946 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.572447    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.572946 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.572790    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 09 09:32:58.573125 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.573103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c657h\""
Jun 09 09:32:58.574034 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.574007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:32:58.574122 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.574071    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:32:58.574721 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.574701    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 09 09:32:58.576601 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.576470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.578731 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-hostroot\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.578842 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-daemon-config\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.578842 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578762    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.578842 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-systemd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-bin\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-registration-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-netns\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-etc-kubernetes\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.578986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwk99\" (UniqueName: \"kubernetes.io/projected/ff120835-01c5-41f2-9a39-c42d4fced1ce-kube-api-access-vwk99\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-var-lib-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-etc-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-system-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cnibin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579140    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-kubelet\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-log-socket\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/5167279c-68fd-4b23-9a4c-0c8cd92cd330-kube-api-access-n8fzj\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579206    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-socket-dir-parent\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-bin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-node-log\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-device-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579302    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-os-release\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.579334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstnk\" (UniqueName: \"kubernetes.io/projected/0ba5f058-390f-4bf4-bacd-f61b46c312fa-kube-api-access-pstnk\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-systemd-units\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-ovn\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579421    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-config\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579566    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ggd4z\""
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-script-lib\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-socket-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtrs\" (UniqueName: \"kubernetes.io/projected/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kube-api-access-vmtrs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-multus\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/281b27f8-d59f-489b-9164-e9a08b780af0-host\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/281b27f8-d59f-489b-9164-e9a08b780af0-serviceca\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cni-binary-copy\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-k8s-cni-cncf-io\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-conf-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-multus-certs\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.580114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-netns\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-netd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-sys-fs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-kubelet\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-slash\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-env-overrides\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.579990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.580810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.580027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm8xh\" (UniqueName: \"kubernetes.io/projected/281b27f8-d59f-489b-9164-e9a08b780af0-kube-api-access-xm8xh\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.581119 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.581024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z69bv\""
Jun 09 09:32:58.581310 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.581293    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 09 09:32:58.581388 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.581336    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 09 09:32:58.581772 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.581755    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.584044 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.584027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.584522 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.584504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hfswg\""
Jun 09 09:32:58.584616 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.584506    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.584616 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.584549    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 09 09:32:58.584801 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.584551    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.586302 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.586283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.586393 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.586350    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:32:58.587061 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.587040    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 09 09:32:58.587167 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.587067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 09 09:32:58.587167 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.587106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmgdv\""
Jun 09 09:32:58.589565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.589549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.591901 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.591880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 09 09:32:58.591991 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.591980    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwkb9\""
Jun 09 09:32:58.592101 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.592082    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 09 09:32:58.601419 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.601394    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4j8np"
Jun 09 09:32:58.609031 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.609014    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4j8np"
Jun 09 09:32:58.668890 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.668870    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 09 09:32:58.680867 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f4fb18b-e57a-4276-9223-50e8cd75fb27-host-slash\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.680867 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680875    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-multus\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/281b27f8-d59f-489b-9164-e9a08b780af0-serviceca\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-multus-certs\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-multus\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-netns\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680956    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.680992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681014    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-run-netns\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-sys-fs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm8xh\" (UniqueName: \"kubernetes.io/projected/281b27f8-d59f-489b-9164-e9a08b780af0-kube-api-access-xm8xh\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681065    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-sys-fs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9369b817-e406-4f2f-8bff-f1778ecbaca3-hosts-file\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681074    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681116    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-multus-certs\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-kubelet\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-slash\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-env-overrides\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-slash\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92657a6c-4994-48bd-9cee-1fff67142f33-agent-certs\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-kubelet\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f4fb18b-e57a-4276-9223-50e8cd75fb27-iptables-alerter-script\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-kubelet-config\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.681343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-daemon-config\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-systemd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcz7f\" (UniqueName: \"kubernetes.io/projected/622994b3-c77d-4986-b4d9-14ca1e1ba65c-kube-api-access-pcz7f\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cnibin\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-systemd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-etc-kubernetes\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysconfig\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-kubernetes\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-system-cni-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/281b27f8-d59f-489b-9164-e9a08b780af0-serviceca\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-var-lib-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-etc-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-etc-kubernetes\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-system-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681700    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-env-overrides\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.682267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-etc-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cnibin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-log-socket\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681795    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-systemd\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-system-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cnibin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681911    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-var-lib-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9369b817-e406-4f2f-8bff-f1778ecbaca3-tmp-dir\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.681947    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-log-socket\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682000    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-daemon-config\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-socket-dir-parent\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-bin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-node-log\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682155    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-socket-dir-parent\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682201    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-cni-bin\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683011 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682239    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-node-log\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/281b27f8-d59f-489b-9164-e9a08b780af0-host\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682285    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-systemd-units\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682350    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/281b27f8-d59f-489b-9164-e9a08b780af0-host\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-config\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-script-lib\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-systemd-units\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-os-release\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-sys\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cni-binary-copy\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-k8s-cni-cncf-io\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-conf-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-netd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682638    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-k8s-cni-cncf-io\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4shp\" (UniqueName: \"kubernetes.io/projected/9369b817-e406-4f2f-8bff-f1778ecbaca3-kube-api-access-c4shp\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-dbus\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.683798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682691    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-conf-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-tmp\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.682777    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfr8q\" (UniqueName: \"kubernetes.io/projected/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-kube-api-access-dfr8q\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.682863    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:59.182840887 +0000 UTC m=+2.990345615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682903    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-netd\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682923    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-config\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-hostroot\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-bin\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.682997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683006    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba5f058-390f-4bf4-bacd-f61b46c312fa-cni-binary-copy\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-registration-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683041    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-hostroot\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-conf\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.684497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683073    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-registration-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683067    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-host-cni-bin\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovnkube-script-lib\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-run\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-host\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-netns\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwk99\" (UniqueName: \"kubernetes.io/projected/ff120835-01c5-41f2-9a39-c42d4fced1ce-kube-api-access-vwk99\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-var-lib-kubelet\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683278    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-run-netns\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-kubelet\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683342    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-multus-cni-dir\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/5167279c-68fd-4b23-9a4c-0c8cd92cd330-kube-api-access-n8fzj\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683354    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-host-var-lib-kubelet\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-lib-modules\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2rz\" (UniqueName: \"kubernetes.io/projected/5f4fb18b-e57a-4276-9223-50e8cd75fb27-kube-api-access-6n2rz\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.685370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683559    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-openvswitch\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-device-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92657a6c-4994-48bd-9cee-1fff67142f33-konnectivity-ca\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-device-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-modprobe-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-os-release\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstnk\" (UniqueName: \"kubernetes.io/projected/0ba5f058-390f-4bf4-bacd-f61b46c312fa-kube-api-access-pstnk\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-ovn\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff120835-01c5-41f2-9a39-c42d4fced1ce-run-ovn\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba5f058-390f-4bf4-bacd-f61b46c312fa-os-release\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.683975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-socket-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.684007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtrs\" (UniqueName: \"kubernetes.io/projected/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kube-api-access-vmtrs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.684041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-tuned\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.686174 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.684088    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebb61630-9d6c-4685-9c96-ad5a997ff30b-socket-dir\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.687014 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.686992    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff120835-01c5-41f2-9a39-c42d4fced1ce-ovn-node-metrics-cert\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.688530 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.688512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm8xh\" (UniqueName: \"kubernetes.io/projected/281b27f8-d59f-489b-9164-e9a08b780af0-kube-api-access-xm8xh\") pod \"node-ca-s647z\" (UID: \"281b27f8-d59f-489b-9164-e9a08b780af0\") " pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.691985 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.691964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwk99\" (UniqueName: \"kubernetes.io/projected/ff120835-01c5-41f2-9a39-c42d4fced1ce-kube-api-access-vwk99\") pod \"ovnkube-node-lwgk2\" (UID: \"ff120835-01c5-41f2-9a39-c42d4fced1ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.692345 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.692318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fzj\" (UniqueName: \"kubernetes.io/projected/5167279c-68fd-4b23-9a4c-0c8cd92cd330-kube-api-access-n8fzj\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:58.692345 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.692334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstnk\" (UniqueName: \"kubernetes.io/projected/0ba5f058-390f-4bf4-bacd-f61b46c312fa-kube-api-access-pstnk\") pod \"multus-tgtqb\" (UID: \"0ba5f058-390f-4bf4-bacd-f61b46c312fa\") " pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.692578 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.692558    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtrs\" (UniqueName: \"kubernetes.io/projected/ebb61630-9d6c-4685-9c96-ad5a997ff30b-kube-api-access-vmtrs\") pod \"aws-ebs-csi-driver-node-zstp6\" (UID: \"ebb61630-9d6c-4685-9c96-ad5a997ff30b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.721983 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.721959    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 09:32:58.784779 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfr8q\" (UniqueName: \"kubernetes.io/projected/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-kube-api-access-dfr8q\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.784909 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-conf\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.784909 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-run\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-host\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784931    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-conf\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-run\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-var-lib-kubelet\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.784992    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-host\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-lib-modules\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2rz\" (UniqueName: \"kubernetes.io/projected/5f4fb18b-e57a-4276-9223-50e8cd75fb27-kube-api-access-6n2rz\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-var-lib-kubelet\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92657a6c-4994-48bd-9cee-1fff67142f33-konnectivity-ca\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-modprobe-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-tuned\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785221    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysctl-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f4fb18b-e57a-4276-9223-50e8cd75fb27-host-slash\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-modprobe-d\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785178    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-lib-modules\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785297    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f4fb18b-e57a-4276-9223-50e8cd75fb27-host-slash\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.785316 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9369b817-e406-4f2f-8bff-f1778ecbaca3-hosts-file\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92657a6c-4994-48bd-9cee-1fff67142f33-agent-certs\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785453    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9369b817-e406-4f2f-8bff-f1778ecbaca3-hosts-file\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f4fb18b-e57a-4276-9223-50e8cd75fb27-iptables-alerter-script\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-kubelet-config\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcz7f\" (UniqueName: \"kubernetes.io/projected/622994b3-c77d-4986-b4d9-14ca1e1ba65c-kube-api-access-pcz7f\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cnibin\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-kubelet-config\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysconfig\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-kubernetes\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-system-cni-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-systemd\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92657a6c-4994-48bd-9cee-1fff67142f33-konnectivity-ca\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785758    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cnibin\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.785788    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785808    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-sysconfig\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.785888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785848    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-system-cni-dir\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.785859    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:32:59.285820407 +0000 UTC m=+3.093325122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-systemd\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-kubernetes\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785941    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9369b817-e406-4f2f-8bff-f1778ecbaca3-tmp-dir\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.785996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-os-release\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-sys\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786108    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/622994b3-c77d-4986-b4d9-14ca1e1ba65c-sys\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786110    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-os-release\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9369b817-e406-4f2f-8bff-f1778ecbaca3-tmp-dir\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4shp\" (UniqueName: \"kubernetes.io/projected/9369b817-e406-4f2f-8bff-f1778ecbaca3-kube-api-access-c4shp\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-dbus\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-tmp\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:32:58.786813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.787642 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786604    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f4fb18b-e57a-4276-9223-50e8cd75fb27-iptables-alerter-script\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.787642 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786724    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f8a360a-445d-4b95-a3d3-e55af866d18d-dbus\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:58.787642 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.786819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.787642 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.787169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-cni-binary-copy\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.787847 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.787803    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-etc-tuned\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.788626 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.788606    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92657a6c-4994-48bd-9cee-1fff67142f33-agent-certs\") pod \"konnectivity-agent-2tknl\" (UID: \"92657a6c-4994-48bd-9cee-1fff67142f33\") " pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.788748 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.788733    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/622994b3-c77d-4986-b4d9-14ca1e1ba65c-tmp\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.793261 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.793227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfr8q\" (UniqueName: \"kubernetes.io/projected/3b387cd7-f7dc-458d-87de-e7d4ae2c7500-kube-api-access-dfr8q\") pod \"multus-additional-cni-plugins-8hxlj\" (UID: \"3b387cd7-f7dc-458d-87de-e7d4ae2c7500\") " pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:58.793359 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.793227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2rz\" (UniqueName: \"kubernetes.io/projected/5f4fb18b-e57a-4276-9223-50e8cd75fb27-kube-api-access-6n2rz\") pod \"iptables-alerter-xxhd5\" (UID: \"5f4fb18b-e57a-4276-9223-50e8cd75fb27\") " pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.794537 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.794519    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:32:58.794640 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.794543    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:32:58.794640 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.794556    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:32:58.794640 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:58.794608    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:32:59.294593063 +0000 UTC m=+3.102097794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:32:58.796339 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.796314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcz7f\" (UniqueName: \"kubernetes.io/projected/622994b3-c77d-4986-b4d9-14ca1e1ba65c-kube-api-access-pcz7f\") pod \"tuned-4b6mh\" (UID: \"622994b3-c77d-4986-b4d9-14ca1e1ba65c\") " pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.796587 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.796565    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4shp\" (UniqueName: \"kubernetes.io/projected/9369b817-e406-4f2f-8bff-f1778ecbaca3-kube-api-access-c4shp\") pod \"node-resolver-hc2xf\" (UID: \"9369b817-e406-4f2f-8bff-f1778ecbaca3\") " pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.874588 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.874562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:32:58.880179 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.880157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6"
Jun 09 09:32:58.890240 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.890219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s647z"
Jun 09 09:32:58.895764 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.895746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tgtqb"
Jun 09 09:32:58.901359 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.901333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4b6mh"
Jun 09 09:32:58.907850 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.907816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:32:58.915308 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.915291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xxhd5"
Jun 09 09:32:58.921790 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.921773    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hc2xf"
Jun 09 09:32:58.927253 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:58.927236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8hxlj"
Jun 09 09:32:59.189582 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.189553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:32:59.189733 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.189690    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:32:59.189774 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.189744    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:00.189729506 +0000 UTC m=+3.997234214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:32:59.290405 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.290372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:32:59.290550 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.290471    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:32:59.290550 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.290527    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:33:00.290507545 +0000 UTC m=+4.098012257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:32:59.391419 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.391390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:32:59.391579 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.391561    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:32:59.391617 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.391584    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:32:59.391617 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.391595    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:32:59.391680 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.391647    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:00.391630863 +0000 UTC m=+4.199135592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:32:59.542837 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.542801    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb61630_9d6c_4685_9c96_ad5a997ff30b.slice/crio-0634c97d51c083aaca80294bff3d1791f802044253fcdfabc7a13447d7ff4990 WatchSource:0}: Error finding container 0634c97d51c083aaca80294bff3d1791f802044253fcdfabc7a13447d7ff4990: Status 404 returned error can't find the container with id 0634c97d51c083aaca80294bff3d1791f802044253fcdfabc7a13447d7ff4990
Jun 09 09:32:59.543783 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.543758    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod281b27f8_d59f_489b_9164_e9a08b780af0.slice/crio-287b5a1bcbf1218e3651883f6f6af18a1739285e33ad79b938509efd4af693d7 WatchSource:0}: Error finding container 287b5a1bcbf1218e3651883f6f6af18a1739285e33ad79b938509efd4af693d7: Status 404 returned error can't find the container with id 287b5a1bcbf1218e3651883f6f6af18a1739285e33ad79b938509efd4af693d7
Jun 09 09:32:59.545151 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.544703    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff120835_01c5_41f2_9a39_c42d4fced1ce.slice/crio-d2ed9e17262348b386e1a8b648c22278a4b09b99495d830e51191acc4e78aa1e WatchSource:0}: Error finding container d2ed9e17262348b386e1a8b648c22278a4b09b99495d830e51191acc4e78aa1e: Status 404 returned error can't find the container with id d2ed9e17262348b386e1a8b648c22278a4b09b99495d830e51191acc4e78aa1e
Jun 09 09:32:59.549639 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.549618    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b387cd7_f7dc_458d_87de_e7d4ae2c7500.slice/crio-0bd743b1815697b478127e04c2e4957c3278c5233ed9053608e01c4fd804c06a WatchSource:0}: Error finding container 0bd743b1815697b478127e04c2e4957c3278c5233ed9053608e01c4fd804c06a: Status 404 returned error can't find the container with id 0bd743b1815697b478127e04c2e4957c3278c5233ed9053608e01c4fd804c06a
Jun 09 09:32:59.570796 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.570778    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92657a6c_4994_48bd_9cee_1fff67142f33.slice/crio-fa99698287f07a635b14deb2b1c3b77c6066282e9b4dcd3bec274f1ef875890b WatchSource:0}: Error finding container fa99698287f07a635b14deb2b1c3b77c6066282e9b4dcd3bec274f1ef875890b: Status 404 returned error can't find the container with id fa99698287f07a635b14deb2b1c3b77c6066282e9b4dcd3bec274f1ef875890b
Jun 09 09:32:59.572234 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.572213    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622994b3_c77d_4986_b4d9_14ca1e1ba65c.slice/crio-4fb5c25138d10afdb52846d55496388373968426aa4eb7702679e32e731f33b6 WatchSource:0}: Error finding container 4fb5c25138d10afdb52846d55496388373968426aa4eb7702679e32e731f33b6: Status 404 returned error can't find the container with id 4fb5c25138d10afdb52846d55496388373968426aa4eb7702679e32e731f33b6
Jun 09 09:32:59.574015 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.573968    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9369b817_e406_4f2f_8bff_f1778ecbaca3.slice/crio-192c5a5e005d59d4220017c2f7f95a45d2c399e072aba684757c5c1b2f3b3f2b WatchSource:0}: Error finding container 192c5a5e005d59d4220017c2f7f95a45d2c399e072aba684757c5c1b2f3b3f2b: Status 404 returned error can't find the container with id 192c5a5e005d59d4220017c2f7f95a45d2c399e072aba684757c5c1b2f3b3f2b
Jun 09 09:32:59.575852 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.575801    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba5f058_390f_4bf4_bacd_f61b46c312fa.slice/crio-bcede41db55d47d5cd0a759212706082b269bc53652196ce9cd7889fd3d831e0 WatchSource:0}: Error finding container bcede41db55d47d5cd0a759212706082b269bc53652196ce9cd7889fd3d831e0: Status 404 returned error can't find the container with id bcede41db55d47d5cd0a759212706082b269bc53652196ce9cd7889fd3d831e0
Jun 09 09:32:59.576818 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:32:59.576790    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4fb18b_e57a_4276_9223_50e8cd75fb27.slice/crio-90d18b0aaa640d0f5e411457e3ad8ae6d613342d68fda70e55d3735e83b4d5d6 WatchSource:0}: Error finding container 90d18b0aaa640d0f5e411457e3ad8ae6d613342d68fda70e55d3735e83b4d5d6: Status 404 returned error can't find the container with id 90d18b0aaa640d0f5e411457e3ad8ae6d613342d68fda70e55d3735e83b4d5d6
Jun 09 09:32:59.612776 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.612622    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:27:58 +0000 UTC" deadline="2027-11-08 22:19:06.260714119 +0000 UTC"
Jun 09 09:32:59.612776 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.612768    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12420h46m6.647949006s"
Jun 09 09:32:59.638706 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.638679    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:32:59.638804 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:32:59.638777    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:32:59.645602 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.645580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hc2xf" event={"ID":"9369b817-e406-4f2f-8bff-f1778ecbaca3","Type":"ContainerStarted","Data":"192c5a5e005d59d4220017c2f7f95a45d2c399e072aba684757c5c1b2f3b3f2b"}
Jun 09 09:32:59.646734 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.646712    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4b6mh" event={"ID":"622994b3-c77d-4986-b4d9-14ca1e1ba65c","Type":"ContainerStarted","Data":"4fb5c25138d10afdb52846d55496388373968426aa4eb7702679e32e731f33b6"}
Jun 09 09:32:59.647756 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.647737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2tknl" event={"ID":"92657a6c-4994-48bd-9cee-1fff67142f33","Type":"ContainerStarted","Data":"fa99698287f07a635b14deb2b1c3b77c6066282e9b4dcd3bec274f1ef875890b"}
Jun 09 09:32:59.648760 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.648738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerStarted","Data":"0bd743b1815697b478127e04c2e4957c3278c5233ed9053608e01c4fd804c06a"}
Jun 09 09:32:59.649749 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.649709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"d2ed9e17262348b386e1a8b648c22278a4b09b99495d830e51191acc4e78aa1e"}
Jun 09 09:32:59.650852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.650815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tgtqb" event={"ID":"0ba5f058-390f-4bf4-bacd-f61b46c312fa","Type":"ContainerStarted","Data":"bcede41db55d47d5cd0a759212706082b269bc53652196ce9cd7889fd3d831e0"}
Jun 09 09:32:59.651872 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.651851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s647z" event={"ID":"281b27f8-d59f-489b-9164-e9a08b780af0","Type":"ContainerStarted","Data":"287b5a1bcbf1218e3651883f6f6af18a1739285e33ad79b938509efd4af693d7"}
Jun 09 09:32:59.652952 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.652927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6" event={"ID":"ebb61630-9d6c-4685-9c96-ad5a997ff30b","Type":"ContainerStarted","Data":"0634c97d51c083aaca80294bff3d1791f802044253fcdfabc7a13447d7ff4990"}
Jun 09 09:32:59.653973 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:32:59.653954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xxhd5" event={"ID":"5f4fb18b-e57a-4276-9223-50e8cd75fb27","Type":"ContainerStarted","Data":"90d18b0aaa640d0f5e411457e3ad8ae6d613342d68fda70e55d3735e83b4d5d6"}
Jun 09 09:33:00.198702 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.197954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:00.198702 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.198215    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:00.198702 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.198278    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:02.198258898 +0000 UTC m=+6.005763684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:00.298614 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.298575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:00.298790 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.298713    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:00.298790 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.298773    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:33:02.298754834 +0000 UTC m=+6.106259549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:00.399363 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.399325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:00.399534 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.399520    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:33:00.399606 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.399540    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:33:00.399606 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.399553    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:00.399703 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.399609    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:02.399591894 +0000 UTC m=+6.207096608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:00.613360 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.613318    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 09:27:58 +0000 UTC" deadline="2028-03-26 12:10:18.607521644 +0000 UTC"
Jun 09 09:33:00.613360 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.613357    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15746h37m17.994168668s"
Jun 09 09:33:00.641597 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.641570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:00.641732 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.641705    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:00.642114 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.642091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:00.642208 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:00.642188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:00.690236 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.690203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" event={"ID":"14fb097f239e19efddd2e39d86ec19ca","Type":"ContainerStarted","Data":"b19cd7e8bc34d539b183bb36adc9dbb24af3b691716df37da5515f95053dde80"}
Jun 09 09:33:00.701050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.700988    2563 generic.go:356] "Generic (PLEG): container finished" podID="b52206449a4d0db0305a3ff5a05ef557" containerID="d0e1ca2425f7a7f80b94851dbe0715c7731df0c070f3fea423ad6131daf8d3ac" exitCode=0
Jun 09 09:33:00.701168 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.701037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"b52206449a4d0db0305a3ff5a05ef557","Type":"ContainerDied","Data":"d0e1ca2425f7a7f80b94851dbe0715c7731df0c070f3fea423ad6131daf8d3ac"}
Jun 09 09:33:00.737983 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:00.735089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-66.ec2.internal" podStartSLOduration=3.735070091 podStartE2EDuration="3.735070091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:00.706627207 +0000 UTC m=+4.514131941" watchObservedRunningTime="2026-06-09 09:33:00.735070091 +0000 UTC m=+4.542574825"
Jun 09 09:33:01.639582 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:01.639537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:01.640105 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:01.639659    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:01.721444 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:01.721396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" event={"ID":"b52206449a4d0db0305a3ff5a05ef557","Type":"ContainerStarted","Data":"f429ab9da2a520bf1fccbd04626eb5a200c9b7a029b87f7440de222c1216ca12"}
Jun 09 09:33:01.739453 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:01.738867    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-66.ec2.internal" podStartSLOduration=4.738847506 podStartE2EDuration="4.738847506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:01.738500464 +0000 UTC m=+5.546005188" watchObservedRunningTime="2026-06-09 09:33:01.738847506 +0000 UTC m=+5.546352235"
Jun 09 09:33:02.214844 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:02.214797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:02.215049 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.214968    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:02.215049 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.215031    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:06.215012791 +0000 UTC m=+10.022517505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:02.315923 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:02.315891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:02.316096 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.316038    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:02.316152 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.316097    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:33:06.316078137 +0000 UTC m=+10.123582930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:02.417659 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:02.417060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:02.417659 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.417231    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:33:02.417659 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.417262    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:33:02.417659 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.417275    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:02.417659 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.417331    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:06.417313972 +0000 UTC m=+10.224818685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:02.641626 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:02.641597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:02.642084 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.641715    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:02.642167 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:02.642104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:02.642248 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:02.642214    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:03.638695 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:03.638663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:03.638895 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:03.638790    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:04.639020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:04.638986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:04.639020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:04.639007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:04.639518 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:04.639125    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:04.639518 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:04.639262    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:05.639295 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:05.639257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:05.639740 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:05.639383    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:06.254143 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:06.250082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:06.254143 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.251290    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:06.254143 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.251371    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:14.251349509 +0000 UTC m=+18.058854233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:06.351871 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:06.351817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:06.352032 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.351979    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:06.352155 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.352048    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:33:14.352029474 +0000 UTC m=+18.159534188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:06.453193 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:06.453064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:06.453385 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.453238    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:33:06.453385 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.453272    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:33:06.453385 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.453285    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:06.453385 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.453342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:14.45332401 +0000 UTC m=+18.260828724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:06.639415 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:06.639341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:06.639415 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:06.639377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:06.639999 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.639482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:06.640615 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:06.640578    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:07.638877 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:07.638843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:07.639052 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:07.638973    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:08.638761 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:08.638730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:08.639249 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:08.638893    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:08.639249 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:08.638943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:08.639249 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:08.639075    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:09.638557 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:09.638519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:09.638731 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:09.638643    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:10.638762 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:10.638730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:10.639189 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:10.638770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:10.639189 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:10.638860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:10.639189 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:10.638996    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:11.638695 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:11.638667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:11.638879 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:11.638767    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:12.639434 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:12.639402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:12.639793 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:12.639402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:12.639793 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:12.639554    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:12.639793 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:12.639592    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:13.639403 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:13.639375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:13.639570 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:13.639485    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:14.311049 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:14.311009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:14.311281 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.311169    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:14.311281 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.311244    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:30.31122211 +0000 UTC m=+34.118726823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:14.412202 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:14.412158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:14.412352 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.412268    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:14.412352 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.412321    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:33:30.412302959 +0000 UTC m=+34.219807668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:14.512893 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:14.512861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:14.513057 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.513038    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:33:14.513111 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.513061    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:33:14.513111 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.513072    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:14.513207 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.513131    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:33:30.513113489 +0000 UTC m=+34.320618211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:14.639036 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:14.638959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:14.639180 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:14.638963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:14.639180 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.639101    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:14.639282 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:14.639175    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:15.638961 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:15.638928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:15.639344 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:15.639047    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:16.639290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:16.639257    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:16.639719 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:16.639359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:16.639719 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:16.639460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:16.639719 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:16.639612    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:17.638586 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:17.638548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:17.638773 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:17.638667    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:18.639469 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.639309    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:18.640015 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.639387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:18.640015 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:18.639546    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:18.640015 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:18.639654    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:18.752400 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.752334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hc2xf" event={"ID":"9369b817-e406-4f2f-8bff-f1778ecbaca3","Type":"ContainerStarted","Data":"af2c1788b140a5d0aad9a4477d37071663362ec24b574c7645f7416e1e9ed3be"}
Jun 09 09:33:18.754012 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.753975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4b6mh" event={"ID":"622994b3-c77d-4986-b4d9-14ca1e1ba65c","Type":"ContainerStarted","Data":"0d7d7d7ea38685feeabd6b8e2daa2d779d6416e94879b37c41f3c289dcd7aa68"}
Jun 09 09:33:18.755697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.755559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2tknl" event={"ID":"92657a6c-4994-48bd-9cee-1fff67142f33","Type":"ContainerStarted","Data":"368e7386c0adae367abbf62a1b9d8fd7e1cb4f8a8d6adfddb2f7bad18840a5e1"}
Jun 09 09:33:18.757431 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.757407    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="7aa1f418582fae25610e95558294002d1c75f4d25dfac6772f4d9624dbc6905a" exitCode=0
Jun 09 09:33:18.757517 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.757484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"7aa1f418582fae25610e95558294002d1c75f4d25dfac6772f4d9624dbc6905a"}
Jun 09 09:33:18.759938 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.759923    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:33:18.760535 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.760257    2563 generic.go:356] "Generic (PLEG): container finished" podID="ff120835-01c5-41f2-9a39-c42d4fced1ce" containerID="716007b4e2b3a793547da05ca3ca24972d110b2cf3ceecf3ba92f4f475e0e516" exitCode=1
Jun 09 09:33:18.760535 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.760326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"e2a86e844095be8e727301a1ec1daad241ac90eb3c52091599a451d5b424c9d8"}
Jun 09 09:33:18.760535 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.760389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"c8f82758d540e3eb1234ca8cd490a006ae4628b92b7ffbfe6ba92d9725b5ef85"}
Jun 09 09:33:18.760535 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.760434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerDied","Data":"716007b4e2b3a793547da05ca3ca24972d110b2cf3ceecf3ba92f4f475e0e516"}
Jun 09 09:33:18.760535 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.760481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"6e2e6cd0e0cb5cd4226ff20dca0836fd8428e73bc47d86a7bc5185cdba2ed9a5"}
Jun 09 09:33:18.761997 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.761974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tgtqb" event={"ID":"0ba5f058-390f-4bf4-bacd-f61b46c312fa","Type":"ContainerStarted","Data":"e794f5f4944263c8a76624325d74b104d528e29b5d3e6191cb911d590b1cad3d"}
Jun 09 09:33:18.763226 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.763209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s647z" event={"ID":"281b27f8-d59f-489b-9164-e9a08b780af0","Type":"ContainerStarted","Data":"68c43794bd88e6e98cb5d0edffcbdf2c312e472359abcb64e8eba6b694004593"}
Jun 09 09:33:18.764667 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.764645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6" event={"ID":"ebb61630-9d6c-4685-9c96-ad5a997ff30b","Type":"ContainerStarted","Data":"b54fbd7c8d515c72be80c81d737e92cdf0cab107b3e1f630a46874a06f4d5d4a"}
Jun 09 09:33:18.769212 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.769161    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hc2xf" podStartSLOduration=4.206867568 podStartE2EDuration="22.76914496s" totalImagesPullingTime="18.562277392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:18.76806881 +0000 UTC m=+22.575573544" watchObservedRunningTime="2026-06-09 09:33:18.76914496 +0000 UTC m=+22.576649690"
Jun 09 09:33:18.800434 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.800299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s647z" podStartSLOduration=4.201928115 podStartE2EDuration="22.800282208s" totalImagesPullingTime="18.598354093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:18.800192946 +0000 UTC m=+22.607697676" watchObservedRunningTime="2026-06-09 09:33:18.800282208 +0000 UTC m=+22.607786940"
Jun 09 09:33:18.800705 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.800683    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4b6mh" podStartSLOduration=4.229783027 podStartE2EDuration="22.800675634s" totalImagesPullingTime="18.570892607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:18.7832352 +0000 UTC m=+22.590739924" watchObservedRunningTime="2026-06-09 09:33:18.800675634 +0000 UTC m=+22.608180365"
Jun 09 09:33:18.837351 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.837316    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2tknl" podStartSLOduration=4.264092063 podStartE2EDuration="22.837308087s" totalImagesPullingTime="18.573216024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:18.81455889 +0000 UTC m=+22.622063620" watchObservedRunningTime="2026-06-09 09:33:18.837308087 +0000 UTC m=+22.644812818"
Jun 09 09:33:18.862018 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:18.861976    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tgtqb" podStartSLOduration=4.290605183 podStartE2EDuration="22.86195997s" totalImagesPullingTime="18.571354787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:18.861521912 +0000 UTC m=+22.669026643" watchObservedRunningTime="2026-06-09 09:33:18.86195997 +0000 UTC m=+22.669464701"
Jun 09 09:33:19.001239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.001198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:19.083914 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.083866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:19.185635 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.185610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:19.639451 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.639429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:19.639601 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:19.639579    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:19.716426 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.716403    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 09 09:33:19.768494 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.768460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xxhd5" event={"ID":"5f4fb18b-e57a-4276-9223-50e8cd75fb27","Type":"ContainerStarted","Data":"8e6dafe7bf74db24d9fc3146d918f2cbea727db2e2a44041626952c2eb8242bf"}
Jun 09 09:33:19.772085 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.772064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:33:19.772490 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.772470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"6730eed5d6e1fbdfe5c066a9e659a668a6c6cf4d6f6d579b06b7ead333a581c4"}
Jun 09 09:33:19.772578 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.772545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"f66f7468c58c6d73116c0f5c50069e56e26f6448a2d32979e183934d7dfdcd5f"}
Jun 09 09:33:19.774478 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.774458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6" event={"ID":"ebb61630-9d6c-4685-9c96-ad5a997ff30b","Type":"ContainerStarted","Data":"8ca12a2f8297057de6f25d594ee008d1eeade24335762a880eeb54e25312759a"}
Jun 09 09:33:19.784885 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:19.784818    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xxhd5" podStartSLOduration=5.25262886 podStartE2EDuration="23.784805643s" totalImagesPullingTime="18.532176783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:19.784686428 +0000 UTC m=+23.592191159" watchObservedRunningTime="2026-06-09 09:33:19.784805643 +0000 UTC m=+23.592310373"
Jun 09 09:33:20.008259 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.008220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:20.073843 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.073794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:20.538004 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.537970    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:33:20.538544 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.538521    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:33:20.639338 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.639239    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T09:33:19.716422526Z","UUID":"22d6bced-3c9d-40c9-bf8c-58c49cda9c0a","Handler":null,"Name":"","Endpoint":""}
Jun 09 09:33:20.639543 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.639522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:20.639679 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:20.639640    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:20.640063 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.639684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:20.640063 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:20.639802    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:20.641020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.641001    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 09 09:33:20.641109 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.641043    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 09 09:33:20.779632 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.779594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6" event={"ID":"ebb61630-9d6c-4685-9c96-ad5a997ff30b","Type":"ContainerStarted","Data":"3f861de612c3918052970f77568593603d9abda1ff5d22b82f20b91247caf796"}
Jun 09 09:33:20.780133 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.780045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:33:20.780430 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.780410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2tknl"
Jun 09 09:33:20.801235 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.801132    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zstp6" podStartSLOduration=4.255411894 podStartE2EDuration="24.801116268s" totalImagesPullingTime="20.545704374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:20.79721954 +0000 UTC m=+24.604724264" watchObservedRunningTime="2026-06-09 09:33:20.801116268 +0000 UTC m=+24.608620998"
Jun 09 09:33:20.866991 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:20.866957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:21.286138 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:21.285931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:21.381507 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:21.381426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:21.638936 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:21.638866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:21.639082 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:21.638971    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:21.785690 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:21.785656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:33:21.786157 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:21.786085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"52ae424c1d0049cf6826c1c041b8b3d7c2f4a8a66f75b76c45ec610260d0ab3e"}
Jun 09 09:33:22.638953 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:22.638919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:22.639131 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:22.638919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:22.639131 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:22.639060    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:22.639131 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:22.639087    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:23.639163 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.638993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:23.639861 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:23.639230    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:23.791864 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.791815    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="d2c9affab067464c8e56beb9764ea72410c615281995fff05999efc28e2b7228" exitCode=0
Jun 09 09:33:23.792026 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.791898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"d2c9affab067464c8e56beb9764ea72410c615281995fff05999efc28e2b7228"}
Jun 09 09:33:23.795529 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.795515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:33:23.795857 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.795835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"9cca7c6dfe4dc4c51c7ee40034bd984b4f83514e912edb9fbfa49d67083f35b5"}
Jun 09 09:33:23.796141 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.796120    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:23.796244 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.796190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:23.796350 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.796336    2563 scope.go:117] "RemoveContainer" containerID="716007b4e2b3a793547da05ca3ca24972d110b2cf3ceecf3ba92f4f475e0e516"
Jun 09 09:33:23.812337 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:23.812304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:24.638903 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.638870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:24.639068 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:24.639001    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:24.639068 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.639048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:24.639185 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:24.639147    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:24.800414 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.800379    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="3f27950a982117ab9e7b6bedff14c3c5677c2ff1badc41aa1e1ad07802d0b3b3" exitCode=0
Jun 09 09:33:24.800553 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.800480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"3f27950a982117ab9e7b6bedff14c3c5677c2ff1badc41aa1e1ad07802d0b3b3"}
Jun 09 09:33:24.804643 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.804626    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:33:24.805038 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.804954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" event={"ID":"ff120835-01c5-41f2-9a39-c42d4fced1ce","Type":"ContainerStarted","Data":"a82410e6df096e73ceb127f98e0dea91477b0708cb799fb6763126a43a2f4091"}
Jun 09 09:33:24.805391 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.805247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:24.821190 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.821171    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:24.855037 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:24.854575    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2" podStartSLOduration=10.207072936 podStartE2EDuration="28.854557077s" totalImagesPullingTime="18.647484141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:24.854141565 +0000 UTC m=+28.661646307" watchObservedRunningTime="2026-06-09 09:33:24.854557077 +0000 UTC m=+28.662061818"
Jun 09 09:33:25.078872 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.078793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znq7n"]
Jun 09 09:33:25.078985 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.078906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:25.079037 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:25.078988    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:25.081664 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.081628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kcrvz"]
Jun 09 09:33:25.081802 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.081736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:25.081940 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:25.081899    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:25.082565 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.082540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jzv6f"]
Jun 09 09:33:25.082676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.082664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:25.082772 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:25.082751    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:25.809082 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.808896    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="dda99413a41e2f632c78afb772bb754b4afba1a6c0969d1763dcbf94eebb8b81" exitCode=0
Jun 09 09:33:25.809498 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:25.808954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"dda99413a41e2f632c78afb772bb754b4afba1a6c0969d1763dcbf94eebb8b81"}
Jun 09 09:33:26.640393 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:26.640366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:26.640561 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:26.640467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:26.640561 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:26.640499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:26.640561 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:26.640538    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:26.640745 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:26.640565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:26.640745 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:26.640653    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:28.498431 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:28.498389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:28.554194 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:28.554158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:28.638776 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:28.638704    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:28.638976 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:28.638708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:28.638976 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:28.638845    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:28.638976 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:28.638854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:28.638976 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:28.638956    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:28.639178 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:28.639044    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:29.858481 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:29.858455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:29.924151 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:29.924121    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:30.336839 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.336792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:30.337024 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.336936    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:30.337024 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.336993    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:02.336978472 +0000 UTC m=+66.144483181 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 09:33:30.437883 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.437781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:30.438028 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.437935    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:30.438028 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.438003    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret podName:7f8a360a-445d-4b95-a3d3-e55af866d18d nodeName:}" failed. No retries permitted until 2026-06-09 09:34:02.43798217 +0000 UTC m=+66.245486879 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret") pod "global-pull-secret-syncer-znq7n" (UID: "7f8a360a-445d-4b95-a3d3-e55af866d18d") : object "kube-system"/"original-pull-secret" not registered
Jun 09 09:33:30.538371 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.538344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:30.538518 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.538486    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 09:33:30.538518 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.538500    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 09:33:30.538518 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.538509    2563 projected.go:196] Error preparing data for projected volume kube-api-access-wpw2l for pod openshift-network-diagnostics/network-check-target-jzv6f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:30.538620 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.538566    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l podName:0682753a-991c-46fe-8efb-1e53aa727d83 nodeName:}" failed. No retries permitted until 2026-06-09 09:34:02.538538514 +0000 UTC m=+66.346043223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wpw2l" (UniqueName: "kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l") pod "network-check-target-jzv6f" (UID: "0682753a-991c-46fe-8efb-1e53aa727d83") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 09:33:30.639009 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.638976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:30.639334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.639310    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:30.639417 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.639386    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-znq7n" podUID="7f8a360a-445d-4b95-a3d3-e55af866d18d"
Jun 09 09:33:30.639488 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.639474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:30.639539 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.639475    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jzv6f" podUID="0682753a-991c-46fe-8efb-1e53aa727d83"
Jun 09 09:33:30.639661 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:30.639636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:33:30.823385 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.823358    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="da3fb0bb88c08817fc40ae6db7d860758748f6a7bf701b9bce8e0c7b155b7d7b" exitCode=0
Jun 09 09:33:30.823563 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.823407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"da3fb0bb88c08817fc40ae6db7d860758748f6a7bf701b9bce8e0c7b155b7d7b"}
Jun 09 09:33:30.976375 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.976342    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-66.ec2.internal" event="NodeReady"
Jun 09 09:33:30.976769 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:30.976503    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 09 09:33:31.019739 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.019714    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7hf6s"]
Jun 09 09:33:31.029684 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.029664    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kpsbf"]
Jun 09 09:33:31.029807 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.029792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.032215 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.032154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 09 09:33:31.032302 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.032228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 09 09:33:31.032358 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.032318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\""
Jun 09 09:33:31.041890 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.041873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7hf6s"]
Jun 09 09:33:31.041964 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.041904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kpsbf"]
Jun 09 09:33:31.041964 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.041961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.044348 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.044331    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 09 09:33:31.044425 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.044357    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 09 09:33:31.044490 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.044470    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 09 09:33:31.044546 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.044529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kgzwn\""
Jun 09 09:33:31.142908 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.142859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b89759f7-7620-435e-85d0-d4279cac08f1-cert\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.143020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.142920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-config-volume\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.143020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.142945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-tmp-dir\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.143020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.142974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-kube-api-access-ncs6r\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.143020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.143007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.143187 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.143060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j46l\" (UniqueName: \"kubernetes.io/projected/b89759f7-7620-435e-85d0-d4279cac08f1-kube-api-access-8j46l\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.157156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.157126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:31.219782 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.219760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:31.243704 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j46l\" (UniqueName: \"kubernetes.io/projected/b89759f7-7620-435e-85d0-d4279cac08f1-kube-api-access-8j46l\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.243792 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b89759f7-7620-435e-85d0-d4279cac08f1-cert\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.243792 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-config-volume\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.243888 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-tmp-dir\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.243922 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-kube-api-access-ncs6r\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.243955 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.243928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.244059 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:31.244045    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:31.244143 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:31.244106    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:33:31.744089492 +0000 UTC m=+35.551594207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:31.244220 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.244205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-tmp-dir\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.244425 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.244407    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-config-volume\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.247856 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.247839    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b89759f7-7620-435e-85d0-d4279cac08f1-cert\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.252334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.252308    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-kube-api-access-ncs6r\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.252709 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.252689    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j46l\" (UniqueName: \"kubernetes.io/projected/b89759f7-7620-435e-85d0-d4279cac08f1-kube-api-access-8j46l\") pod \"ingress-canary-kpsbf\" (UID: \"b89759f7-7620-435e-85d0-d4279cac08f1\") " pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.356775 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.356735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kpsbf"
Jun 09 09:33:31.521186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.521019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kpsbf"]
Jun 09 09:33:31.525001 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:33:31.524966    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89759f7_7620_435e_85d0_d4279cac08f1.slice/crio-7a758cc9ea739d8a4572a5b7781ce5fb9b29d9a5344b2e824b4ce7c52af4fb02 WatchSource:0}: Error finding container 7a758cc9ea739d8a4572a5b7781ce5fb9b29d9a5344b2e824b4ce7c52af4fb02: Status 404 returned error can't find the container with id 7a758cc9ea739d8a4572a5b7781ce5fb9b29d9a5344b2e824b4ce7c52af4fb02
Jun 09 09:33:31.748000 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.747969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:31.748184 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:31.748104    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:31.748184 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:31.748167    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:33:32.7481516 +0000 UTC m=+36.555656308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:31.829185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.829159    2563 generic.go:356] "Generic (PLEG): container finished" podID="3b387cd7-f7dc-458d-87de-e7d4ae2c7500" containerID="3a637e3a03c04d9f374bdd28ef9994e30e0ac0d08521ed52f1fae2e02904723b" exitCode=0
Jun 09 09:33:31.829376 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.829221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerDied","Data":"3a637e3a03c04d9f374bdd28ef9994e30e0ac0d08521ed52f1fae2e02904723b"}
Jun 09 09:33:31.830366 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:31.830340    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kpsbf" event={"ID":"b89759f7-7620-435e-85d0-d4279cac08f1","Type":"ContainerStarted","Data":"7a758cc9ea739d8a4572a5b7781ce5fb9b29d9a5344b2e824b4ce7c52af4fb02"}
Jun 09 09:33:32.639385 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.639349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:33:32.639937 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.639349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:33:32.639937 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.639349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:33:32.643804 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643781    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 09:33:32.643960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643783    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 09:33:32.643960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643854    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 09:33:32.643960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643873    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\""
Jun 09 09:33:32.643960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643911    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 09:33:32.643960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.643785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\""
Jun 09 09:33:32.753518 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.753490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:32.753665 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:32.753630    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:32.753706 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:32.753698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:33:34.753683743 +0000 UTC m=+38.561188452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:32.837205 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.837165    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" event={"ID":"3b387cd7-f7dc-458d-87de-e7d4ae2c7500","Type":"ContainerStarted","Data":"85a26aa4d0c789b5316d48891a332358af9f9eea5182c0d60bc4d0923d653fde"}
Jun 09 09:33:32.860810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:32.860730    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8hxlj" podStartSLOduration=8.792876922 podStartE2EDuration="36.860712926s" totalImagesPullingTime="28.067836004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:32.859194143 +0000 UTC m=+36.666698874" watchObservedRunningTime="2026-06-09 09:33:32.860712926 +0000 UTC m=+36.668217655"
Jun 09 09:33:33.085636 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:33.085599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:33.141842 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:33.141784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:33.842618 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:33.842584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kpsbf" event={"ID":"b89759f7-7620-435e-85d0-d4279cac08f1","Type":"ContainerStarted","Data":"c9c3450011f1f07a9c146f0030e2a78ded440ca9302a6ecd37b5b0e25951c9a5"}
Jun 09 09:33:33.861792 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:33.861748    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kpsbf" podStartSLOduration=0.703462909 podStartE2EDuration="2.861732896s" totalImagesPullingTime="2.158269987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:33.860563446 +0000 UTC m=+37.668068176" watchObservedRunningTime="2026-06-09 09:33:33.861732896 +0000 UTC m=+37.669237626"
Jun 09 09:33:34.769097 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:34.769064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:34.769266 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:34.769220    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:34.769311 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:34.769276    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:33:38.769262449 +0000 UTC m=+42.576767162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:35.896799 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:35.896765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:35.988639 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:35.988604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:36.065620 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:36.065585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:36.755162 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:36.755125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:36.836094 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:36.836062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:36.937391 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:36.937362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:37.039614 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:37.039542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:38.793972 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:38.793938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:38.794421 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:38.794062    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:38.794421 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:38.794145    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:33:46.794124148 +0000 UTC m=+50.601628857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:41.807100 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:41.807061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:41.878802 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:41.878771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:43.296978 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:43.296930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:46.844843 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:46.844792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:33:46.845276 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:46.844928    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:33:46.845276 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:33:46.844985    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:34:02.844970316 +0000 UTC m=+66.652475025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:33:47.074582 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:47.074546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:47.132934 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:47.132856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:51.930646 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:51.930605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:52.039164 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:52.039122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:52.507843 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:52.507800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:52.572034 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:52.572005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:54.663396 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.663365    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"]
Jun 09 09:33:54.666697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.666673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.669342 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.669322    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 09 09:33:54.670543 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.670518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2l964\""
Jun 09 09:33:54.670543 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.670535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 09 09:33:54.670683 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.670537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 09 09:33:54.670683 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.670518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 09 09:33:54.681088 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.681070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"]
Jun 09 09:33:54.696040 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.696017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgpl8\" (UniqueName: \"kubernetes.io/projected/04bd1699-dfff-4816-9b3e-dc28c6db3689-kube-api-access-mgpl8\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.696135 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.696055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bd1699-dfff-4816-9b3e-dc28c6db3689-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.796904 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.796878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgpl8\" (UniqueName: \"kubernetes.io/projected/04bd1699-dfff-4816-9b3e-dc28c6db3689-kube-api-access-mgpl8\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.796996 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.796913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bd1699-dfff-4816-9b3e-dc28c6db3689-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.800889 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.800868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04bd1699-dfff-4816-9b3e-dc28c6db3689-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.804965 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.804946    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgpl8\" (UniqueName: \"kubernetes.io/projected/04bd1699-dfff-4816-9b3e-dc28c6db3689-kube-api-access-mgpl8\") pod \"managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh\" (UID: \"04bd1699-dfff-4816-9b3e-dc28c6db3689\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:54.988398 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:54.988373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"
Jun 09 09:33:55.102771 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:55.102730    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh"]
Jun 09 09:33:55.106693 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:33:55.106670    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04bd1699_dfff_4816_9b3e_dc28c6db3689.slice/crio-f9c4c0b0fc538a2e6d864b8fe1c7e06cc0bffa7e9c36d2137939e8bdbb71b966 WatchSource:0}: Error finding container f9c4c0b0fc538a2e6d864b8fe1c7e06cc0bffa7e9c36d2137939e8bdbb71b966: Status 404 returned error can't find the container with id f9c4c0b0fc538a2e6d864b8fe1c7e06cc0bffa7e9c36d2137939e8bdbb71b966
Jun 09 09:33:55.898930 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:55.898894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh" event={"ID":"04bd1699-dfff-4816-9b3e-dc28c6db3689","Type":"ContainerStarted","Data":"f9c4c0b0fc538a2e6d864b8fe1c7e06cc0bffa7e9c36d2137939e8bdbb71b966"}
Jun 09 09:33:56.823460 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:56.823433    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lwgk2"
Jun 09 09:33:56.982703 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:56.982667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:57.044538 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:57.044507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:33:57.905559 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:57.905519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh" event={"ID":"04bd1699-dfff-4816-9b3e-dc28c6db3689","Type":"ContainerStarted","Data":"94f14f6daabb40c205711aafa11a6f288effb094a91af34ae1030f21d6b6dc74"}
Jun 09 09:33:57.923397 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:33:57.923354    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh" podStartSLOduration=1.650101863 podStartE2EDuration="3.923341051s" totalImagesPullingTime="2.273239188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:33:57.923123225 +0000 UTC m=+61.730627955" watchObservedRunningTime="2026-06-09 09:33:57.923341051 +0000 UTC m=+61.730845782"
Jun 09 09:34:02.343654 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.343616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:34:02.346581 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.346562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 09:34:02.354731 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:02.354710    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 09:34:02.354799 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:02.354767    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:35:06.354750387 +0000 UTC m=+130.162255099 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : secret "metrics-daemon-secret" not found
Jun 09 09:34:02.444794 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.444765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:34:02.447601 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.447584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 09:34:02.492183 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.492163    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f8a360a-445d-4b95-a3d3-e55af866d18d-original-pull-secret\") pod \"global-pull-secret-syncer-znq7n\" (UID: \"7f8a360a-445d-4b95-a3d3-e55af866d18d\") " pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:34:02.545164 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.545140    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:34:02.547742 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.547727    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 09:34:02.557905 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.557888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 09:34:02.567808 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.567786    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpw2l\" (UniqueName: \"kubernetes.io/projected/0682753a-991c-46fe-8efb-1e53aa727d83-kube-api-access-wpw2l\") pod \"network-check-target-jzv6f\" (UID: \"0682753a-991c-46fe-8efb-1e53aa727d83\") " pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:34:02.660134 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.660066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-znq7n"
Jun 09 09:34:02.663280 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.662981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bbl4j\""
Jun 09 09:34:02.670762 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.670741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:34:02.819113 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.819085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-znq7n"]
Jun 09 09:34:02.821928 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:34:02.821902    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8a360a_445d_4b95_a3d3_e55af866d18d.slice/crio-330ef77a019425a4c2d640ea91b9dba3af0b5580c158f93a7276e183b9aae4e4 WatchSource:0}: Error finding container 330ef77a019425a4c2d640ea91b9dba3af0b5580c158f93a7276e183b9aae4e4: Status 404 returned error can't find the container with id 330ef77a019425a4c2d640ea91b9dba3af0b5580c158f93a7276e183b9aae4e4
Jun 09 09:34:02.834578 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.834557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jzv6f"]
Jun 09 09:34:02.840363 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:34:02.840330    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0682753a_991c_46fe_8efb_1e53aa727d83.slice/crio-2a8fa78aa2246c814993117ec0e7ab04da111a1e1557ce57fd63be7f37942633 WatchSource:0}: Error finding container 2a8fa78aa2246c814993117ec0e7ab04da111a1e1557ce57fd63be7f37942633: Status 404 returned error can't find the container with id 2a8fa78aa2246c814993117ec0e7ab04da111a1e1557ce57fd63be7f37942633
Jun 09 09:34:02.848004 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.847984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:34:02.848104 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:02.848093    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:34:02.848162 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:02.848138    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:34:34.848123788 +0000 UTC m=+98.655628497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:34:02.918958 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.918883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znq7n" event={"ID":"7f8a360a-445d-4b95-a3d3-e55af866d18d","Type":"ContainerStarted","Data":"330ef77a019425a4c2d640ea91b9dba3af0b5580c158f93a7276e183b9aae4e4"}
Jun 09 09:34:02.919808 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:02.919789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jzv6f" event={"ID":"0682753a-991c-46fe-8efb-1e53aa727d83","Type":"ContainerStarted","Data":"2a8fa78aa2246c814993117ec0e7ab04da111a1e1557ce57fd63be7f37942633"}
Jun 09 09:34:07.935128 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:07.935083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jzv6f" event={"ID":"0682753a-991c-46fe-8efb-1e53aa727d83","Type":"ContainerStarted","Data":"ad435fc81b3884fca9a7bdd0c89dd6d1139748d53a9a4923fba6763f4d4cb993"}
Jun 09 09:34:07.935601 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:07.935160    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:34:07.936621 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:07.936598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-znq7n" event={"ID":"7f8a360a-445d-4b95-a3d3-e55af866d18d","Type":"ContainerStarted","Data":"9003e2e4c768dbd832a040b03a3d3858ee7d42ae8217089b237822ed688ddfb7"}
Jun 09 09:34:07.952368 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:07.952328    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jzv6f" podStartSLOduration=67.728050143 podStartE2EDuration="1m11.952310111s" totalImagesPullingTime="4.224259968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:07.951896587 +0000 UTC m=+71.759401320" watchObservedRunningTime="2026-06-09 09:34:07.952310111 +0000 UTC m=+71.759814838"
Jun 09 09:34:07.967671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:07.967630    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-znq7n" podStartSLOduration=67.718430293 podStartE2EDuration="1m11.967615006s" totalImagesPullingTime="4.249184713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:34:07.967198083 +0000 UTC m=+71.774702816" watchObservedRunningTime="2026-06-09 09:34:07.967615006 +0000 UTC m=+71.775119738"
Jun 09 09:34:14.912548 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:14.912513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:34:14.986133 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:14.986101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:34:34.850449 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:34.850416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:34:34.850789 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:34.850529    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:34:34.850789 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:34:34.850586    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:35:38.850572472 +0000 UTC m=+162.658077181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:34:38.942525 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:34:38.942489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jzv6f"
Jun 09 09:35:06.451863 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:06.451807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:35:06.452320 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:06.451983    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 09:35:06.452320 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:06.452070    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs podName:5167279c-68fd-4b23-9a4c-0c8cd92cd330 nodeName:}" failed. No retries permitted until 2026-06-09 09:37:08.452047947 +0000 UTC m=+252.259552655 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs") pod "network-metrics-daemon-kcrvz" (UID: "5167279c-68fd-4b23-9a4c-0c8cd92cd330") : secret "metrics-daemon-secret" not found
Jun 09 09:35:33.686448 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:33.686412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:35:34.052577 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:34.052546    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7hf6s" podUID="fc4bbbbf-18e4-4572-af37-9415a7f0d4bc"
Jun 09 09:35:34.137843 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:34.137799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:35:35.654750 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:35.654716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kcrvz" podUID="5167279c-68fd-4b23-9a4c-0c8cd92cd330"
Jun 09 09:35:38.865329 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:38.865291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:35:38.865768 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:38.865446    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 09:35:38.865768 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:35:38.865529    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls podName:fc4bbbbf-18e4-4572-af37-9415a7f0d4bc nodeName:}" failed. No retries permitted until 2026-06-09 09:37:40.865510076 +0000 UTC m=+284.673014785 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls") pod "dns-default-7hf6s" (UID: "fc4bbbbf-18e4-4572-af37-9415a7f0d4bc") : secret "dns-default-metrics-tls" not found
Jun 09 09:35:49.638787 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:49.638757    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:35:51.986049 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:51.986007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:35:58.198238 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:58.198202    2563 generic.go:356] "Generic (PLEG): container finished" podID="04bd1699-dfff-4816-9b3e-dc28c6db3689" containerID="94f14f6daabb40c205711aafa11a6f288effb094a91af34ae1030f21d6b6dc74" exitCode=255
Jun 09 09:35:58.198238 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:58.198241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh" event={"ID":"04bd1699-dfff-4816-9b3e-dc28c6db3689","Type":"ContainerDied","Data":"94f14f6daabb40c205711aafa11a6f288effb094a91af34ae1030f21d6b6dc74"}
Jun 09 09:35:58.203746 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:58.203725    2563 scope.go:117] "RemoveContainer" containerID="94f14f6daabb40c205711aafa11a6f288effb094a91af34ae1030f21d6b6dc74"
Jun 09 09:35:59.203571 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:35:59.203540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d87bc48b6-4k6xh" event={"ID":"04bd1699-dfff-4816-9b3e-dc28c6db3689","Type":"ContainerStarted","Data":"3929fe1e026ee06889f58962cbd8324877026c1613ac7555138261007e77edc9"}
Jun 09 09:36:16.718521 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.718486    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:36:16.722683 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.722649    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.726177 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.726157    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 09 09:36:16.726395 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.726382    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 09 09:36:16.727420 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.727405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6f9wj\""
Jun 09 09:36:16.730142 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.730121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 09 09:36:16.731256 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.731237    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 09 09:36:16.738240 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.738217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:36:16.803738 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.803709    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"]
Jun 09 09:36:16.806560 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.806545    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bjwc5"]
Jun 09 09:36:16.806650 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.806631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.809567 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.809545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x6b8d\""
Jun 09 09:36:16.809889 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.809874    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 09 09:36:16.809987 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.809943    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 09 09:36:16.810049 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.809994    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 09 09:36:16.810130 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.810109    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-hh6zb"]
Jun 09 09:36:16.810226 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.810213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:16.810710 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.810696    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 09 09:36:16.812617 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.812594    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 09 09:36:16.812838 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.812807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.812936 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.812811    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 09 09:36:16.813222 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.813206    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 09 09:36:16.813305 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.813274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bfdrt\""
Jun 09 09:36:16.813305 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.813296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 09 09:36:16.813900 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.813878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjl5c\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.813933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.814191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814026    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7w44\" (UniqueName: \"kubernetes.io/projected/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-kube-api-access-z7w44\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.814191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.814442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.814339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.815599 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.815584    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 09 09:36:16.819164 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.819130    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 09 09:36:16.819261 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.819195    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 09 09:36:16.819261 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.819141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nfwdg\""
Jun 09 09:36:16.819374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.819275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 09 09:36:16.824243 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.824220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"]
Jun 09 09:36:16.825272 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.825252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hh6zb"]
Jun 09 09:36:16.825574 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.825556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 09 09:36:16.826206 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.826188    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bjwc5"]
Jun 09 09:36:16.826481 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.826462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 09 09:36:16.897442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.897416    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"]
Jun 09 09:36:16.900162 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.900147    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"
Jun 09 09:36:16.902753 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.902726    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 09 09:36:16.902876 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.902730    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 09 09:36:16.903014 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.903001    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xltrv\""
Jun 09 09:36:16.910560 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.910542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"]
Jun 09 09:36:16.914853 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjl5c\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.914963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/717ad8b5-5bda-4ff7-ac03-6933003314ef-serving-cert\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.914963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-config\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:16.914963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-snapshots\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.914963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915172 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.914978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-tmp\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.915172 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915172 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xq89\" (UniqueName: \"kubernetes.io/projected/460c232b-ddcc-469f-9f2b-7c66ca881d4e-kube-api-access-5xq89\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-trusted-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wszbn\" (UniqueName: \"kubernetes.io/projected/717ad8b5-5bda-4ff7-ac03-6933003314ef-kube-api-access-wszbn\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:16.915313    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:16.915326    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fdd66c-mnqxs: secret "image-registry-tls" not found
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7w44\" (UniqueName: \"kubernetes.io/projected/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-kube-api-access-z7w44\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:16.915385    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls podName:58234a7a-357c-4d20-9506-32f859918e2d nodeName:}" failed. No retries permitted until 2026-06-09 09:36:17.415366904 +0000 UTC m=+201.222871629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls") pod "image-registry-788fdd66c-mnqxs" (UID: "58234a7a-357c-4d20-9506-32f859918e2d") : secret "image-registry-tls" not found
Jun 09 09:36:16.915390 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915389    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllkz\" (UniqueName: \"kubernetes.io/projected/7643d452-ad11-40f8-bbc7-af1efa764031-kube-api-access-fllkz\") pod \"volume-data-source-validator-78dd696465-4zczj\" (UID: \"7643d452-ad11-40f8-bbc7-af1efa764031\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/460c232b-ddcc-469f-9f2b-7c66ca881d4e-serving-cert\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-service-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-trusted-ca\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.916021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.915635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.916300 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.916134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.916300 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.916173    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.917715 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.917696    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.917780 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.917709    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.917945 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.917929    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.928658 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.928628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7w44\" (UniqueName: \"kubernetes.io/projected/2b1b34b5-fbff-4389-a6c6-4770ee9074d5-kube-api-access-z7w44\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-dng2v\" (UID: \"2b1b34b5-fbff-4389-a6c6-4770ee9074d5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:16.928785 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.928767    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.928932 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.928914    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjl5c\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:16.984231 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:16.984203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:17.015786 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllkz\" (UniqueName: \"kubernetes.io/projected/7643d452-ad11-40f8-bbc7-af1efa764031-kube-api-access-fllkz\") pod \"volume-data-source-validator-78dd696465-4zczj\" (UID: \"7643d452-ad11-40f8-bbc7-af1efa764031\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"
Jun 09 09:36:17.015899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/460c232b-ddcc-469f-9f2b-7c66ca881d4e-serving-cert\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.015899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-service-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.015899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-trusted-ca\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.015899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/717ad8b5-5bda-4ff7-ac03-6933003314ef-serving-cert\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.015899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.015879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-config\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.016146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-snapshots\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.016146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-tmp\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.016146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xq89\" (UniqueName: \"kubernetes.io/projected/460c232b-ddcc-469f-9f2b-7c66ca881d4e-kube-api-access-5xq89\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.016146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-trusted-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.016317 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wszbn\" (UniqueName: \"kubernetes.io/projected/717ad8b5-5bda-4ff7-ac03-6933003314ef-kube-api-access-wszbn\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.016513 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-service-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.016617 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.016582    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-config\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.018645 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.017349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-tmp\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.018645 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.017511    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/460c232b-ddcc-469f-9f2b-7c66ca881d4e-trusted-ca\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.018645 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.017713    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/717ad8b5-5bda-4ff7-ac03-6933003314ef-snapshots\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.018645 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.017742    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717ad8b5-5bda-4ff7-ac03-6933003314ef-trusted-ca-bundle\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.022023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.018963    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/717ad8b5-5bda-4ff7-ac03-6933003314ef-serving-cert\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.022023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.019258    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/460c232b-ddcc-469f-9f2b-7c66ca881d4e-serving-cert\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.024523 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.024495    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllkz\" (UniqueName: \"kubernetes.io/projected/7643d452-ad11-40f8-bbc7-af1efa764031-kube-api-access-fllkz\") pod \"volume-data-source-validator-78dd696465-4zczj\" (UID: \"7643d452-ad11-40f8-bbc7-af1efa764031\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"
Jun 09 09:36:17.025373 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.025355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xq89\" (UniqueName: \"kubernetes.io/projected/460c232b-ddcc-469f-9f2b-7c66ca881d4e-kube-api-access-5xq89\") pod \"console-operator-668fdbf85c-bjwc5\" (UID: \"460c232b-ddcc-469f-9f2b-7c66ca881d4e\") " pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.025470 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.025449    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wszbn\" (UniqueName: \"kubernetes.io/projected/717ad8b5-5bda-4ff7-ac03-6933003314ef-kube-api-access-wszbn\") pod \"insights-operator-896549976-hh6zb\" (UID: \"717ad8b5-5bda-4ff7-ac03-6933003314ef\") " pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.084798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.084773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:17.116559 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.116538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"
Jun 09 09:36:17.123599 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.123585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:17.130310 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.130289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-hh6zb"
Jun 09 09:36:17.208043 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.208017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"
Jun 09 09:36:17.257654 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.257575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v"]
Jun 09 09:36:17.261363 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:17.261338    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1b34b5_fbff_4389_a6c6_4770ee9074d5.slice/crio-eb0ee819c0b8e57399512950f2a1c54bfdee3546c92cfc49085593a3780acad5 WatchSource:0}: Error finding container eb0ee819c0b8e57399512950f2a1c54bfdee3546c92cfc49085593a3780acad5: Status 404 returned error can't find the container with id eb0ee819c0b8e57399512950f2a1c54bfdee3546c92cfc49085593a3780acad5
Jun 09 09:36:17.337189 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.337160    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj"]
Jun 09 09:36:17.339816 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:17.339793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7643d452_ad11_40f8_bbc7_af1efa764031.slice/crio-080db7227bae59b33becdcfee45a03ede2e75454b805206e0409f649064e032f WatchSource:0}: Error finding container 080db7227bae59b33becdcfee45a03ede2e75454b805206e0409f649064e032f: Status 404 returned error can't find the container with id 080db7227bae59b33becdcfee45a03ede2e75454b805206e0409f649064e032f
Jun 09 09:36:17.422150 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.422125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:17.422297 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:17.422279    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 09:36:17.422347 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:17.422301    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fdd66c-mnqxs: secret "image-registry-tls" not found
Jun 09 09:36:17.422384 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:17.422347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls podName:58234a7a-357c-4d20-9506-32f859918e2d nodeName:}" failed. No retries permitted until 2026-06-09 09:36:18.422333289 +0000 UTC m=+202.229838007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls") pod "image-registry-788fdd66c-mnqxs" (UID: "58234a7a-357c-4d20-9506-32f859918e2d") : secret "image-registry-tls" not found
Jun 09 09:36:17.481021 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.480995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-hh6zb"]
Jun 09 09:36:17.484077 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:17.484050    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717ad8b5_5bda_4ff7_ac03_6933003314ef.slice/crio-749d03d725d7ec8d9febd646c67e0f3db14e24e189e3100d64957c31e427ae84 WatchSource:0}: Error finding container 749d03d725d7ec8d9febd646c67e0f3db14e24e189e3100d64957c31e427ae84: Status 404 returned error can't find the container with id 749d03d725d7ec8d9febd646c67e0f3db14e24e189e3100d64957c31e427ae84
Jun 09 09:36:17.484291 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:17.484273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-bjwc5"]
Jun 09 09:36:17.487494 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:17.487473    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460c232b_ddcc_469f_9f2b_7c66ca881d4e.slice/crio-873fdf6d4adeb8bbc272690bc76c10db61b501d222c0571d3236188ecfbb82c7 WatchSource:0}: Error finding container 873fdf6d4adeb8bbc272690bc76c10db61b501d222c0571d3236188ecfbb82c7: Status 404 returned error can't find the container with id 873fdf6d4adeb8bbc272690bc76c10db61b501d222c0571d3236188ecfbb82c7
Jun 09 09:36:18.264641 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:18.264547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hh6zb" event={"ID":"717ad8b5-5bda-4ff7-ac03-6933003314ef","Type":"ContainerStarted","Data":"749d03d725d7ec8d9febd646c67e0f3db14e24e189e3100d64957c31e427ae84"}
Jun 09 09:36:18.266092 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:18.265976    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v" event={"ID":"2b1b34b5-fbff-4389-a6c6-4770ee9074d5","Type":"ContainerStarted","Data":"eb0ee819c0b8e57399512950f2a1c54bfdee3546c92cfc49085593a3780acad5"}
Jun 09 09:36:18.267695 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:18.267611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj" event={"ID":"7643d452-ad11-40f8-bbc7-af1efa764031","Type":"ContainerStarted","Data":"080db7227bae59b33becdcfee45a03ede2e75454b805206e0409f649064e032f"}
Jun 09 09:36:18.269439 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:18.269387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" event={"ID":"460c232b-ddcc-469f-9f2b-7c66ca881d4e","Type":"ContainerStarted","Data":"873fdf6d4adeb8bbc272690bc76c10db61b501d222c0571d3236188ecfbb82c7"}
Jun 09 09:36:18.430427 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:18.430392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:18.430602 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:18.430527    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 09:36:18.430602 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:18.430544    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fdd66c-mnqxs: secret "image-registry-tls" not found
Jun 09 09:36:18.430719 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:18.430606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls podName:58234a7a-357c-4d20-9506-32f859918e2d nodeName:}" failed. No retries permitted until 2026-06-09 09:36:20.430586773 +0000 UTC m=+204.238091481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls") pod "image-registry-788fdd66c-mnqxs" (UID: "58234a7a-357c-4d20-9506-32f859918e2d") : secret "image-registry-tls" not found
Jun 09 09:36:20.277307 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.277278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj" event={"ID":"7643d452-ad11-40f8-bbc7-af1efa764031","Type":"ContainerStarted","Data":"5075bf10f088c03ad1787a513af6c81b99ea2123cef64bf03bfc4304de654143"}
Jun 09 09:36:20.279053 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.279034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/0.log"
Jun 09 09:36:20.279157 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.279067    2563 generic.go:356] "Generic (PLEG): container finished" podID="460c232b-ddcc-469f-9f2b-7c66ca881d4e" containerID="d080215d6406a42c5e6f3cc281f98f264d78a7dfc076e901c9b45a8af66b1df0" exitCode=255
Jun 09 09:36:20.279221 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.279163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" event={"ID":"460c232b-ddcc-469f-9f2b-7c66ca881d4e","Type":"ContainerDied","Data":"d080215d6406a42c5e6f3cc281f98f264d78a7dfc076e901c9b45a8af66b1df0"}
Jun 09 09:36:20.279358 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.279338    2563 scope.go:117] "RemoveContainer" containerID="d080215d6406a42c5e6f3cc281f98f264d78a7dfc076e901c9b45a8af66b1df0"
Jun 09 09:36:20.280910 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.280886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hh6zb" event={"ID":"717ad8b5-5bda-4ff7-ac03-6933003314ef","Type":"ContainerStarted","Data":"ed22757b3cfc2bac79e4c243a3c6ee2bfc069e4525eaa71b331103adb2db8326"}
Jun 09 09:36:20.282343 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.282321    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v" event={"ID":"2b1b34b5-fbff-4389-a6c6-4770ee9074d5","Type":"ContainerStarted","Data":"78ac51df40fcc9092b9924bc17668f93e708a80111e7be21360de122f71c167f"}
Jun 09 09:36:20.293010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.292966    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-4zczj" podStartSLOduration=1.514354359 podStartE2EDuration="4.292948439s" totalImagesPullingTime="2.77859408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:20.291615749 +0000 UTC m=+204.099120484" watchObservedRunningTime="2026-06-09 09:36:20.292948439 +0000 UTC m=+204.100453171"
Jun 09 09:36:20.306584 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.306546    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v" podStartSLOduration=1.449616788 podStartE2EDuration="4.306534351s" totalImagesPullingTime="2.856917563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:20.305116227 +0000 UTC m=+204.112620958" watchObservedRunningTime="2026-06-09 09:36:20.306534351 +0000 UTC m=+204.114039081"
Jun 09 09:36:20.321366 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.321313    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-hh6zb" podStartSLOduration=1.6807765319999999 podStartE2EDuration="4.321303825s" totalImagesPullingTime="2.640527293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:20.320595971 +0000 UTC m=+204.128100701" watchObservedRunningTime="2026-06-09 09:36:20.321303825 +0000 UTC m=+204.128808559"
Jun 09 09:36:20.423097 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.423066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:20.449187 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.449161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:20.449297 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:20.449254    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 09:36:20.449297 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:20.449264    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fdd66c-mnqxs: secret "image-registry-tls" not found
Jun 09 09:36:20.449403 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:20.449307    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls podName:58234a7a-357c-4d20-9506-32f859918e2d nodeName:}" failed. No retries permitted until 2026-06-09 09:36:24.449294723 +0000 UTC m=+208.256799432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls") pod "image-registry-788fdd66c-mnqxs" (UID: "58234a7a-357c-4d20-9506-32f859918e2d") : secret "image-registry-tls" not found
Jun 09 09:36:20.524521 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.524487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:20.624645 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.624577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:20.684981 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:20.684954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:21.287363 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.287336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:36:21.288057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.288039    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/0.log"
Jun 09 09:36:21.288134 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.288075    2563 generic.go:356] "Generic (PLEG): container finished" podID="460c232b-ddcc-469f-9f2b-7c66ca881d4e" containerID="8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec" exitCode=255
Jun 09 09:36:21.288188 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.288162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" event={"ID":"460c232b-ddcc-469f-9f2b-7c66ca881d4e","Type":"ContainerDied","Data":"8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec"}
Jun 09 09:36:21.288236 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.288201    2563 scope.go:117] "RemoveContainer" containerID="d080215d6406a42c5e6f3cc281f98f264d78a7dfc076e901c9b45a8af66b1df0"
Jun 09 09:36:21.288452 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.288429    2563 scope.go:117] "RemoveContainer" containerID="8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec"
Jun 09 09:36:21.288664 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:21.288637    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bjwc5_openshift-console-operator(460c232b-ddcc-469f-9f2b-7c66ca881d4e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" podUID="460c232b-ddcc-469f-9f2b-7c66ca881d4e"
Jun 09 09:36:21.314257 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.314233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:21.451467 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.451434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:21.511599 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:21.511576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:22.293155 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.293128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:36:22.293608 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.293434    2563 scope.go:117] "RemoveContainer" containerID="8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec"
Jun 09 09:36:22.293608 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:22.293580    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bjwc5_openshift-console-operator(460c232b-ddcc-469f-9f2b-7c66ca881d4e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" podUID="460c232b-ddcc-469f-9f2b-7c66ca881d4e"
Jun 09 09:36:22.367294 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.367259    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:22.459619 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.459588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:22.920189 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.920163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:22.975590 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:22.975556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:23.300803 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:23.300780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hc2xf_9369b817-e406-4f2f-8bff-f1778ecbaca3/dns-node-resolver/0.log"
Jun 09 09:36:23.747462 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:23.747433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:24.301366 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.301342    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s647z_281b27f8-d59f-489b-9164-e9a08b780af0/node-ca/0.log"
Jun 09 09:36:24.480607 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.480581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:24.480748 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:24.480707    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 09 09:36:24.480748 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:24.480720    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-788fdd66c-mnqxs: secret "image-registry-tls" not found
Jun 09 09:36:24.480813 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:24.480775    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls podName:58234a7a-357c-4d20-9506-32f859918e2d nodeName:}" failed. No retries permitted until 2026-06-09 09:36:32.480757948 +0000 UTC m=+216.288262659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls") pod "image-registry-788fdd66c-mnqxs" (UID: "58234a7a-357c-4d20-9506-32f859918e2d") : secret "image-registry-tls" not found
Jun 09 09:36:24.534319 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.534291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:24.635304 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.635225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:24.735417 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.735390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:24.836003 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.835974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:24.900906 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.900820    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kpsbf_b89759f7-7620-435e-85d0-d4279cac08f1/serve-healthcheck-canary/0.log"
Jun 09 09:36:24.936266 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:24.936234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:25.446410 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:25.446370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:26.043803 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:26.043748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:26.344186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:26.344092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:26.444001 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:26.443931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:26.843771 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:26.843744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:27.045505 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:27.045476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:27.124225 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:27.124158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:27.124225 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:27.124204    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:27.124484 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:27.124473    2563 scope.go:117] "RemoveContainer" containerID="8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec"
Jun 09 09:36:27.124657 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:27.124638    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-bjwc5_openshift-console-operator(460c232b-ddcc-469f-9f2b-7c66ca881d4e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" podUID="460c232b-ddcc-469f-9f2b-7c66ca881d4e"
Jun 09 09:36:27.634198 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:27.634166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:28.043603 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:28.043567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:28.234497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:28.234461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:28.431536 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:28.431452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:28.838597 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:28.838563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:28.938045 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:28.938013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:29.237314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:29.237283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:29.637848 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:29.637753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:29.739264 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:29.739237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:29.842372 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:29.842350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:30.442542 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:30.442503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:30.840361 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:30.840335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:31.043304 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:31.043270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:31.143523 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:31.143428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:31.437027 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:31.436959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:32.236145 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.236110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:32.541195 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.541110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:32.543398 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.543365    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"image-registry-788fdd66c-mnqxs\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") " pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:32.632660 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.632630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:32.639147 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.639118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:32.759300 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.759273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:36:32.762294 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:32.762264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58234a7a_357c_4d20_9506_32f859918e2d.slice/crio-7ae7d7fa33eb106d606993c08803500c0e3e86af6e0642ccf7d8b35d1ca38a2f WatchSource:0}: Error finding container 7ae7d7fa33eb106d606993c08803500c0e3e86af6e0642ccf7d8b35d1ca38a2f: Status 404 returned error can't find the container with id 7ae7d7fa33eb106d606993c08803500c0e3e86af6e0642ccf7d8b35d1ca38a2f
Jun 09 09:36:32.840636 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:32.840610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:33.048545 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.048471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:33.326395 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.326322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" event={"ID":"58234a7a-357c-4d20-9506-32f859918e2d","Type":"ContainerStarted","Data":"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"}
Jun 09 09:36:33.326395 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.326364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" event={"ID":"58234a7a-357c-4d20-9506-32f859918e2d","Type":"ContainerStarted","Data":"7ae7d7fa33eb106d606993c08803500c0e3e86af6e0642ccf7d8b35d1ca38a2f"}
Jun 09 09:36:33.326806 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.326460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:36:33.346761 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.346723    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" podStartSLOduration=17.346710573 podStartE2EDuration="17.346710573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:33.346261171 +0000 UTC m=+217.153765901" watchObservedRunningTime="2026-06-09 09:36:33.346710573 +0000 UTC m=+217.154215305"
Jun 09 09:36:33.435721 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.435686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:33.668627 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:33.668540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:34.234997 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:34.234965    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:34.437979 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:34.437945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:34.837705 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:34.837677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:35.039364 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:35.039333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:35.235046 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:35.235001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:35.690140 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:35.690104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:35.842422 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:35.842394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:36.115674 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:36.115643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:38.643130 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:38.643103    2563 scope.go:117] "RemoveContainer" containerID="8919c62e2771994833344c687b3aef8e78d57b6ff7051f16ac52780bb8a998ec"
Jun 09 09:36:39.285808 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.285763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:39.345905 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.345879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:36:39.346040 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.345969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" event={"ID":"460c232b-ddcc-469f-9f2b-7c66ca881d4e","Type":"ContainerStarted","Data":"121a91c91beccafc19d0e20e291f45f525199913375f4a0613fa12421d36fbf8"}
Jun 09 09:36:39.346291 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.346264    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:39.350706 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.350685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5"
Jun 09 09:36:39.362971 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:39.362932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-bjwc5" podStartSLOduration=20.728403668 podStartE2EDuration="23.362919443s" totalImagesPullingTime="2.634515775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:39.361486786 +0000 UTC m=+223.168991518" watchObservedRunningTime="2026-06-09 09:36:39.362919443 +0000 UTC m=+223.170424201"
Jun 09 09:36:40.288702 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:40.288668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:40.389508 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:40.389479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:40.467184 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:40.467151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:40.767209 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:40.767179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:40.979892 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:40.979858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:41.176127 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:41.176048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:41.361359 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:41.361330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:42.198313 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.198269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:42.818094 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.818062    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"]
Jun 09 09:36:42.820534 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.820514    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:42.823949 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.823917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 09 09:36:42.824073 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.823964    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qfqkm\""
Jun 09 09:36:42.836807 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.836775    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"]
Jun 09 09:36:42.839782 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.839752    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:36:42.841590 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.841550    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-jdjdl"]
Jun 09 09:36:42.843742 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.843722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:36:42.846137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.846111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2dfql\""
Jun 09 09:36:42.846137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.846129    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 09 09:36:42.846474 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.846445    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 09 09:36:42.855524 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.855503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jdjdl"]
Jun 09 09:36:42.874680 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.874657    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df5cccb6d-vvm45"]
Jun 09 09:36:42.876551 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.876533    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bnrxl"]
Jun 09 09:36:42.876675 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.876655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:42.878179 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.878164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:42.880657 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.880640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 09 09:36:42.881013 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.880994    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 09 09:36:42.881451 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.881427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jd4jm\""
Jun 09 09:36:42.887996 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.887976    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df5cccb6d-vvm45"]
Jun 09 09:36:42.889106 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.889086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bnrxl"]
Jun 09 09:36:42.913494 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.913468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxknl\" (UniqueName: \"kubernetes.io/projected/e1988dc3-2cff-4c51-b0fc-7cf82584119f-kube-api-access-mxknl\") pod \"downloads-6657875f97-jdjdl\" (UID: \"e1988dc3-2cff-4c51-b0fc-7cf82584119f\") " pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:36:42.913627 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.913524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bb991fc-76d0-4a2d-bd88-5889ea54d136-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kmwxq\" (UID: \"3bb991fc-76d0-4a2d-bd88-5889ea54d136\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:42.917542 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:42.917512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:43.014514 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxknl\" (UniqueName: \"kubernetes.io/projected/e1988dc3-2cff-4c51-b0fc-7cf82584119f-kube-api-access-mxknl\") pod \"downloads-6657875f97-jdjdl\" (UID: \"e1988dc3-2cff-4c51-b0fc-7cf82584119f\") " pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:36:43.014625 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-bound-sa-token\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.014625 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/767f6769-9aa0-4589-bcb9-030348410b8d-ca-trust-extracted\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.014625 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8777c73-012e-48c3-a294-e1f04a0c5611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.014625 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-installation-pull-secrets\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.014811 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-registry-tls\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.014811 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.014811 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8777c73-012e-48c3-a294-e1f04a0c5611-crio-socket\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.014811 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvdv\" (UniqueName: \"kubernetes.io/projected/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-api-access-ngvdv\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.014811 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-registry-certificates\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.015023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-trusted-ca\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.015023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bb991fc-76d0-4a2d-bd88-5889ea54d136-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kmwxq\" (UID: \"3bb991fc-76d0-4a2d-bd88-5889ea54d136\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:43.015023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ddv\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-kube-api-access-j6ddv\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.015023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-image-registry-private-configuration\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.015023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.014982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8777c73-012e-48c3-a294-e1f04a0c5611-data-volume\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.015505 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.015467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:43.017508 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.017491    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3bb991fc-76d0-4a2d-bd88-5889ea54d136-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-kmwxq\" (UID: \"3bb991fc-76d0-4a2d-bd88-5889ea54d136\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:43.022592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.022573    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxknl\" (UniqueName: \"kubernetes.io/projected/e1988dc3-2cff-4c51-b0fc-7cf82584119f-kube-api-access-mxknl\") pod \"downloads-6657875f97-jdjdl\" (UID: \"e1988dc3-2cff-4c51-b0fc-7cf82584119f\") " pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:36:43.115813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-registry-tls\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.115813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.115813 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8777c73-012e-48c3-a294-e1f04a0c5611-crio-socket\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvdv\" (UniqueName: \"kubernetes.io/projected/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-api-access-ngvdv\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-registry-certificates\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-trusted-ca\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8777c73-012e-48c3-a294-e1f04a0c5611-crio-socket\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116057 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.115945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ddv\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-kube-api-access-j6ddv\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-image-registry-private-configuration\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8777c73-012e-48c3-a294-e1f04a0c5611-data-volume\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-bound-sa-token\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/767f6769-9aa0-4589-bcb9-030348410b8d-ca-trust-extracted\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116314 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8777c73-012e-48c3-a294-e1f04a0c5611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116546 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-installation-pull-secrets\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116546 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116438    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116546 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8777c73-012e-48c3-a294-e1f04a0c5611-data-volume\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.116798 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/767f6769-9aa0-4589-bcb9-030348410b8d-ca-trust-extracted\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.116942 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-registry-certificates\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.117018 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.116971    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/767f6769-9aa0-4589-bcb9-030348410b8d-trusted-ca\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.118386 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.118365    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-registry-tls\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.118816 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.118793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8777c73-012e-48c3-a294-e1f04a0c5611-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.119195 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.119174    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-installation-pull-secrets\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.119322 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.119250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/767f6769-9aa0-4589-bcb9-030348410b8d-image-registry-private-configuration\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.119950 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.119493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:43.124458 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.124410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvdv\" (UniqueName: \"kubernetes.io/projected/c8777c73-012e-48c3-a294-e1f04a0c5611-kube-api-access-ngvdv\") pod \"insights-runtime-extractor-bnrxl\" (UID: \"c8777c73-012e-48c3-a294-e1f04a0c5611\") " pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.124908 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.124879    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-bound-sa-token\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.125348 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.125312    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ddv\" (UniqueName: \"kubernetes.io/projected/767f6769-9aa0-4589-bcb9-030348410b8d-kube-api-access-j6ddv\") pod \"image-registry-7df5cccb6d-vvm45\" (UID: \"767f6769-9aa0-4589-bcb9-030348410b8d\") " pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.130766 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.130733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:43.154093 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.154076    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:36:43.187246 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.186960    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:43.193852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.193590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bnrxl"
Jun 09 09:36:43.283976 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.283806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"]
Jun 09 09:36:43.286256 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:43.286226    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb991fc_76d0_4a2d_bd88_5889ea54d136.slice/crio-701d2630f6c544a8cd9d40857480f6e8fb692072fd592e2edc6c691c209fbbad WatchSource:0}: Error finding container 701d2630f6c544a8cd9d40857480f6e8fb692072fd592e2edc6c691c209fbbad: Status 404 returned error can't find the container with id 701d2630f6c544a8cd9d40857480f6e8fb692072fd592e2edc6c691c209fbbad
Jun 09 09:36:43.310150 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.310126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-jdjdl"]
Jun 09 09:36:43.312187 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:43.312150    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1988dc3_2cff_4c51_b0fc_7cf82584119f.slice/crio-6b49de21ad84dcb1e961494cc8618b25f61e127b9dd7ef6a3b45b82682d05d9e WatchSource:0}: Error finding container 6b49de21ad84dcb1e961494cc8618b25f61e127b9dd7ef6a3b45b82682d05d9e: Status 404 returned error can't find the container with id 6b49de21ad84dcb1e961494cc8618b25f61e127b9dd7ef6a3b45b82682d05d9e
Jun 09 09:36:43.341270 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.341249    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df5cccb6d-vvm45"]
Jun 09 09:36:43.343484 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:43.343448    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767f6769_9aa0_4589_bcb9_030348410b8d.slice/crio-bccb28835e54852714fa30370a8ed48786c88438f3ebc0f51d1317c4a767f8d2 WatchSource:0}: Error finding container bccb28835e54852714fa30370a8ed48786c88438f3ebc0f51d1317c4a767f8d2: Status 404 returned error can't find the container with id bccb28835e54852714fa30370a8ed48786c88438f3ebc0f51d1317c4a767f8d2
Jun 09 09:36:43.359434 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.359401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jdjdl" event={"ID":"e1988dc3-2cff-4c51-b0fc-7cf82584119f","Type":"ContainerStarted","Data":"6b49de21ad84dcb1e961494cc8618b25f61e127b9dd7ef6a3b45b82682d05d9e"}
Jun 09 09:36:43.360814 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.360792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" event={"ID":"767f6769-9aa0-4589-bcb9-030348410b8d","Type":"ContainerStarted","Data":"bccb28835e54852714fa30370a8ed48786c88438f3ebc0f51d1317c4a767f8d2"}
Jun 09 09:36:43.361385 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.361362    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bnrxl"]
Jun 09 09:36:43.362255 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.362234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq" event={"ID":"3bb991fc-76d0-4a2d-bd88-5889ea54d136","Type":"ContainerStarted","Data":"701d2630f6c544a8cd9d40857480f6e8fb692072fd592e2edc6c691c209fbbad"}
Jun 09 09:36:43.380774 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:43.380753    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8777c73_012e_48c3_a294_e1f04a0c5611.slice/crio-da22145d48e8a431da389460b64e23ad16468a7b145dffb2aa07f8f15099a57d WatchSource:0}: Error finding container da22145d48e8a431da389460b64e23ad16468a7b145dffb2aa07f8f15099a57d: Status 404 returned error can't find the container with id da22145d48e8a431da389460b64e23ad16468a7b145dffb2aa07f8f15099a57d
Jun 09 09:36:43.485454 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.485420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:43.540818 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:43.540781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:44.369722 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.369647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bnrxl" event={"ID":"c8777c73-012e-48c3-a294-e1f04a0c5611","Type":"ContainerStarted","Data":"75833e2a6386173606910bb7912c21bd004089b1fc9b398db0e6365e5c5b5131"}
Jun 09 09:36:44.369722 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.369703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bnrxl" event={"ID":"c8777c73-012e-48c3-a294-e1f04a0c5611","Type":"ContainerStarted","Data":"d3ca8833a46d80cc833f73cac17a345e6210c44dbedffa702f265e4e3192b59d"}
Jun 09 09:36:44.369722 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.369721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bnrxl" event={"ID":"c8777c73-012e-48c3-a294-e1f04a0c5611","Type":"ContainerStarted","Data":"da22145d48e8a431da389460b64e23ad16468a7b145dffb2aa07f8f15099a57d"}
Jun 09 09:36:44.371228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.371205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" event={"ID":"767f6769-9aa0-4589-bcb9-030348410b8d","Type":"ContainerStarted","Data":"da61d4ebefa95c321221e82a531e7883b20297c58c072546394da62017e09bd0"}
Jun 09 09:36:44.371350 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.371331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:36:44.390389 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:44.390340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podStartSLOduration=2.390326949 podStartE2EDuration="2.390326949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:44.389772679 +0000 UTC m=+228.197277414" watchObservedRunningTime="2026-06-09 09:36:44.390326949 +0000 UTC m=+228.197831726"
Jun 09 09:36:45.378457 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.378413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq" event={"ID":"3bb991fc-76d0-4a2d-bd88-5889ea54d136","Type":"ContainerStarted","Data":"0a003224c446bbbae9d18c189da822b3df6cfd1c4b3bc6a7ba8925ada61e9fd7"}
Jun 09 09:36:45.378923 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.378873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:45.388313 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.388283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq"
Jun 09 09:36:45.395537 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.395484    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-kmwxq" podStartSLOduration=1.913487554 podStartE2EDuration="3.395469329s" totalImagesPullingTime="1.481981775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:45.393790376 +0000 UTC m=+229.201295109" watchObservedRunningTime="2026-06-09 09:36:45.395469329 +0000 UTC m=+229.202974065"
Jun 09 09:36:45.874710 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.874660    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:45.949204 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:45.949128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:46.142765 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:46.142727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:46.383570 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:46.383540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bnrxl" event={"ID":"c8777c73-012e-48c3-a294-e1f04a0c5611","Type":"ContainerStarted","Data":"6492c22a3dab3338ddf0018de5454789cc3f2c56ff4e6ef8a5f6ffde0a50052f"}
Jun 09 09:36:46.401281 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:46.401239    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bnrxl" podStartSLOduration=2.315044376 podStartE2EDuration="4.40122503s" totalImagesPullingTime="2.086180654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:46.400187464 +0000 UTC m=+230.207692194" watchObservedRunningTime="2026-06-09 09:36:46.40122503 +0000 UTC m=+230.208729762"
Jun 09 09:36:47.199337 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:47.199298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:47.877381 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:47.877336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:49.198776 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:49.198734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:49.253922 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:49.253885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.009774 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.009734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.241163 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.241123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.270389 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.270322    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"]
Jun 09 09:36:50.276171 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.276145    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"]
Jun 09 09:36:50.276284 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.276269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.278973 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.278946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5vdhn\""
Jun 09 09:36:50.279087 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.278976    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 09 09:36:50.279087 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.278989    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 09 09:36:50.279493 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.279475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.280041 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.280025    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 09 09:36:50.280153 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.280060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 09 09:36:50.280153 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.280109    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 09 09:36:50.283661 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.283633    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 09 09:36:50.283661 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.283636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nlks9\""
Jun 09 09:36:50.283909 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.283893    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 09 09:36:50.283981 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.283956    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 09 09:36:50.288445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.288426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"]
Jun 09 09:36:50.297402 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.297381    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-464lx"]
Jun 09 09:36:50.300795 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.300777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.303244 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.303224    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 09 09:36:50.303358 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.303261    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q78cq\""
Jun 09 09:36:50.303358 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.303292    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 09 09:36:50.303939 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.303917    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 09 09:36:50.304240 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.304223    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"]
Jun 09 09:36:50.320900 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.320877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.372274 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-node-exporter-accelerators-collector-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372406 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-tls\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372406 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-sys\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372406 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728a0053-a83c-4889-8c98-fb197ad08490-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.372562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.372562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9k9b\" (UniqueName: \"kubernetes.io/projected/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-api-access-f9k9b\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.372562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-metrics-client-ca\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.372562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsvzb\" (UniqueName: \"kubernetes.io/projected/925e97dc-479f-415b-9088-ac1035493334-kube-api-access-rsvzb\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-node-exporter-wtmp\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-root\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fl9\" (UniqueName: \"kubernetes.io/projected/728a0053-a83c-4889-8c98-fb197ad08490-kube-api-access-k2fl9\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.372752 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1adf0d66-9eba-4deb-a220-f9a771a04a0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.373050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.373050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.373050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.372868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/925e97dc-479f-415b-9088-ac1035493334-node-exporter-textfile\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.470940 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.470909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.473947 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.473927    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474001 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.473958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsvzb\" (UniqueName: \"kubernetes.io/projected/925e97dc-479f-415b-9088-ac1035493334-kube-api-access-rsvzb\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474001 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.473980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-node-exporter-wtmp\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474001 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.473997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474119 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.474119 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-root\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474119 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fl9\" (UniqueName: \"kubernetes.io/projected/728a0053-a83c-4889-8c98-fb197ad08490-kube-api-access-k2fl9\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.474250 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474125    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-node-exporter-wtmp\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474250 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474151    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-root\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474250 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:50.474183    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jun 09 09:36:50.474250 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:50.474247    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls podName:1adf0d66-9eba-4deb-a220-f9a771a04a0f nodeName:}" failed. No retries permitted until 2026-06-09 09:36:50.974229479 +0000 UTC m=+234.781734217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-bghpg" (UID: "1adf0d66-9eba-4deb-a220-f9a771a04a0f") : secret "kube-state-metrics-tls" not found
Jun 09 09:36:50.474445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1adf0d66-9eba-4deb-a220-f9a771a04a0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/925e97dc-479f-415b-9088-ac1035493334-node-exporter-textfile\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474445 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-node-exporter-accelerators-collector-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-tls\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-sys\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728a0053-a83c-4889-8c98-fb197ad08490-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1adf0d66-9eba-4deb-a220-f9a771a04a0f-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9k9b\" (UniqueName: \"kubernetes.io/projected/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-api-access-f9k9b\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.474671 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-metrics-client-ca\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.475083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.475083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.475083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.474699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925e97dc-479f-415b-9088-ac1035493334-sys\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.475083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.475029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/925e97dc-479f-415b-9088-ac1035493334-node-exporter-textfile\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.475280 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.475204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-node-exporter-accelerators-collector-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.475554 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.475529    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925e97dc-479f-415b-9088-ac1035493334-metrics-client-ca\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.475643 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.475537    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/728a0053-a83c-4889-8c98-fb197ad08490-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.475852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.475811    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1adf0d66-9eba-4deb-a220-f9a771a04a0f-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.477269 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.477238    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.477367 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.477247    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/925e97dc-479f-415b-9088-ac1035493334-node-exporter-tls\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.477367 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.477280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.477367 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.477356    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.477562 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.477545    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/728a0053-a83c-4889-8c98-fb197ad08490-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.483224 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.483204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9k9b\" (UniqueName: \"kubernetes.io/projected/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-api-access-f9k9b\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.483494 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.483474    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fl9\" (UniqueName: \"kubernetes.io/projected/728a0053-a83c-4889-8c98-fb197ad08490-kube-api-access-k2fl9\") pod \"openshift-state-metrics-65f78d5c66-rc74m\" (UID: \"728a0053-a83c-4889-8c98-fb197ad08490\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.483869 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.483849    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsvzb\" (UniqueName: \"kubernetes.io/projected/925e97dc-479f-415b-9088-ac1035493334-kube-api-access-rsvzb\") pod \"node-exporter-464lx\" (UID: \"925e97dc-479f-415b-9088-ac1035493334\") " pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.572556 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.572477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.587406 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.587373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"
Jun 09 09:36:50.609893 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.609869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-464lx"
Jun 09 09:36:50.623255 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:50.623232    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925e97dc_479f_415b_9088_ac1035493334.slice/crio-da63dc920ae9b50254f5f0198fdab2300840598bfa89444b2d3b37e8856a15ca WatchSource:0}: Error finding container da63dc920ae9b50254f5f0198fdab2300840598bfa89444b2d3b37e8856a15ca: Status 404 returned error can't find the container with id da63dc920ae9b50254f5f0198fdab2300840598bfa89444b2d3b37e8856a15ca
Jun 09 09:36:50.674665 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.674635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.718640 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.718557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m"]
Jun 09 09:36:50.721156 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:50.721135    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728a0053_a83c_4889_8c98_fb197ad08490.slice/crio-1f204b2d8f75672e7adce13752047bbcb2d9718e940baa214be9cf64104c204c WatchSource:0}: Error finding container 1f204b2d8f75672e7adce13752047bbcb2d9718e940baa214be9cf64104c204c: Status 404 returned error can't find the container with id 1f204b2d8f75672e7adce13752047bbcb2d9718e940baa214be9cf64104c204c
Jun 09 09:36:50.729442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.729411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:50.978838 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.978751    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:50.981637 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:50.981591    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1adf0d66-9eba-4deb-a220-f9a771a04a0f-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bghpg\" (UID: \"1adf0d66-9eba-4deb-a220-f9a771a04a0f\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:51.193053 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.192979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"
Jun 09 09:36:51.243659 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.243624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:51.324186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.324152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:51.329519 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.329494    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:36:51.334840 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.334802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.337728 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 09 09:36:51.337868 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337755    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 09 09:36:51.337868 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337814    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 09 09:36:51.338018 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 09 09:36:51.338018 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 09 09:36:51.338018 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.337961    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 09 09:36:51.338254 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.338188    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 09 09:36:51.338306 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.338272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 09 09:36:51.338427 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.338409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qpcgn\""
Jun 09 09:36:51.338483 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.338429    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 09 09:36:51.347016 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.346957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:36:51.403073 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.403045    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m" event={"ID":"728a0053-a83c-4889-8c98-fb197ad08490","Type":"ContainerStarted","Data":"5cfda2da4914f0d182510294c6bdc21f88feb52e9e4de05241c305d0cf3365e4"}
Jun 09 09:36:51.403186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.403100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m" event={"ID":"728a0053-a83c-4889-8c98-fb197ad08490","Type":"ContainerStarted","Data":"e4ff1bc524ceaed6bbc5bee15e49afd4f9c5c1a62a53164b74aaed7186bf0beb"}
Jun 09 09:36:51.403186 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.403124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m" event={"ID":"728a0053-a83c-4889-8c98-fb197ad08490","Type":"ContainerStarted","Data":"1f204b2d8f75672e7adce13752047bbcb2d9718e940baa214be9cf64104c204c"}
Jun 09 09:36:51.404233 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.404214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-464lx" event={"ID":"925e97dc-479f-415b-9088-ac1035493334","Type":"ContainerStarted","Data":"da63dc920ae9b50254f5f0198fdab2300840598bfa89444b2d3b37e8856a15ca"}
Jun 09 09:36:51.482361 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482361 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phvdm\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482361 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482591 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482407    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482591 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482591 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482591 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.482784 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.482759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.516101 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.516075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg"]
Jun 09 09:36:51.519159 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:51.519080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adf0d66_9eba_4deb_a220_f9a771a04a0f.slice/crio-4a82afd3fc057a79338122a395197abdaea3d46ca514722c187a4ba3b76ac366 WatchSource:0}: Error finding container 4a82afd3fc057a79338122a395197abdaea3d46ca514722c187a4ba3b76ac366: Status 404 returned error can't find the container with id 4a82afd3fc057a79338122a395197abdaea3d46ca514722c187a4ba3b76ac366
Jun 09 09:36:51.583615 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583735 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583802 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583871 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583871 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583980 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583980 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.583980 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.583964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.584125 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.584078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phvdm\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.584125 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.584113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.584214 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.584141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.584214 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.584168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.584214 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.584210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.585450 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:51.585401    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 09 09:36:51.585547 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:51.585461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls podName:a66813e5-02a3-42ea-be7d-69504fdc91e6 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:52.085441722 +0000 UTC m=+235.892946432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6") : secret "alertmanager-main-tls" not found
Jun 09 09:36:51.585612 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.585583    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.586716 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.586422    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.586902 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.586881    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.587040 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.586996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.588340 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.588314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.588733 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.588688    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.589282 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.589262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.589988 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.589717    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.590142 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.590122    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.590273 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.590254    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.591150 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.591113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:51.593351 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:51.593330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phvdm\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:52.088411 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.088370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:52.088597 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:52.088535    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 09 09:36:52.088658 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:36:52.088613    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls podName:a66813e5-02a3-42ea-be7d-69504fdc91e6 nodeName:}" failed. No retries permitted until 2026-06-09 09:36:53.088591457 +0000 UTC m=+236.896096170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6") : secret "alertmanager-main-tls" not found
Jun 09 09:36:52.195444 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.195416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:52.257033 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.257009    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cd6cf946c-f269c"]
Jun 09 09:36:52.260659 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.260638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.263531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 09 09:36:52.263531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263334    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fvdurrtq4cmns\""
Jun 09 09:36:52.263531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263347    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 09 09:36:52.263531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263412    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 09 09:36:52.263531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263531    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 09 09:36:52.263868 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.263638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-27wz4\""
Jun 09 09:36:52.264096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.264076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 09 09:36:52.272472 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.272450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cd6cf946c-f269c"]
Jun 09 09:36:52.391541 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4afccdd-5d03-4964-85b0-9da897a72832-metrics-client-ca\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391673 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t74q\" (UniqueName: \"kubernetes.io/projected/f4afccdd-5d03-4964-85b0-9da897a72832-kube-api-access-8t74q\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391673 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391673 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391854 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-grpc-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391854 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391854 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.391987 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.391852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.411156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.411110    2563 generic.go:356] "Generic (PLEG): container finished" podID="925e97dc-479f-415b-9088-ac1035493334" containerID="ca90cad4f46f375ebfef3b6faeacf219357062c5beed10feee3775df383e0d14" exitCode=0
Jun 09 09:36:52.411290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.411191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-464lx" event={"ID":"925e97dc-479f-415b-9088-ac1035493334","Type":"ContainerDied","Data":"ca90cad4f46f375ebfef3b6faeacf219357062c5beed10feee3775df383e0d14"}
Jun 09 09:36:52.414917 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.414889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m" event={"ID":"728a0053-a83c-4889-8c98-fb197ad08490","Type":"ContainerStarted","Data":"2afe2bba4b7225fac7d97351826847d6c4cdcf5c47f377ebf1cc0e5ff64630e5"}
Jun 09 09:36:52.416591 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.416525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg" event={"ID":"1adf0d66-9eba-4deb-a220-f9a771a04a0f","Type":"ContainerStarted","Data":"4a82afd3fc057a79338122a395197abdaea3d46ca514722c187a4ba3b76ac366"}
Jun 09 09:36:52.446084 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.446045    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-rc74m" podStartSLOduration=1.138031394 podStartE2EDuration="2.446031581s" totalImagesPullingTime="1.308000187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:52.443940725 +0000 UTC m=+236.251445469" watchObservedRunningTime="2026-06-09 09:36:52.446031581 +0000 UTC m=+236.253536290"
Jun 09 09:36:52.492425 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.492515 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.492569 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.492569 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4afccdd-5d03-4964-85b0-9da897a72832-metrics-client-ca\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.492677 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t74q\" (UniqueName: \"kubernetes.io/projected/f4afccdd-5d03-4964-85b0-9da897a72832-kube-api-access-8t74q\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.492677 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.493341 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.493341 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.492851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-grpc-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.493896 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.493572    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4afccdd-5d03-4964-85b0-9da897a72832-metrics-client-ca\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.495510 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.495482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.495607 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.495568    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.496052 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.496023    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.496534 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.496513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.496675 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.496654    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-grpc-tls\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.496901 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.496866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f4afccdd-5d03-4964-85b0-9da897a72832-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.504240 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.504211    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t74q\" (UniqueName: \"kubernetes.io/projected/f4afccdd-5d03-4964-85b0-9da897a72832-kube-api-access-8t74q\") pod \"thanos-querier-5cd6cf946c-f269c\" (UID: \"f4afccdd-5d03-4964-85b0-9da897a72832\") " pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.571835 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.571770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:52.724860 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.724793    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cd6cf946c-f269c"]
Jun 09 09:36:52.729363 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:52.729323    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4afccdd_5d03_4964_85b0_9da897a72832.slice/crio-504723b5e000af3121570c40f9d1362d11d2fd2a3d5410c2a2e13ea493cb6fb8 WatchSource:0}: Error finding container 504723b5e000af3121570c40f9d1362d11d2fd2a3d5410c2a2e13ea493cb6fb8: Status 404 returned error can't find the container with id 504723b5e000af3121570c40f9d1362d11d2fd2a3d5410c2a2e13ea493cb6fb8
Jun 09 09:36:52.846473 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.846433    2563 patch_prober.go:28] interesting pod/image-registry-788fdd66c-mnqxs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:36:52.846634 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.846487    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:36:52.994228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:52.994157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:53.094287 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.094248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:53.100319 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.100298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:53.102530 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.102506    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:53.146726 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.146684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:36:53.195431 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.195376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:53.287641 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.287609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:53.333889 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.333768    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:36:53.338934 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:53.338901    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66813e5_02a3_42ea_be7d_69504fdc91e6.slice/crio-41f627f6ab3e41517d20e6989bdf37b3e938169b257f5593b68d88e676ab9bc1 WatchSource:0}: Error finding container 41f627f6ab3e41517d20e6989bdf37b3e938169b257f5593b68d88e676ab9bc1: Status 404 returned error can't find the container with id 41f627f6ab3e41517d20e6989bdf37b3e938169b257f5593b68d88e676ab9bc1
Jun 09 09:36:53.424857 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.424742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg" event={"ID":"1adf0d66-9eba-4deb-a220-f9a771a04a0f","Type":"ContainerStarted","Data":"8eb58f82ed1ec6109abf93abd9fd0a51d32a3898d11d5e11ecd9c01127b75893"}
Jun 09 09:36:53.424857 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.424807    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg" event={"ID":"1adf0d66-9eba-4deb-a220-f9a771a04a0f","Type":"ContainerStarted","Data":"dbdb5f07f0b7993638213fcdccee71d1ca9bcae107d36a2e1322924481460254"}
Jun 09 09:36:53.424857 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.424857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg" event={"ID":"1adf0d66-9eba-4deb-a220-f9a771a04a0f","Type":"ContainerStarted","Data":"f8921ea380724997b5f5d711b759c609de15a0b54de92aa66a90625c548985a2"}
Jun 09 09:36:53.426467 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.426439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"504723b5e000af3121570c40f9d1362d11d2fd2a3d5410c2a2e13ea493cb6fb8"}
Jun 09 09:36:53.428551 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.428505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-464lx" event={"ID":"925e97dc-479f-415b-9088-ac1035493334","Type":"ContainerStarted","Data":"e19f596cc1439af113ebb13aa2a789b2e20c651be72c42ccdec239f1ae22faea"}
Jun 09 09:36:53.428641 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.428553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-464lx" event={"ID":"925e97dc-479f-415b-9088-ac1035493334","Type":"ContainerStarted","Data":"4702a49aaa173ff1402c11c55f9600466dadb4d773620e72b9a0075dc438b264"}
Jun 09 09:36:53.430145 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.430125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"41f627f6ab3e41517d20e6989bdf37b3e938169b257f5593b68d88e676ab9bc1"}
Jun 09 09:36:53.430536 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.430516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:53.442451 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.442412    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bghpg" podStartSLOduration=1.840268091 podStartE2EDuration="3.442397601s" totalImagesPullingTime="1.60212951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:53.4416639 +0000 UTC m=+237.249168645" watchObservedRunningTime="2026-06-09 09:36:53.442397601 +0000 UTC m=+237.249902332"
Jun 09 09:36:53.463069 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.463034    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-464lx" podStartSLOduration=2.575725025 podStartE2EDuration="3.463019116s" totalImagesPullingTime="818.286187ms" totalInitContainerRuntime="69.007904ms" isStatefulPod=true podCreationTimestamp="2026-06-09 09:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:53.462321847 +0000 UTC m=+237.269826575" watchObservedRunningTime="2026-06-09 09:36:53.463019116 +0000 UTC m=+237.270523850"
Jun 09 09:36:53.655375 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:53.655223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:54.373055 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.373015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:54.428218 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.428130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:54.572873 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.572821    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79c7677f76-xvjf6"]
Jun 09 09:36:54.576705 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.576684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.579450 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.579379    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 09 09:36:54.580411 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.580382    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 09 09:36:54.580658 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.580638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 09 09:36:54.580749 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.580681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6kvfq\""
Jun 09 09:36:54.580749 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.580711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f2a0ouq7avtel\""
Jun 09 09:36:54.580963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.580929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 09 09:36:54.585750 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.585724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79c7677f76-xvjf6"]
Jun 09 09:36:54.718475 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-tls\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718475 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-metrics-server-audit-profiles\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718475 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-client-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718707 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-audit-log\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718707 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718707 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-client-certs\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.718707 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.718705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fkxz\" (UniqueName: \"kubernetes.io/projected/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-kube-api-access-4fkxz\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.819779 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fkxz\" (UniqueName: \"kubernetes.io/projected/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-kube-api-access-4fkxz\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.819968 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-tls\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.819968 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-metrics-server-audit-profiles\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.819968 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-client-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.819968 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-audit-log\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.820185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.819995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.820185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.820023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-client-certs\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.820901 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.820468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-audit-log\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.820901 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.820853    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.821065 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.821040    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-metrics-server-audit-profiles\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.822643 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.822623    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-tls\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.822761 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.822735    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-client-ca-bundle\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.823333 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.823307    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-secret-metrics-server-client-certs\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.828939 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.828919    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fkxz\" (UniqueName: \"kubernetes.io/projected/d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a-kube-api-access-4fkxz\") pod \"metrics-server-79c7677f76-xvjf6\" (UID: \"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a\") " pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:54.889959 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:54.889902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:36:55.030711 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.030626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:55.090985 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.090949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:55.261797 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.261775    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79c7677f76-xvjf6"]
Jun 09 09:36:55.264505 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:36:55.264484    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14f8d3b_4762_4dfb_b29f_1cd3bea89c3a.slice/crio-a5a555c36b16ee6b2afcf5de54f3afc37c80e90847d6fd43eafa0472a2074b19 WatchSource:0}: Error finding container a5a555c36b16ee6b2afcf5de54f3afc37c80e90847d6fd43eafa0472a2074b19: Status 404 returned error can't find the container with id a5a555c36b16ee6b2afcf5de54f3afc37c80e90847d6fd43eafa0472a2074b19
Jun 09 09:36:55.286605 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.286553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:55.440192 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.440160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6" event={"ID":"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a","Type":"ContainerStarted","Data":"a5a555c36b16ee6b2afcf5de54f3afc37c80e90847d6fd43eafa0472a2074b19"}
Jun 09 09:36:55.442493 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.442469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"cd22f3f1af8afe42aa3d60d1b22221c2c05f8613d3b428be07aec796d1a23b4e"}
Jun 09 09:36:55.442604 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.442534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"051d6dd7960923e1ac7e3ae4affffd0cf040644326c6ed5ed78c023c8c4b148f"}
Jun 09 09:36:55.442604 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.442581    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"5ab8c7d66d0ec226fbcc9e935468a27b17df01b90848a18a5838bb248e180e8e"}
Jun 09 09:36:55.444187 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.444161    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c" exitCode=0
Jun 09 09:36:55.444302 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:55.444199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"}
Jun 09 09:36:56.432934 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:56.432814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:56.455745 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:56.455700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"f10c8f6a8b6ea9c3b3419932f842b9e7c00b523277895f95e114eb9c58dda4e5"}
Jun 09 09:36:56.456266 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:56.455791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"dbc63df79644e444cf645726fcdcbc16efc016424104cc04539201b4a1c948e8"}
Jun 09 09:36:56.511146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:56.511110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:36:57.464096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:57.464060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" event={"ID":"f4afccdd-5d03-4964-85b0-9da897a72832","Type":"ContainerStarted","Data":"50626cb6dda21a36f120b70870cd9db399eee1068ee526221e20b108256c4791"}
Jun 09 09:36:57.464564 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:57.464230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:36:57.488368 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:57.488320    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c" podStartSLOduration=2.239002348 podStartE2EDuration="5.488301173s" totalImagesPullingTime="3.249298825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:57.486298757 +0000 UTC m=+241.293803548" watchObservedRunningTime="2026-06-09 09:36:57.488301173 +0000 UTC m=+241.295805907"
Jun 09 09:36:58.472271 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:58.472232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6" event={"ID":"d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a","Type":"ContainerStarted","Data":"feae68f1ae46fa4b090b7cebdcb7e02050800135ab8555cb17f98542ace2bf4f"}
Jun 09 09:36:58.490195 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:58.490149    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6" podStartSLOduration=2.151516264 podStartE2EDuration="4.490133315s" totalImagesPullingTime="2.338617051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:58.488851376 +0000 UTC m=+242.296356132" watchObservedRunningTime="2026-06-09 09:36:58.490133315 +0000 UTC m=+242.297638105"
Jun 09 09:36:59.479711 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"}
Jun 09 09:36:59.480137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"}
Jun 09 09:36:59.480137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"}
Jun 09 09:36:59.480137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"}
Jun 09 09:36:59.480137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"}
Jun 09 09:36:59.480137 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.479923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerStarted","Data":"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"}
Jun 09 09:36:59.505512 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:36:59.504701    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.93037688 podStartE2EDuration="8.504682363s" totalImagesPullingTime="4.556872357s" totalInitContainerRuntime="17.433126ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:36:59.502622654 +0000 UTC m=+243.310127386" watchObservedRunningTime="2026-06-09 09:36:59.504682363 +0000 UTC m=+243.312187097"
Jun 09 09:37:02.826082 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:02.826044    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:02.845982 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:02.845953    2563 patch_prober.go:28] interesting pod/image-registry-788fdd66c-mnqxs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:02.846134 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:02.846006    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:02.926261 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:02.926217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:03.193085 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:03.193013    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:03.193085 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:03.193060    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:03.478481 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:03.478454    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cd6cf946c-f269c"
Jun 09 09:37:04.117999 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:04.117960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:04.178549 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:04.178511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:05.383054 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:05.382982    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:05.383054 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:05.383032    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:05.589874 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:05.589814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:05.640866 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:05.640778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:07.863046 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:07.863010    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry" containerID="cri-o://18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e" gracePeriod=30
Jun 09 09:37:08.543484 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:08.543447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:37:08.545779 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:08.545750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5167279c-68fd-4b23-9a4c-0c8cd92cd330-metrics-certs\") pod \"network-metrics-daemon-kcrvz\" (UID: \"5167279c-68fd-4b23-9a4c-0c8cd92cd330\") " pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:37:08.842476 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:08.842392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-79nq8\""
Jun 09 09:37:08.850555 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:08.850528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kcrvz"
Jun 09 09:37:12.841373 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:12.841337    2563 patch_prober.go:28] interesting pod/image-registry-788fdd66c-mnqxs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.133.0.9:5000/healthz\": dial tcp 10.133.0.9:5000: connect: connection refused" start-of-body=
Jun 09 09:37:12.841808 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:12.841391    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry" probeResult="failure" output="Get \"https://10.133.0.9:5000/healthz\": dial tcp 10.133.0.9:5000: connect: connection refused"
Jun 09 09:37:13.192267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.192175    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:13.192267 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.192239    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:13.397477 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.397457    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kcrvz"]
Jun 09 09:37:13.408005 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:37:13.407976    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5167279c_68fd_4b23_9a4c_0c8cd92cd330.slice/crio-e8720ff10b086ec554a1c908393f6ce4c4c5537e7b0b0fb2fae8acd94a8c455c WatchSource:0}: Error finding container e8720ff10b086ec554a1c908393f6ce4c4c5537e7b0b0fb2fae8acd94a8c455c: Status 404 returned error can't find the container with id e8720ff10b086ec554a1c908393f6ce4c4c5537e7b0b0fb2fae8acd94a8c455c
Jun 09 09:37:13.439419 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.439396    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:37:13.486352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.486480 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.486555 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjl5c\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.486555 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486540    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.486660 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.486660 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.487050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486669    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.487050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") pod \"58234a7a-357c-4d20-9506-32f859918e2d\" (UID: \"58234a7a-357c-4d20-9506-32f859918e2d\") "
Jun 09 09:37:13.487050 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.486728    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 09:37:13.487226 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.487049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:13.487226 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.487127    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-trusted-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.487590 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.487548    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 09:37:13.489293 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.489262    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:37:13.489398 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.489336    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:37:13.489473 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.489445    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:37:13.489576 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.489558    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c" (OuterVolumeSpecName: "kube-api-access-vjl5c") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "kube-api-access-vjl5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:37:13.489665 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.489647    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:37:13.495198 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.495164    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58234a7a-357c-4d20-9506-32f859918e2d" (UID: "58234a7a-357c-4d20-9506-32f859918e2d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 09:37:13.540757 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.540721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:13.543108 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.543085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-jdjdl" event={"ID":"e1988dc3-2cff-4c51-b0fc-7cf82584119f","Type":"ContainerStarted","Data":"89bd9c9a853a4e9322afeb455f99b65ba2acf0304f2367923e1ea5b146cde386"}
Jun 09 09:37:13.543285 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.543266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:37:13.544412 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.544388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcrvz" event={"ID":"5167279c-68fd-4b23-9a4c-0c8cd92cd330","Type":"ContainerStarted","Data":"e8720ff10b086ec554a1c908393f6ce4c4c5537e7b0b0fb2fae8acd94a8c455c"}
Jun 09 09:37:13.544513 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.544494    2563 patch_prober.go:28] interesting pod/downloads-6657875f97-jdjdl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused" start-of-body=
Jun 09 09:37:13.544559 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.544545    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-jdjdl" podUID="e1988dc3-2cff-4c51-b0fc-7cf82584119f" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.15:8080/\": dial tcp 10.133.0.15:8080: connect: connection refused"
Jun 09 09:37:13.545577 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.545559    2563 generic.go:356] "Generic (PLEG): container finished" podID="58234a7a-357c-4d20-9506-32f859918e2d" containerID="18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e" exitCode=0
Jun 09 09:37:13.545646 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.545586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" event={"ID":"58234a7a-357c-4d20-9506-32f859918e2d","Type":"ContainerDied","Data":"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"}
Jun 09 09:37:13.545646 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.545595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs"
Jun 09 09:37:13.545646 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.545610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-788fdd66c-mnqxs" event={"ID":"58234a7a-357c-4d20-9506-32f859918e2d","Type":"ContainerDied","Data":"7ae7d7fa33eb106d606993c08803500c0e3e86af6e0642ccf7d8b35d1ca38a2f"}
Jun 09 09:37:13.545646 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.545629    2563 scope.go:117] "RemoveContainer" containerID="18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"
Jun 09 09:37:13.554399 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.554375    2563 scope.go:117] "RemoveContainer" containerID="18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"
Jun 09 09:37:13.554693 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:37:13.554666    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e\": container with ID starting with 18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e not found: ID does not exist" containerID="18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"
Jun 09 09:37:13.554779 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.554700    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e"} err="failed to get container status \"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e\": rpc error: code = NotFound desc = could not find container \"18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e\": container with ID starting with 18baedd4f530ade2523c6383d70f93b99382cdb73a89dd829e335f2a32a7d29e not found: ID does not exist"
Jun 09 09:37:13.560123 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.560082    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-jdjdl" podStartSLOduration=1.508697176 podStartE2EDuration="31.560068383s" totalImagesPullingTime="30.051371207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:13.558948552 +0000 UTC m=+257.366453280" watchObservedRunningTime="2026-06-09 09:37:13.560068383 +0000 UTC m=+257.367573113"
Jun 09 09:37:13.571945 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.571919    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:37:13.577239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.577214    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-788fdd66c-mnqxs"]
Jun 09 09:37:13.588540 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588517    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58234a7a-357c-4d20-9506-32f859918e2d-ca-trust-extracted\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588544    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-bound-sa-token\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588558    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588566    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-installation-pull-secrets\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588578    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjl5c\" (UniqueName: \"kubernetes.io/projected/58234a7a-357c-4d20-9506-32f859918e2d-kube-api-access-vjl5c\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588589    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58234a7a-357c-4d20-9506-32f859918e2d-image-registry-private-configuration\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:13.588644 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:13.588599    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58234a7a-357c-4d20-9506-32f859918e2d-registry-certificates\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:37:14.565367 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:14.565285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-jdjdl"
Jun 09 09:37:14.646436 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:14.646391    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58234a7a-357c-4d20-9506-32f859918e2d" path="/var/lib/kubelet/pods/58234a7a-357c-4d20-9506-32f859918e2d/volumes"
Jun 09 09:37:14.890812 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:14.890729    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:37:14.891191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:14.891163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:37:15.038140 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:15.038101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:15.090810 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:15.090721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:15.384844 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:15.384796    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:15.385022 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:15.384874    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:16.563716 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.563682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcrvz" event={"ID":"5167279c-68fd-4b23-9a4c-0c8cd92cd330","Type":"ContainerStarted","Data":"158500e46ffde321e551a02fa32aca066ec416b7c09677b7cd7dc8192a23dc55"}
Jun 09 09:37:16.564165 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.563733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kcrvz" event={"ID":"5167279c-68fd-4b23-9a4c-0c8cd92cd330","Type":"ContainerStarted","Data":"6eb4bbc3fbd89e8fe2fb89bb748cce56ef43823bc967b37a63fa3567063938f5"}
Jun 09 09:37:16.582014 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.581967    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kcrvz" podStartSLOduration=258.568621748 podStartE2EDuration="4m20.581947455s" totalImagesPullingTime="2.013325707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:16.579634293 +0000 UTC m=+260.387139027" watchObservedRunningTime="2026-06-09 09:37:16.581947455 +0000 UTC m=+260.389452185"
Jun 09 09:37:16.684740 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.684690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:16.788309 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.788268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:16.842066 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:16.841989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:23.191341 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.191306    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:23.192127 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.191364    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:23.192127 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.191399    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:37:23.192127 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.191783    2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"da61d4ebefa95c321221e82a531e7883b20297c58c072546394da62017e09bd0"} pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" containerMessage="Container registry failed liveness probe, will be restarted"
Jun 09 09:37:23.195479 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.195452    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:23.195586 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:23.195500    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:24.540265 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:24.540216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:24.597614 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:24.597573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:27.546946 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:27.546909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:27.607736 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:27.607702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:28.485911 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:28.485875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:28.585297 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:28.585269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:33.196682 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:33.196648    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:33.197158 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:33.196707    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:34.051563 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:34.051527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:34.152634 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:34.152607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:34.895992 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:34.895920    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:37:34.899748 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:34.899726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79c7677f76-xvjf6"
Jun 09 09:37:36.645276 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:36.645235    2563 generic.go:356] "Generic (PLEG): container finished" podID="717ad8b5-5bda-4ff7-ac03-6933003314ef" containerID="ed22757b3cfc2bac79e4c243a3c6ee2bfc069e4525eaa71b331103adb2db8326" exitCode=0
Jun 09 09:37:36.645672 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:36.645301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hh6zb" event={"ID":"717ad8b5-5bda-4ff7-ac03-6933003314ef","Type":"ContainerDied","Data":"ed22757b3cfc2bac79e4c243a3c6ee2bfc069e4525eaa71b331103adb2db8326"}
Jun 09 09:37:36.645672 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:36.645614    2563 scope.go:117] "RemoveContainer" containerID="ed22757b3cfc2bac79e4c243a3c6ee2bfc069e4525eaa71b331103adb2db8326"
Jun 09 09:37:37.138924 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:37:37.138888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7hf6s" podUID="fc4bbbbf-18e4-4572-af37-9415a7f0d4bc"
Jun 09 09:37:37.651525 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:37.651490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-hh6zb" event={"ID":"717ad8b5-5bda-4ff7-ac03-6933003314ef","Type":"ContainerStarted","Data":"2f2b54bf987305507dab4a695050382e69fd6d2b42171ca2e00e47fbaef3dac5"}
Jun 09 09:37:37.651938 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:37.651509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:39.328383 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:39.328350    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/init-config-reloader/0.log"
Jun 09 09:37:39.528056 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:39.528022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/alertmanager/0.log"
Jun 09 09:37:39.729705 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:39.729680    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/config-reloader/0.log"
Jun 09 09:37:39.927516 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:39.927490    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/kube-rbac-proxy-web/0.log"
Jun 09 09:37:40.127963 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.127890    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/kube-rbac-proxy/0.log"
Jun 09 09:37:40.327897 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.327870    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/kube-rbac-proxy-metric/0.log"
Jun 09 09:37:40.527731 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.527701    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a66813e5-02a3-42ea-be7d-69504fdc91e6/prom-label-proxy/0.log"
Jun 09 09:37:40.923651 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.923576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:40.925955 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.925933    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc4bbbbf-18e4-4572-af37-9415a7f0d4bc-metrics-tls\") pod \"dns-default-7hf6s\" (UID: \"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc\") " pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:40.928536 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.928514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-state-metrics/0.log"
Jun 09 09:37:40.954973 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.954953    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbxj\""
Jun 09 09:37:40.963132 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:40.963116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:41.106790 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.106764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7hf6s"]
Jun 09 09:37:41.109978 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:37:41.109952    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4bbbbf_18e4_4572_af37_9415a7f0d4bc.slice/crio-e611a1bbc2caa8dfd1a46949686ffea96cd67d592e676d9fdca534af57e8c26e WatchSource:0}: Error finding container e611a1bbc2caa8dfd1a46949686ffea96cd67d592e676d9fdca534af57e8c26e: Status 404 returned error can't find the container with id e611a1bbc2caa8dfd1a46949686ffea96cd67d592e676d9fdca534af57e8c26e
Jun 09 09:37:41.127070 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.127047    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-rbac-proxy-main/0.log"
Jun 09 09:37:41.327939 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.327895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-rbac-proxy-self/0.log"
Jun 09 09:37:41.528028 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.527999    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79c7677f76-xvjf6_d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a/metrics-server/0.log"
Jun 09 09:37:41.667488 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.667399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hf6s" event={"ID":"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc","Type":"ContainerStarted","Data":"e611a1bbc2caa8dfd1a46949686ffea96cd67d592e676d9fdca534af57e8c26e"}
Jun 09 09:37:41.928287 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:41.928213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/init-textfile/0.log"
Jun 09 09:37:42.129532 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:42.129500    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/node-exporter/0.log"
Jun 09 09:37:42.328106 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:42.328065    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/kube-rbac-proxy/0.log"
Jun 09 09:37:43.195530 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.195495    2563 patch_prober.go:28] interesting pod/image-registry-7df5cccb6d-vvm45 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 09 09:37:43.195919 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.195548    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 09:37:43.527679 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.527599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:43.628838 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.628794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:43.678213 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.678191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hf6s" event={"ID":"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc","Type":"ContainerStarted","Data":"5e7d32592c82b62f264066a3ce8083ddd0d59752db1dc8c2d8f7a8fc42f17455"}
Jun 09 09:37:43.678327 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.678235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7hf6s" event={"ID":"fc4bbbbf-18e4-4572-af37-9415a7f0d4bc","Type":"ContainerStarted","Data":"a03bd3e7f3674676ea8c7633c3275c12f68ce89d3eacd9faa7f3776c44e0dc23"}
Jun 09 09:37:43.678379 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.678329    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:43.696724 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.696687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7hf6s" podStartSLOduration=250.506521518 podStartE2EDuration="4m12.696673419s" totalImagesPullingTime="2.190151901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:37:43.694934335 +0000 UTC m=+287.502439081" watchObservedRunningTime="2026-06-09 09:37:43.696673419 +0000 UTC m=+287.504178149"
Jun 09 09:37:43.727755 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.727729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/kube-rbac-proxy-main/0.log"
Jun 09 09:37:43.927118 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:43.927082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/kube-rbac-proxy-self/0.log"
Jun 09 09:37:44.127974 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:44.127909    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/openshift-state-metrics/0.log"
Jun 09 09:37:46.129732 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.129653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kmwxq_3bb991fc-76d0-4a2d-bd88-5889ea54d136/prometheus-operator-admission-webhook/0.log"
Jun 09 09:37:46.328618 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.328586    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/thanos-query/0.log"
Jun 09 09:37:46.478446 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.478418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:46.527915 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.527895    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-web/0.log"
Jun 09 09:37:46.579575 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.579545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:46.630773 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.630750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:46.691166 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.691143    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b1b34b5-fbff-4389-a6c6-4770ee9074d5" containerID="78ac51df40fcc9092b9924bc17668f93e708a80111e7be21360de122f71c167f" exitCode=0
Jun 09 09:37:46.691291 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.691195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v" event={"ID":"2b1b34b5-fbff-4389-a6c6-4770ee9074d5","Type":"ContainerDied","Data":"78ac51df40fcc9092b9924bc17668f93e708a80111e7be21360de122f71c167f"}
Jun 09 09:37:46.691455 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.691443    2563 scope.go:117] "RemoveContainer" containerID="78ac51df40fcc9092b9924bc17668f93e708a80111e7be21360de122f71c167f"
Jun 09 09:37:46.728289 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.728268    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy/0.log"
Jun 09 09:37:46.835874 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.835821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:46.928843 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.928803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/prom-label-proxy/0.log"
Jun 09 09:37:46.936164 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:46.936135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:47.128718 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:47.128634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-rules/0.log"
Jun 09 09:37:47.329104 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:47.329076    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-metrics/0.log"
Jun 09 09:37:47.698619 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:47.698590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-dng2v" event={"ID":"2b1b34b5-fbff-4389-a6c6-4770ee9074d5","Type":"ContainerStarted","Data":"919514ca4e12c48edbfce37bc8e7e1c912beeb21926a61989797fde4691bbd9d"}
Jun 09 09:37:47.730969 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:47.730941    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:37:47.931648 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:47.931615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/2.log"
Jun 09 09:37:48.211347 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.211303    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" podUID="767f6769-9aa0-4589-bcb9-030348410b8d" containerName="registry" containerID="cri-o://da61d4ebefa95c321221e82a531e7883b20297c58c072546394da62017e09bd0" gracePeriod=30
Jun 09 09:37:48.530472 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.530447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jdjdl_e1988dc3-2cff-4c51-b0fc-7cf82584119f/download-server/0.log"
Jun 09 09:37:48.692086 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.692059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:48.727835 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.727809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7hf6s_fc4bbbbf-18e4-4572-af37-9415a7f0d4bc/dns/0.log"
Jun 09 09:37:48.740973 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.740942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:48.927973 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:48.927900    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7hf6s_fc4bbbbf-18e4-4572-af37-9415a7f0d4bc/kube-rbac-proxy/0.log"
Jun 09 09:37:49.708919 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:49.708834    2563 generic.go:356] "Generic (PLEG): container finished" podID="767f6769-9aa0-4589-bcb9-030348410b8d" containerID="da61d4ebefa95c321221e82a531e7883b20297c58c072546394da62017e09bd0" exitCode=0
Jun 09 09:37:49.709286 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:49.708926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" event={"ID":"767f6769-9aa0-4589-bcb9-030348410b8d","Type":"ContainerDied","Data":"da61d4ebefa95c321221e82a531e7883b20297c58c072546394da62017e09bd0"}
Jun 09 09:37:49.709286 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:49.708970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45" event={"ID":"767f6769-9aa0-4589-bcb9-030348410b8d","Type":"ContainerStarted","Data":"7aad8f526a44333daa91163ba19d02f3a5dae3517dd2f8baad29dc0097138e86"}
Jun 09 09:37:49.709286 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:49.708991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:37:50.127817 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:50.127791    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hc2xf_9369b817-e406-4f2f-8bff-f1778ecbaca3/dns-node-resolver/0.log"
Jun 09 09:37:50.550662 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:50.550625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:50.608502 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:50.608476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:50.727916 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:50.727891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df5cccb6d-vvm45_767f6769-9aa0-4589-bcb9-030348410b8d/registry/1.log"
Jun 09 09:37:51.128442 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:51.128413    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s647z_281b27f8-d59f-489b-9164-e9a08b780af0/node-ca/0.log"
Jun 09 09:37:51.728075 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:51.728045    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kpsbf_b89759f7-7620-435e-85d0-d4279cac08f1/serve-healthcheck-canary/0.log"
Jun 09 09:37:53.684405 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:53.684370    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7hf6s"
Jun 09 09:37:56.586061 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:56.586030    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:37:56.589197 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:56.589167    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:37:56.593899 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:56.593879    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:37:56.596657 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:56.596637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:37:56.598133 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:56.598113    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jun 09 09:37:58.766068 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:58.766036    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:37:58.820889 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:37:58.820860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:02.821457 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:02.821426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:02.922714 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:02.922676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:05.108010 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:05.107968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:05.206953 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:05.206917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:05.308344 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:05.308309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:07.838030 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:07.837997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:07.939012 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:07.938975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:09.440630 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:09.440597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:09.644918 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:09.644881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:10.506531 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506498    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:10.506905 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506817    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="alertmanager" containerID="cri-o://5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25" gracePeriod=120
Jun 09 09:38:10.506976 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506886    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-metric" containerID="cri-o://82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42" gracePeriod=120
Jun 09 09:38:10.506976 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506904    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-web" containerID="cri-o://40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381" gracePeriod=120
Jun 09 09:38:10.507089 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506955    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="prom-label-proxy" containerID="cri-o://b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb" gracePeriod=120
Jun 09 09:38:10.507089 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.506975    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy" containerID="cri-o://ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb" gracePeriod=120
Jun 09 09:38:10.507172 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.507117    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="config-reloader" containerID="cri-o://09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87" gracePeriod=120
Jun 09 09:38:10.717744 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.717726    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df5cccb6d-vvm45"
Jun 09 09:38:10.802239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802169    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb" exitCode=0
Jun 09 09:38:10.802239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802191    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb" exitCode=0
Jun 09 09:38:10.802239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802197    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87" exitCode=0
Jun 09 09:38:10.802239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802204    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25" exitCode=0
Jun 09 09:38:10.802239 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"}
Jun 09 09:38:10.802480 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"}
Jun 09 09:38:10.802480 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"}
Jun 09 09:38:10.802480 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.802319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"}
Jun 09 09:38:10.847793 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.847744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:10.948547 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:10.948518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:11.049611 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.049579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:11.149636 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.149555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:11.743148 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.743127    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.772990 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.772950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773118 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773024    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773118 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773118 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773094    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773126    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phvdm\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773290 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773276    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773340    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773362    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 09:38:11.773511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773370    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773771 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773540    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca\") pod \"a66813e5-02a3-42ea-be7d-69504fdc91e6\" (UID: \"a66813e5-02a3-42ea-be7d-69504fdc91e6\") "
Jun 09 09:38:11.773771 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773662    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 09:38:11.775699 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.773992    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 09:38:11.775699 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.774031    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.775699 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.774084    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-alertmanager-main-db\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.777347 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.777300    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.777760 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.777713    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:38:11.777914 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.777784    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out" (OuterVolumeSpecName: "config-out") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 09:38:11.778478 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.778449    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.778698 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.778666    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.779788 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.779747    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.779970 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.779874    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm" (OuterVolumeSpecName: "kube-api-access-phvdm") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "kube-api-access-phvdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:38:11.780130 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.780101    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume" (OuterVolumeSpecName: "config-volume") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.783354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.783330    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.790943 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.790921    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config" (OuterVolumeSpecName: "web-config") pod "a66813e5-02a3-42ea-be7d-69504fdc91e6" (UID: "a66813e5-02a3-42ea-be7d-69504fdc91e6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 09:38:11.810323 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810293    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42" exitCode=0
Jun 09 09:38:11.810323 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810319    2563 generic.go:356] "Generic (PLEG): container finished" podID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerID="40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381" exitCode=0
Jun 09 09:38:11.810495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"}
Jun 09 09:38:11.810495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810387    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.810495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"}
Jun 09 09:38:11.810495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a66813e5-02a3-42ea-be7d-69504fdc91e6","Type":"ContainerDied","Data":"41f627f6ab3e41517d20e6989bdf37b3e938169b257f5593b68d88e676ab9bc1"}
Jun 09 09:38:11.810659 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.810503    2563 scope.go:117] "RemoveContainer" containerID="b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"
Jun 09 09:38:11.819514 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.819482    2563 scope.go:117] "RemoveContainer" containerID="82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"
Jun 09 09:38:11.827262 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.827243    2563 scope.go:117] "RemoveContainer" containerID="ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"
Jun 09 09:38:11.834776 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.834142    2563 scope.go:117] "RemoveContainer" containerID="40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"
Jun 09 09:38:11.835661 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.835638    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:11.841772 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.841752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:11.842025 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.842010    2563 scope.go:117] "RemoveContainer" containerID="09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"
Jun 09 09:38:11.848920 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.848903    2563 scope.go:117] "RemoveContainer" containerID="5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"
Jun 09 09:38:11.855519 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.855504    2563 scope.go:117] "RemoveContainer" containerID="449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"
Jun 09 09:38:11.861945 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.861928    2563 scope.go:117] "RemoveContainer" containerID="b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"
Jun 09 09:38:11.862174 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.862157    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb\": container with ID starting with b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb not found: ID does not exist" containerID="b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"
Jun 09 09:38:11.862215 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862182    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"} err="failed to get container status \"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb\": rpc error: code = NotFound desc = could not find container \"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb\": container with ID starting with b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb not found: ID does not exist"
Jun 09 09:38:11.862215 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862199    2563 scope.go:117] "RemoveContainer" containerID="82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"
Jun 09 09:38:11.862419 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.862403    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42\": container with ID starting with 82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42 not found: ID does not exist" containerID="82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"
Jun 09 09:38:11.862461 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"} err="failed to get container status \"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42\": rpc error: code = NotFound desc = could not find container \"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42\": container with ID starting with 82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42 not found: ID does not exist"
Jun 09 09:38:11.862461 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862443    2563 scope.go:117] "RemoveContainer" containerID="ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"
Jun 09 09:38:11.862685 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.862668    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb\": container with ID starting with ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb not found: ID does not exist" containerID="ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"
Jun 09 09:38:11.862731 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"} err="failed to get container status \"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb\": rpc error: code = NotFound desc = could not find container \"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb\": container with ID starting with ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb not found: ID does not exist"
Jun 09 09:38:11.862731 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862705    2563 scope.go:117] "RemoveContainer" containerID="40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"
Jun 09 09:38:11.862936 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.862914    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381\": container with ID starting with 40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381 not found: ID does not exist" containerID="40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"
Jun 09 09:38:11.863042 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862939    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"} err="failed to get container status \"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381\": rpc error: code = NotFound desc = could not find container \"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381\": container with ID starting with 40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381 not found: ID does not exist"
Jun 09 09:38:11.863042 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.862958    2563 scope.go:117] "RemoveContainer" containerID="09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"
Jun 09 09:38:11.863189 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.863173    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87\": container with ID starting with 09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87 not found: ID does not exist" containerID="09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"
Jun 09 09:38:11.863228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863193    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"} err="failed to get container status \"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87\": rpc error: code = NotFound desc = could not find container \"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87\": container with ID starting with 09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87 not found: ID does not exist"
Jun 09 09:38:11.863228 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863214    2563 scope.go:117] "RemoveContainer" containerID="5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"
Jun 09 09:38:11.863423 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.863406    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25\": container with ID starting with 5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25 not found: ID does not exist" containerID="5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"
Jun 09 09:38:11.863471 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863427    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"} err="failed to get container status \"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25\": rpc error: code = NotFound desc = could not find container \"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25\": container with ID starting with 5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25 not found: ID does not exist"
Jun 09 09:38:11.863471 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863440    2563 scope.go:117] "RemoveContainer" containerID="449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"
Jun 09 09:38:11.863618 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:38:11.863597    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c\": container with ID starting with 449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c not found: ID does not exist" containerID="449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"
Jun 09 09:38:11.863658 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863624    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"} err="failed to get container status \"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c\": rpc error: code = NotFound desc = could not find container \"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c\": container with ID starting with 449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c not found: ID does not exist"
Jun 09 09:38:11.863658 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863636    2563 scope.go:117] "RemoveContainer" containerID="b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"
Jun 09 09:38:11.863869 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863854    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb"} err="failed to get container status \"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb\": rpc error: code = NotFound desc = could not find container \"b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb\": container with ID starting with b5cf37d018396f33897a6eb71215711dc10f95ab8fa6f84409a9f432bf765fcb not found: ID does not exist"
Jun 09 09:38:11.863909 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.863869    2563 scope.go:117] "RemoveContainer" containerID="82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"
Jun 09 09:38:11.864070 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864052    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42"} err="failed to get container status \"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42\": rpc error: code = NotFound desc = could not find container \"82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42\": container with ID starting with 82586d763f5f85f9d5bff987f01aab653db7785b0584c95b62c187a6ef9d9d42 not found: ID does not exist"
Jun 09 09:38:11.864111 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864071    2563 scope.go:117] "RemoveContainer" containerID="ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"
Jun 09 09:38:11.864274 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864255    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb"} err="failed to get container status \"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb\": rpc error: code = NotFound desc = could not find container \"ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb\": container with ID starting with ad7d9c3c7adb355663a5c6fa2246ff48e039812fa6fc7ef432c6d1e2ec1793cb not found: ID does not exist"
Jun 09 09:38:11.864321 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864275    2563 scope.go:117] "RemoveContainer" containerID="40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"
Jun 09 09:38:11.864493 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864476    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381"} err="failed to get container status \"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381\": rpc error: code = NotFound desc = could not find container \"40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381\": container with ID starting with 40d4131d6c0fe629e472333d438575cb5aa77c3fdede28968ebdd26811975381 not found: ID does not exist"
Jun 09 09:38:11.864556 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864496    2563 scope.go:117] "RemoveContainer" containerID="09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"
Jun 09 09:38:11.864751 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864732    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87"} err="failed to get container status \"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87\": rpc error: code = NotFound desc = could not find container \"09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87\": container with ID starting with 09eb967d7eb2b582e58a11945ac4eaaabaf951d99736d083c32d3bbce4ba6a87 not found: ID does not exist"
Jun 09 09:38:11.864803 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.864752    2563 scope.go:117] "RemoveContainer" containerID="5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"
Jun 09 09:38:11.865042 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.865002    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25"} err="failed to get container status \"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25\": rpc error: code = NotFound desc = could not find container \"5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25\": container with ID starting with 5eedf1acd96f2c1e87daf97da6b6648135950c5f23f35e77e131deb5723c3b25 not found: ID does not exist"
Jun 09 09:38:11.865042 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.865028    2563 scope.go:117] "RemoveContainer" containerID="449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"
Jun 09 09:38:11.865336 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.865304    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c"} err="failed to get container status \"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c\": rpc error: code = NotFound desc = could not find container \"449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c\": container with ID starting with 449c99d71e812c45aa9f810c1b14a86334bd0141f05ebe6a4814ca365c7a0a0c not found: ID does not exist"
Jun 09 09:38:11.866681 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.866661    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:11.867020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867004    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="alertmanager"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867022    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="alertmanager"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867034    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867040    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867049    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-metric"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867055    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-metric"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867061    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="prom-label-proxy"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867066    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="prom-label-proxy"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867073    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-web"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867078    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-web"
Jun 09 09:38:11.867083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867086    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="config-reloader"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867091    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="config-reloader"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867098    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867103    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867109    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="init-config-reloader"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867114    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="init-config-reloader"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867166    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="prom-label-proxy"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867173    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867180    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-metric"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867186    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="alertmanager"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867194    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58234a7a-357c-4d20-9506-32f859918e2d" containerName="registry"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867199    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="config-reloader"
Jun 09 09:38:11.867354 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.867205    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" containerName="kube-rbac-proxy-web"
Jun 09 09:38:11.870361 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.870346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.872738 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.872720    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 09 09:38:11.872853 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.872734    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 09 09:38:11.872853 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.872746    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 09 09:38:11.872987 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.872739    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 09 09:38:11.873041 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.872989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 09 09:38:11.873092 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.873042    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 09 09:38:11.873234 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.873183    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 09 09:38:11.873349 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.873245    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qpcgn\""
Jun 09 09:38:11.873349 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.873248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 09 09:38:11.874430 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874413    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874431    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-cluster-tls-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874441    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-volume\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874450    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a66813e5-02a3-42ea-be7d-69504fdc91e6-config-out\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874458    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874468    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-main-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874531    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a66813e5-02a3-42ea-be7d-69504fdc91e6-metrics-client-ca\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874575    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-web-config\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874587    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-tls-assets\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874600    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a66813e5-02a3-42ea-be7d-69504fdc91e6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.874697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.874613    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phvdm\" (UniqueName: \"kubernetes.io/projected/a66813e5-02a3-42ea-be7d-69504fdc91e6-kube-api-access-phvdm\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:38:11.877739 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.877723    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 09 09:38:11.883677 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.883655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:11.975477 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975720 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975720 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975720 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-web-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975720 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975720 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975924 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975924 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-out\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975924 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcfgd\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-kube-api-access-bcfgd\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:11.975924 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:11.975834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076278 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-web-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-out\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcfgd\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-kube-api-access-bcfgd\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.076993 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.076699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.077154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.077130    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.077304 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.077279    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94020ba-7ac4-4b1b-949d-9147b4ce1421-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079559 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079529    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079690 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079640    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079805 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079780    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079805 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079795    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079928 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.079983 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079963    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-volume\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.080022 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.080022 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.079994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94020ba-7ac4-4b1b-949d-9147b4ce1421-web-config\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.081246 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.081230    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94020ba-7ac4-4b1b-949d-9147b4ce1421-config-out\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.083966 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.083949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcfgd\" (UniqueName: \"kubernetes.io/projected/a94020ba-7ac4-4b1b-949d-9147b4ce1421-kube-api-access-bcfgd\") pod \"alertmanager-main-0\" (UID: \"a94020ba-7ac4-4b1b-949d-9147b4ce1421\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.180449 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.180389    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 09 09:38:12.313289 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.313265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 09 09:38:12.315562 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:38:12.315536    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94020ba_7ac4_4b1b_949d_9147b4ce1421.slice/crio-883685b6a25a0c9a0d8933468e94774d509a07a80047006a28cf3fe0469c0d86 WatchSource:0}: Error finding container 883685b6a25a0c9a0d8933468e94774d509a07a80047006a28cf3fe0469c0d86: Status 404 returned error can't find the container with id 883685b6a25a0c9a0d8933468e94774d509a07a80047006a28cf3fe0469c0d86
Jun 09 09:38:12.644235 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.644199    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66813e5-02a3-42ea-be7d-69504fdc91e6" path="/var/lib/kubelet/pods/a66813e5-02a3-42ea-be7d-69504fdc91e6/volumes"
Jun 09 09:38:12.815967 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.815938    2563 generic.go:356] "Generic (PLEG): container finished" podID="a94020ba-7ac4-4b1b-949d-9147b4ce1421" containerID="1483a7428bf922c61b09a20c4f3ddbca672f1c721d7721ac60e229a944492166" exitCode=0
Jun 09 09:38:12.816269 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.815991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerDied","Data":"1483a7428bf922c61b09a20c4f3ddbca672f1c721d7721ac60e229a944492166"}
Jun 09 09:38:12.816269 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:12.816037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"883685b6a25a0c9a0d8933468e94774d509a07a80047006a28cf3fe0469c0d86"}
Jun 09 09:38:13.488681 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.488652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:13.546152 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.546131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:13.823754 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"9893c2719f27a8431b405928a76240a25adf7dce35d45e531d190530782a3190"}
Jun 09 09:38:13.824096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823788    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"a44ee284dbba34f3991c6643ab80a2c344e0f04a9e3d21646d5caa4ac615601e"}
Jun 09 09:38:13.824096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"3cfc9e78b0560c22c61556e44ad240c01db534d124d544058dcb1b760f57e59f"}
Jun 09 09:38:13.824096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"4ec3d25cd56cac61bf761d09995ac3e03e6164572b23e10dd91aa17121e12510"}
Jun 09 09:38:13.824096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"0efb6b85a238533ea79b450e8514ab06fe775285f9857d910e19b6d43ed5fa93"}
Jun 09 09:38:13.824096 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.823971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a94020ba-7ac4-4b1b-949d-9147b4ce1421","Type":"ContainerStarted","Data":"fe052272fee37e8e1935e856fbedc7a15b772fcddc5aeeedabe13309a3aad419"}
Jun 09 09:38:13.852250 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:13.852203    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.835375015 podStartE2EDuration="2.852190738s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.815723ms" isStatefulPod=false podCreationTimestamp="2026-06-09 09:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:38:13.850536601 +0000 UTC m=+317.658041332" watchObservedRunningTime="2026-06-09 09:38:13.852190738 +0000 UTC m=+317.659695469"
Jun 09 09:38:14.542203 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.542167    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bb475cfb6-9czpn"]
Jun 09 09:38:14.544763 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.544745    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.547352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.547324    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 09 09:38:14.547448 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.547361    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 09 09:38:14.547448 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.547409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 09 09:38:14.547859 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.547842    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 09 09:38:14.547904 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.547887    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z5cmv\""
Jun 09 09:38:14.548423 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.548406    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 09 09:38:14.552614 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.552564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 09 09:38:14.560023 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.559999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb475cfb6-9czpn"]
Jun 09 09:38:14.596058 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-serving-certs-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596165 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596165 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596165 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596265 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596265 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-federate-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596326 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-metrics-client-ca\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.596364 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.596326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgg68\" (UniqueName: \"kubernetes.io/projected/9d87b4c9-0ead-450d-aef1-523c8764fb3e-kube-api-access-fgg68\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697072 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697169 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-federate-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697169 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-metrics-client-ca\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697169 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgg68\" (UniqueName: \"kubernetes.io/projected/9d87b4c9-0ead-450d-aef1-523c8764fb3e-kube-api-access-fgg68\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697335 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-serving-certs-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697335 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697223    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697335 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.697335 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.697255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.698063 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.698038    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-metrics-client-ca\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.698063 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.698051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-serving-certs-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.698336 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.698310    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.699724 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.699692    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.699852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.699738    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-secret-telemeter-client\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.699852 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.699774    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-federate-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.699970 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.699885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d87b4c9-0ead-450d-aef1-523c8764fb3e-telemeter-client-tls\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.704495 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.704475    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgg68\" (UniqueName: \"kubernetes.io/projected/9d87b4c9-0ead-450d-aef1-523c8764fb3e-kube-api-access-fgg68\") pod \"telemeter-client-bb475cfb6-9czpn\" (UID: \"9d87b4c9-0ead-450d-aef1-523c8764fb3e\") " pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.855428 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.855361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn"
Jun 09 09:38:14.986687 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.986661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb475cfb6-9czpn"]
Jun 09 09:38:14.990216 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:38:14.990191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d87b4c9_0ead_450d_aef1_523c8764fb3e.slice/crio-4ed10bd6d1170bedf69a61f20c626ed734b321a5f038524b5ad43123fae91fd9 WatchSource:0}: Error finding container 4ed10bd6d1170bedf69a61f20c626ed734b321a5f038524b5ad43123fae91fd9: Status 404 returned error can't find the container with id 4ed10bd6d1170bedf69a61f20c626ed734b321a5f038524b5ad43123fae91fd9
Jun 09 09:38:14.992230 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:14.992214    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 09:38:15.833262 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:15.833227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn" event={"ID":"9d87b4c9-0ead-450d-aef1-523c8764fb3e","Type":"ContainerStarted","Data":"4ed10bd6d1170bedf69a61f20c626ed734b321a5f038524b5ad43123fae91fd9"}
Jun 09 09:38:17.843750 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:17.843717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn" event={"ID":"9d87b4c9-0ead-450d-aef1-523c8764fb3e","Type":"ContainerStarted","Data":"915a4ad0083da14856a406592fe8fa501fd8442d9bf850e5d3637028c5159f12"}
Jun 09 09:38:17.844142 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:17.843766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn" event={"ID":"9d87b4c9-0ead-450d-aef1-523c8764fb3e","Type":"ContainerStarted","Data":"e97231dc76836b5cc22246ae53eacbe7014053c9ea865c70305604d326e88411"}
Jun 09 09:38:17.844142 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:17.843784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn" event={"ID":"9d87b4c9-0ead-450d-aef1-523c8764fb3e","Type":"ContainerStarted","Data":"a6af18b46a19ad3ab2cfe0e41b3953610e9b29023ace12a4bd484d73add84254"}
Jun 09 09:38:17.868222 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:17.868173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bb475cfb6-9czpn" podStartSLOduration=1.994627634 podStartE2EDuration="3.868158584s" totalImagesPullingTime="1.87353095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:38:17.866948359 +0000 UTC m=+321.674453091" watchObservedRunningTime="2026-06-09 09:38:17.868158584 +0000 UTC m=+321.675663314"
Jun 09 09:38:18.570139 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:18.570106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:18.636289 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:18.636258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:18.733472 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:18.733436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:22.753283 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:22.753250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:28.489926 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:28.489893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:28.539284 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:28.539247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:29.814027 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:29.813997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:38:29.914637 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:38:29.914604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:07.451821 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:07.451783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:24.705398 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:24.705361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:24.759837 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:24.759804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:36.530683 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:36.530636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:36.580038 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:36.580008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:39.545516 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:39.545474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:39.606725 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:39.606692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:43.487432 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:43.487398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:43.589427 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:43.589399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:48.264307 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:48.264270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:50.062740 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:50.062705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:50.162902 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:50.162860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:39:50.211626 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:39:50.211597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:41:19.306407 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:41:19.306361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:41:19.367989 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:41:19.367960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:42:11.363167 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:11.363097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:42:12.617775 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:12.617729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:42:13.506986 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:13.506947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:42:13.561277 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:13.561249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:42:56.615701 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:56.615675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:42:56.616521 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:56.616502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:42:56.622690 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:56.622675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:42:56.623563 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:42:56.623547    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:43:27.422140 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:27.422062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:27.476748 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:27.476721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:38.791634 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:38.791590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:38.853095 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:38.853069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:38.903932 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:38.903896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:40.948005 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:40.947968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:49.264871 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:49.264817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:43:49.366429 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:43:49.366397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:44:23.673524 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:44:23.673487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:47:46.066083 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.066048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:47:46.658153 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.658122    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:47:46.661250 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.661234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:46.663869 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.663847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pssdw\""
Jun 09 09:47:46.663962 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.663922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 09 09:47:46.665180 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.665164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 09 09:47:46.681156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.681115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:47:46.764369 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.764344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmpfn\" (UniqueName: \"kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn\") pod \"feast-operator-controller-manager-dd864797c-fp4bm\" (UID: \"120151b2-81be-4388-8bbc-9633901a85ae\") " pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:46.865121 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.865097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmpfn\" (UniqueName: \"kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn\") pod \"feast-operator-controller-manager-dd864797c-fp4bm\" (UID: \"120151b2-81be-4388-8bbc-9633901a85ae\") " pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:46.874191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.874170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmpfn\" (UniqueName: \"kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn\") pod \"feast-operator-controller-manager-dd864797c-fp4bm\" (UID: \"120151b2-81be-4388-8bbc-9633901a85ae\") " pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:46.971592 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:46.971572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:47.097727 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:47.097692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:47:47.122749 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:47.122725    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:47:47.125091 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:47:47.125061    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120151b2_81be_4388_8bbc_9633901a85ae.slice/crio-2c784c26d5be676f2f7f6f1eddf00338e842ce27ec2b0522ecac74d50ddbf9fb WatchSource:0}: Error finding container 2c784c26d5be676f2f7f6f1eddf00338e842ce27ec2b0522ecac74d50ddbf9fb: Status 404 returned error can't find the container with id 2c784c26d5be676f2f7f6f1eddf00338e842ce27ec2b0522ecac74d50ddbf9fb
Jun 09 09:47:47.127435 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:47.127418    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 09:47:47.155271 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:47.155229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" event={"ID":"120151b2-81be-4388-8bbc-9633901a85ae","Type":"ContainerStarted","Data":"2c784c26d5be676f2f7f6f1eddf00338e842ce27ec2b0522ecac74d50ddbf9fb"}
Jun 09 09:47:50.170433 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:50.170393    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" event={"ID":"120151b2-81be-4388-8bbc-9633901a85ae","Type":"ContainerStarted","Data":"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"}
Jun 09 09:47:50.170892 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:50.170547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:47:50.188985 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:50.188939    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" podStartSLOduration=1.7470460330000002 podStartE2EDuration="4.188923764s" totalImagesPullingTime="2.441877731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:47:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:47:50.186815408 +0000 UTC m=+893.994320152" watchObservedRunningTime="2026-06-09 09:47:50.188923764 +0000 UTC m=+893.996428494"
Jun 09 09:47:56.644738 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:56.644714    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:47:56.645158 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:56.644844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:47:56.651661 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:56.651642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:47:56.651788 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:47:56.651728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:48:01.176995 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:01.176961    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:48:28.170028 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.169993    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.268237 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.268206    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.460502 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.460427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.560275 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.560248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.617047 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.617015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.718546 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.718480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:28.824744 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:28.824712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:48:29.748373 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:48:29.748339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:49:13.061384 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:49:13.061311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:13.860873 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:13.860741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:13.956989 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:13.956948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.057993 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.057963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.122100 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.122037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.252229 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.252201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.353841 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.353787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.453243 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.453172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:14.555552 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:14.555524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:50:28.238190 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:50:28.238149    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:29.496610 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:29.496578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:29.600117 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:29.600085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:29.698733 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:29.698699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:29.761815 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:29.761741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:29.899334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:29.899304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:30.040534 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:30.040459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:30.142721 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:30.142689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:38.343613 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:38.343578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:51:43.501215 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:51:43.501177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:45.039817 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:45.039782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:45.143078 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:45.143041    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:45.211030 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:45.210998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:45.277047 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:45.277022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:50.327145 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:50.327114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:52:56.670737 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:56.670707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:52:56.672206 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:56.672185    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:52:56.678046 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:56.678013    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:52:56.679415 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:52:56.679398    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:53:09.405579 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:09.405540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:28.001744 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.001703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:28.215173 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.215142    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:53:28.218497 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.218478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:53:28.220818 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.220797    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 09:53:28.220818 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.220798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 09:53:28.221013 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.220844    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-l2spf\""
Jun 09 09:53:28.230797 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.230776    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:53:28.291362 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.291312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5shwq\" (UniqueName: \"kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq\") pod \"redis-69bbd798b6-pgcvq\" (UID: \"e2e2f649-98e2-41fa-8d59-642b4da2a213\") " pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:53:28.298941 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.298904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:28.392425 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.392404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5shwq\" (UniqueName: \"kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq\") pod \"redis-69bbd798b6-pgcvq\" (UID: \"e2e2f649-98e2-41fa-8d59-642b4da2a213\") " pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:53:28.399926 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.399905    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5shwq\" (UniqueName: \"kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq\") pod \"redis-69bbd798b6-pgcvq\" (UID: \"e2e2f649-98e2-41fa-8d59-642b4da2a213\") " pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:53:28.419043 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.419018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:28.527408 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.527393    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:53:28.658954 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.658852    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:53:28.661716 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:53:28.661694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2e2f649_98e2_41fa_8d59_642b4da2a213.slice/crio-84dead1c4e1143af68c16fe2f33f03f41e2e50a9eb1d0126103148f9fbaf455e WatchSource:0}: Error finding container 84dead1c4e1143af68c16fe2f33f03f41e2e50a9eb1d0126103148f9fbaf455e: Status 404 returned error can't find the container with id 84dead1c4e1143af68c16fe2f33f03f41e2e50a9eb1d0126103148f9fbaf455e
Jun 09 09:53:28.663960 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:28.663945    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 09:53:29.558420 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:29.558372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-pgcvq" event={"ID":"e2e2f649-98e2-41fa-8d59-642b4da2a213","Type":"ContainerStarted","Data":"84dead1c4e1143af68c16fe2f33f03f41e2e50a9eb1d0126103148f9fbaf455e"}
Jun 09 09:53:30.564192 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:30.564153    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-pgcvq" event={"ID":"e2e2f649-98e2-41fa-8d59-642b4da2a213","Type":"ContainerStarted","Data":"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"}
Jun 09 09:53:30.580151 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:30.580103    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-pgcvq" podStartSLOduration=1.068021899 podStartE2EDuration="2.580087741s" totalImagesPullingTime="1.512065842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:53:30.578285285 +0000 UTC m=+1234.385790016" watchObservedRunningTime="2026-06-09 09:53:30.580087741 +0000 UTC m=+1234.387592471"
Jun 09 09:53:38.711461 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:38.711424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:38.812962 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:38.812925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:38.908511 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:38.908477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:54.438238 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:54.438198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:53:55.612604 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.612567    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-ffztx"]
Jun 09 09:53:55.618502 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.618482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:53:55.621570 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.621541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-nqkpc\""
Jun 09 09:53:55.621761 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.621541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 09 09:53:55.622448 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.622428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ffztx"]
Jun 09 09:53:55.712049 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.712024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pp5k\" (UniqueName: \"kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k\") pod \"feast-test-apply-ffztx\" (UID: \"8d5cf054-9908-43aa-95a6-3719d23cbe65\") " pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:53:55.813118 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.813098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pp5k\" (UniqueName: \"kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k\") pod \"feast-test-apply-ffztx\" (UID: \"8d5cf054-9908-43aa-95a6-3719d23cbe65\") " pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:53:55.821400 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.821374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pp5k\" (UniqueName: \"kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k\") pod \"feast-test-apply-ffztx\" (UID: \"8d5cf054-9908-43aa-95a6-3719d23cbe65\") " pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:53:55.928921 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:55.928854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:53:56.056047 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:56.056024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ffztx"]
Jun 09 09:53:56.058292 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:53:56.058265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d5cf054_9908_43aa_95a6_3719d23cbe65.slice/crio-7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5 WatchSource:0}: Error finding container 7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5: Status 404 returned error can't find the container with id 7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5
Jun 09 09:53:56.675678 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:53:56.675643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerStarted","Data":"7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5"}
Jun 09 09:54:00.771370 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:00.771345    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jun 09 09:54:01.703418 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:01.703381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerStarted","Data":"aa1e2b26b0c40dcce3329275b5c3423e43535638b54e831bc0da281e9eff9eee"}
Jun 09 09:54:07.729227 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:07.729183    2563 generic.go:356] "Generic (PLEG): container finished" podID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerID="aa1e2b26b0c40dcce3329275b5c3423e43535638b54e831bc0da281e9eff9eee" exitCode=0
Jun 09 09:54:07.729611 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:07.729237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerDied","Data":"aa1e2b26b0c40dcce3329275b5c3423e43535638b54e831bc0da281e9eff9eee"}
Jun 09 09:54:08.735602 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:08.735564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerStarted","Data":"628b8056c11be3fc8496a3c3ec9bdc987eba547f093ba5868167e93ec23d7899"}
Jun 09 09:54:08.752264 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:08.752210    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-ffztx" podStartSLOduration=2.8276394270000003 podStartE2EDuration="13.752194007s" totalImagesPullingTime="4.708525882s" totalInitContainerRuntime="6.216028698s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:54:08.75070255 +0000 UTC m=+1272.558207282" watchObservedRunningTime="2026-06-09 09:54:08.752194007 +0000 UTC m=+1272.559698775"
Jun 09 09:54:17.780365 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:17.780330    2563 generic.go:356] "Generic (PLEG): container finished" podID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerID="628b8056c11be3fc8496a3c3ec9bdc987eba547f093ba5868167e93ec23d7899" exitCode=0
Jun 09 09:54:17.780725 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:17.780397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerDied","Data":"628b8056c11be3fc8496a3c3ec9bdc987eba547f093ba5868167e93ec23d7899"}
Jun 09 09:54:18.920526 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:18.920502    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:54:19.002939 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.002914    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pp5k\" (UniqueName: \"kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k\") pod \"8d5cf054-9908-43aa-95a6-3719d23cbe65\" (UID: \"8d5cf054-9908-43aa-95a6-3719d23cbe65\") "
Jun 09 09:54:19.005012 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.004992    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k" (OuterVolumeSpecName: "kube-api-access-6pp5k") pod "8d5cf054-9908-43aa-95a6-3719d23cbe65" (UID: "8d5cf054-9908-43aa-95a6-3719d23cbe65"). InnerVolumeSpecName "kube-api-access-6pp5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:54:19.104135 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.104084    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pp5k\" (UniqueName: \"kubernetes.io/projected/8d5cf054-9908-43aa-95a6-3719d23cbe65-kube-api-access-6pp5k\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:54:19.790516 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.790488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ffztx"
Jun 09 09:54:19.790516 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.790494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ffztx" event={"ID":"8d5cf054-9908-43aa-95a6-3719d23cbe65","Type":"ContainerDied","Data":"7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5"}
Jun 09 09:54:19.790719 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.790527    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a5986a9eba10b61aaf2d6dbc4dbeece729c92803ccf7a5beb32992c04f5e6a5"
Jun 09 09:54:19.942841 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.942804    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ffztx_8d5cf054-9908-43aa-95a6-3719d23cbe65/feast-0/0.log"
Jun 09 09:54:19.948734 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:19.948710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ffztx_8d5cf054-9908-43aa-95a6-3719d23cbe65/feast-1/0.log"
Jun 09 09:54:50.396506 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:50.396474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:54:55.385749 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.385712    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-ffztx"]
Jun 09 09:54:55.395164 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.395138    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-ffztx"]
Jun 09 09:54:55.404048 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.404028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:54:55.404230 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.404192    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-pgcvq" podUID="e2e2f649-98e2-41fa-8d59-642b4da2a213" containerName="redis" containerID="cri-o://f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545" gracePeriod=30
Jun 09 09:54:55.450238 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.450209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:54:55.649199 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.649138    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:54:55.790374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.790349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5shwq\" (UniqueName: \"kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq\") pod \"e2e2f649-98e2-41fa-8d59-642b4da2a213\" (UID: \"e2e2f649-98e2-41fa-8d59-642b4da2a213\") "
Jun 09 09:54:55.792285 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.792256    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq" (OuterVolumeSpecName: "kube-api-access-5shwq") pod "e2e2f649-98e2-41fa-8d59-642b4da2a213" (UID: "e2e2f649-98e2-41fa-8d59-642b4da2a213"). InnerVolumeSpecName "kube-api-access-5shwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:54:55.891664 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.891642    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5shwq\" (UniqueName: \"kubernetes.io/projected/e2e2f649-98e2-41fa-8d59-642b4da2a213-kube-api-access-5shwq\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:54:55.939036 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.938979    2563 generic.go:356] "Generic (PLEG): container finished" podID="e2e2f649-98e2-41fa-8d59-642b4da2a213" containerID="f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545" exitCode=0
Jun 09 09:54:55.939036 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.939012    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-pgcvq"
Jun 09 09:54:55.939146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.939043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-pgcvq" event={"ID":"e2e2f649-98e2-41fa-8d59-642b4da2a213","Type":"ContainerDied","Data":"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"}
Jun 09 09:54:55.939146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.939078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-pgcvq" event={"ID":"e2e2f649-98e2-41fa-8d59-642b4da2a213","Type":"ContainerDied","Data":"84dead1c4e1143af68c16fe2f33f03f41e2e50a9eb1d0126103148f9fbaf455e"}
Jun 09 09:54:55.939146 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.939097    2563 scope.go:117] "RemoveContainer" containerID="f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"
Jun 09 09:54:55.946988 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.946973    2563 scope.go:117] "RemoveContainer" containerID="f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"
Jun 09 09:54:55.947229 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:54:55.947208    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545\": container with ID starting with f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545 not found: ID does not exist" containerID="f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"
Jun 09 09:54:55.947269 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.947238    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545"} err="failed to get container status \"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545\": rpc error: code = NotFound desc = could not find container \"f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545\": container with ID starting with f3e0235e37ed3b4170c537571c250e0eabef0b2c0b33b3b16d60cf0111b5d545 not found: ID does not exist"
Jun 09 09:54:55.965957 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.965940    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:54:55.978890 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:55.978872    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-pgcvq"]
Jun 09 09:54:56.644198 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:56.644170    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" path="/var/lib/kubelet/pods/8d5cf054-9908-43aa-95a6-3719d23cbe65/volumes"
Jun 09 09:54:56.644498 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:54:56.644485    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2e2f649-98e2-41fa-8d59-642b4da2a213" path="/var/lib/kubelet/pods/e2e2f649-98e2-41fa-8d59-642b4da2a213/volumes"
Jun 09 09:55:21.761805 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:21.761714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:32.717523 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:32.717486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:32.962736 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:32.962696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:33.062030 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:33.061997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:33.300369 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:33.300336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:33.359913 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:33.359810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:55:33.697199 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:55:33.697123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:10.811837 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:10.811802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:10.895595 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:10.895564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:15.793536 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:15.793488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:21.220665 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:21.220630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:21.299532 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:21.299498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:21.441395 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:21.441363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:21.676375 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:21.676295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:34.783305 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:34.783276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:36.871202 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:36.871152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:36.981247 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:36.981211    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:37.056514 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:37.056481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:37.306595 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:37.306556    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:57:56.704474 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:56.704443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:57:56.707271 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:56.707249    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 09:57:56.711475 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:56.711456    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:57:56.714154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:57:56.714137    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 09:59:09.851986 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:09.851945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:12.017871 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.017835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:12.361063 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.360971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:59:12.361254 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.361230    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" podUID="120151b2-81be-4388-8bbc-9633901a85ae" containerName="manager" containerID="cri-o://a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc" gracePeriod=10
Jun 09 09:59:12.367866 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.367813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:12.537378 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.537345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:12.608334 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.608290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:12.638647 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.638623    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:59:12.728156 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.728122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmpfn\" (UniqueName: \"kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn\") pod \"120151b2-81be-4388-8bbc-9633901a85ae\" (UID: \"120151b2-81be-4388-8bbc-9633901a85ae\") "
Jun 09 09:59:12.730295 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.730273    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn" (OuterVolumeSpecName: "kube-api-access-zmpfn") pod "120151b2-81be-4388-8bbc-9633901a85ae" (UID: "120151b2-81be-4388-8bbc-9633901a85ae"). InnerVolumeSpecName "kube-api-access-zmpfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 09:59:12.829441 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:12.829400    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmpfn\" (UniqueName: \"kubernetes.io/projected/120151b2-81be-4388-8bbc-9633901a85ae-kube-api-access-zmpfn\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 09:59:13.008360 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.008327    2563 generic.go:356] "Generic (PLEG): container finished" podID="120151b2-81be-4388-8bbc-9633901a85ae" containerID="a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc" exitCode=0
Jun 09 09:59:13.008526 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.008374    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"
Jun 09 09:59:13.008526 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.008403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" event={"ID":"120151b2-81be-4388-8bbc-9633901a85ae","Type":"ContainerDied","Data":"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"}
Jun 09 09:59:13.008526 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.008454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm" event={"ID":"120151b2-81be-4388-8bbc-9633901a85ae","Type":"ContainerDied","Data":"2c784c26d5be676f2f7f6f1eddf00338e842ce27ec2b0522ecac74d50ddbf9fb"}
Jun 09 09:59:13.008526 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.008477    2563 scope.go:117] "RemoveContainer" containerID="a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"
Jun 09 09:59:13.017180 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.017163    2563 scope.go:117] "RemoveContainer" containerID="a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"
Jun 09 09:59:13.017433 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:59:13.017414    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc\": container with ID starting with a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc not found: ID does not exist" containerID="a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"
Jun 09 09:59:13.017499 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.017440    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc"} err="failed to get container status \"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc\": rpc error: code = NotFound desc = could not find container \"a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc\": container with ID starting with a2b9df4ac99b805dad112a5937b5ef54fc7ad658f344a3c28010efcf6b517cdc not found: ID does not exist"
Jun 09 09:59:13.029007 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.028981    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:59:13.032658 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:13.032637    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-dd864797c-fp4bm"]
Jun 09 09:59:14.644817 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:14.644785    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="120151b2-81be-4388-8bbc-9633901a85ae" path="/var/lib/kubelet/pods/120151b2-81be-4388-8bbc-9633901a85ae/volumes"
Jun 09 09:59:14.851689 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:14.851645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:17.583407 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:17.583361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:17.639322 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:17.639285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:23.192310 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.192243    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:23.292778 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.292739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:23.736374 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.736336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:23.745853 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.745796    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 09:59:23.746154 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746142    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerName="feast-0"
Jun 09 09:59:23.746201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746156    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerName="feast-0"
Jun 09 09:59:23.746201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746174    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e2f649-98e2-41fa-8d59-642b4da2a213" containerName="redis"
Jun 09 09:59:23.746201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746180    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e2f649-98e2-41fa-8d59-642b4da2a213" containerName="redis"
Jun 09 09:59:23.746201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746190    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerName="feast-1"
Jun 09 09:59:23.746201 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746197    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerName="feast-1"
Jun 09 09:59:23.746352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746208    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="120151b2-81be-4388-8bbc-9633901a85ae" containerName="manager"
Jun 09 09:59:23.746352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746214    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="120151b2-81be-4388-8bbc-9633901a85ae" containerName="manager"
Jun 09 09:59:23.746352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746279    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e2f649-98e2-41fa-8d59-642b4da2a213" containerName="redis"
Jun 09 09:59:23.746352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746288    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="120151b2-81be-4388-8bbc-9633901a85ae" containerName="manager"
Jun 09 09:59:23.746352 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.746295    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5cf054-9908-43aa-95a6-3719d23cbe65" containerName="feast-1"
Jun 09 09:59:23.752163 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.752119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:23.755514 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.755487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 09 09:59:23.755669 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.755530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 09 09:59:23.756661 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.756644    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rnx64\""
Jun 09 09:59:23.765931 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.765905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 09:59:23.825970 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.825934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5nv4\" (UniqueName: \"kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4\") pod \"feast-operator-controller-manager-6d54c7db9d-fb77p\" (UID: \"e5489796-d68f-4dbf-8596-0c3b3807c3c6\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:23.926593 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.926557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5nv4\" (UniqueName: \"kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4\") pod \"feast-operator-controller-manager-6d54c7db9d-fb77p\" (UID: \"e5489796-d68f-4dbf-8596-0c3b3807c3c6\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:23.937515 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:23.937479    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5nv4\" (UniqueName: \"kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4\") pod \"feast-operator-controller-manager-6d54c7db9d-fb77p\" (UID: \"e5489796-d68f-4dbf-8596-0c3b3807c3c6\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:24.062999 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:24.062909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:24.201417 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:24.201389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 09:59:24.204313 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:59:24.204285    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5489796_d68f_4dbf_8596_0c3b3807c3c6.slice/crio-e99cf70d36b75c10840280fd158b45923e7be471acd6c2faaf0a4ad6f5437384 WatchSource:0}: Error finding container e99cf70d36b75c10840280fd158b45923e7be471acd6c2faaf0a4ad6f5437384: Status 404 returned error can't find the container with id e99cf70d36b75c10840280fd158b45923e7be471acd6c2faaf0a4ad6f5437384
Jun 09 09:59:24.206302 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:24.206284    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 09:59:25.068375 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:25.068336    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" event={"ID":"e5489796-d68f-4dbf-8596-0c3b3807c3c6","Type":"ContainerStarted","Data":"e99cf70d36b75c10840280fd158b45923e7be471acd6c2faaf0a4ad6f5437384"}
Jun 09 09:59:27.080093 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:27.080052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" event={"ID":"e5489796-d68f-4dbf-8596-0c3b3807c3c6","Type":"ContainerStarted","Data":"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"}
Jun 09 09:59:27.080545 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:27.080216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:27.099185 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:27.099112    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" podStartSLOduration=1.928396037 podStartE2EDuration="4.09909011s" totalImagesPullingTime="2.170694073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 09:59:27.098730371 +0000 UTC m=+1590.906235113" watchObservedRunningTime="2026-06-09 09:59:27.09909011 +0000 UTC m=+1590.906594842"
Jun 09 09:59:38.087333 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:38.087258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 09:59:39.934206 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:39.934162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:39.989989 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:39.989961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.304845 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.304793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.405890 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.405854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.463588 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.463560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.506254 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.506225    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 09:59:40.510877 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.510860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.513697 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.513666    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 09 09:59:40.513847 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.513799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lp5ks\""
Jun 09 09:59:40.513930 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.513913    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 09 09:59:40.513989 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.513943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 09:59:40.514106 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.514088    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 09 09:59:40.514170 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.514155    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 09 09:59:40.514212 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.514155    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 09:59:40.519969 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.519947    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 09:59:40.544603 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.544577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.577455 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb2qf\" (UniqueName: \"kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.577455 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.577589 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.577589 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.577655 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.577655 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.577637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678548 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb2qf\" (UniqueName: \"kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.678676 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.679020 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:59:40.678749    2563 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 09:59:40.679020 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:59:40.678753    2563 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 09 09:59:40.679020 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:59:40.678800    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls podName:6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e nodeName:}" failed. No retries permitted until 2026-06-09 09:59:41.178783976 +0000 UTC m=+1604.986288691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls") pod "feast-simple-feast-setup-75c64c888b-wcwhg" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 09:59:40.679020 ip-10-0-135-66 kubenswrapper[2563]: E0609 09:59:40.678821    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls podName:6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e nodeName:}" failed. No retries permitted until 2026-06-09 09:59:41.178804896 +0000 UTC m=+1604.986309615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls") pod "feast-simple-feast-setup-75c64c888b-wcwhg" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e") : secret "feast-simple-feast-setup-online-tls" not found
Jun 09 09:59:40.679020 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.678938    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.681109 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.681088    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.681191 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.681142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.687241 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.687220    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb2qf\" (UniqueName: \"kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:40.891514 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.891440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:40.988067 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:40.988038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:41.183415 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.183338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:41.183415 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.183383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:41.185809 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.185775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:41.185948 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.185818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-wcwhg\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:41.420983 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.420946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 09:59:41.557134 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:41.557105    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 09:59:41.557938 ip-10-0-135-66 kubenswrapper[2563]: W0609 09:59:41.557911    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a5e30f1_d57c_4b1f_8a58_49094b1a2d3e.slice/crio-892c8f57b569d402adcdc658151e7557841dee487efb82270defeed396169260 WatchSource:0}: Error finding container 892c8f57b569d402adcdc658151e7557841dee487efb82270defeed396169260: Status 404 returned error can't find the container with id 892c8f57b569d402adcdc658151e7557841dee487efb82270defeed396169260
Jun 09 09:59:42.144570 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:42.144535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"892c8f57b569d402adcdc658151e7557841dee487efb82270defeed396169260"}
Jun 09 09:59:52.245886 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:52.245847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:52.303707 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:52.303675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:52.808403 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:52.808361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 09:59:56.221404 ip-10-0-135-66 kubenswrapper[2563]: I0609 09:59:56.221369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"}
Jun 09 10:00:00.239901 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:00.239873    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5" exitCode=0
Jun 09 10:00:00.240329 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:00.239947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"}
Jun 09 10:00:01.246382 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:01.246350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"}
Jun 09 10:00:06.271180 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:06.271146    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295" exitCode=0
Jun 09 10:00:06.271645 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:06.271224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"}
Jun 09 10:00:07.283453 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:07.283413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"}
Jun 09 10:00:07.284055 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:07.283478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"}
Jun 09 10:00:07.284055 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:07.283502    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"}
Jun 09 10:00:07.284055 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:07.283520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerStarted","Data":"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"}
Jun 09 10:00:07.308212 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:07.308152    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podStartSLOduration=13.266894403 podStartE2EDuration="27.308129063s" totalImagesPullingTime="14.04123466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 09:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:00:07.307268696 +0000 UTC m=+1631.114773454" watchObservedRunningTime="2026-06-09 10:00:07.308129063 +0000 UTC m=+1631.115633795"
Jun 09 10:00:08.218841 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.218790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:00:08.421514 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.421471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:08.422013 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.421538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:08.422013 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.421562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:08.422013 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.421581    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:08.424108 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.424068    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Jun 09 10:00:08.424108 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.424086    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Jun 09 10:00:08.424108 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.424097    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 10:00:08.424354 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:08.424183    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 10:00:09.293542 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:09.293497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:00:11.421844 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.421789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:11.422361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.421873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:11.422361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.421895    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:11.422361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.421917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:11.422361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.422142    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jun 09 10:00:11.422588 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.422508    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Jun 09 10:00:11.422588 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.422136    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Jun 09 10:00:11.422952 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:11.422921    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 10:00:14.422090 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.422060    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.422533 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.422221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.422533 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.422477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.423058 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.423036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.423163 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.423103    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.423163 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.423154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:14.426732 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:14.426716    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:15.330416 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:15.330381    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:00:56.765841 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:56.765801    2563 scope.go:117] "RemoveContainer" containerID="628b8056c11be3fc8496a3c3ec9bdc987eba547f093ba5868167e93ec23d7899"
Jun 09 10:00:56.774148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:00:56.774125    2563 scope.go:117] "RemoveContainer" containerID="aa1e2b26b0c40dcce3329275b5c3423e43535638b54e831bc0da281e9eff9eee"
Jun 09 10:01:17.728812 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.728727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:17.729424 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.729403    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 10:01:17.729659 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.729626    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry" containerID="cri-o://9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf" gracePeriod=30
Jun 09 10:01:17.729785 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.729650    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" containerID="cri-o://8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41" gracePeriod=30
Jun 09 10:01:17.729879 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.729666    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline" containerID="cri-o://7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82" gracePeriod=30
Jun 09 10:01:17.729996 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.729686    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" containerID="cri-o://1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc" gracePeriod=30
Jun 09 10:01:17.827673 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.827642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:17.930692 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:17.930659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:18.018420 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.018335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:18.019098 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.019077    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:01:18.021786 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.021767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.024584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.024565    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-59f8b\""
Jun 09 10:01:18.036085 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.036059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:01:18.073288 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.073457 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.073457 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.073457 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.073457 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxnx\" (UniqueName: \"kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.073594 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.073521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.087289 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.087244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:18.174760 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.174953 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.174953 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.174953 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.174953 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxnx\" (UniqueName: \"kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.175153 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.174956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.175153 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:18.175056    2563 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 10:01:18.175153 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:18.175146    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls podName:875232d0-4788-4ad9-aab8-6407f49fe1a7 nodeName:}" failed. No retries permitted until 2026-06-09 10:01:18.675125387 +0000 UTC m=+1702.482630096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls") pod "feast-simple-feast-setup-75c64c888b-xfkp9" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7") : secret "feast-simple-feast-setup-offline-tls" not found
Jun 09 10:01:18.175315 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.175295    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.177503 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.177475    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.177632 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.177523    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.177632 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.177530    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.182983 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.182959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxnx\" (UniqueName: \"kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.218684 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.218654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:18.319881 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.319764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:01:18.605600 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.605521    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41" exitCode=0
Jun 09 10:01:18.605600 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.605546    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc" exitCode=0
Jun 09 10:01:18.605600 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.605591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"}
Jun 09 10:01:18.605777 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.605628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"}
Jun 09 10:01:18.680063 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.680034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.682271 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.682245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-xfkp9\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:18.932087 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:18.932000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:19.068315 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:19.068291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:01:19.070661 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:01:19.070637    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod875232d0_4788_4ad9_aab8_6407f49fe1a7.slice/crio-182dea122219cabe03127f1e70ba1f582915be7ddb9cb9774509a21376212f71 WatchSource:0}: Error finding container 182dea122219cabe03127f1e70ba1f582915be7ddb9cb9774509a21376212f71: Status 404 returned error can't find the container with id 182dea122219cabe03127f1e70ba1f582915be7ddb9cb9774509a21376212f71
Jun 09 10:01:19.611356 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:19.611316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"0ff6a167cabc2bb2867dbe70f586e1943c20ce71424bb8a4c06c1420824de1e2"}
Jun 09 10:01:19.611552 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:19.611369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"182dea122219cabe03127f1e70ba1f582915be7ddb9cb9774509a21376212f71"}
Jun 09 10:01:23.633161 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:23.633128    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="0ff6a167cabc2bb2867dbe70f586e1943c20ce71424bb8a4c06c1420824de1e2" exitCode=0
Jun 09 10:01:23.633544 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:23.633201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"0ff6a167cabc2bb2867dbe70f586e1943c20ce71424bb8a4c06c1420824de1e2"}
Jun 09 10:01:24.422851 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:24.422788    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Jun 09 10:01:24.644148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:24.644116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"a4c5aaa7fa2ba336579c2d192f202c7f2c4e79177293a1dce346f58d5ea3f679"}
Jun 09 10:01:25.328256 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:25.328213    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 10:01:29.665584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:29.665547    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="a4c5aaa7fa2ba336579c2d192f202c7f2c4e79177293a1dce346f58d5ea3f679" exitCode=0
Jun 09 10:01:29.665981 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:29.665591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"a4c5aaa7fa2ba336579c2d192f202c7f2c4e79177293a1dce346f58d5ea3f679"}
Jun 09 10:01:30.682230 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.682185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"8327bd910dee769a4c774f610583f2c2e699b135f54ff7a58e99bfd6b3b6f16d"}
Jun 09 10:01:30.682712 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.682251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"643ff04b6edd9d1a91a888fc9893c20fb429025a02651905ee3f9e5760e7cda2"}
Jun 09 10:01:30.682712 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.682269    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"aab336badfcfbae463103f6b56dbec044c773c8fc3e953d0286b226639179224"}
Jun 09 10:01:30.682712 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.682284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerStarted","Data":"38b3491e3b558cfa63694f848de69239bb7f9731e75cec7b2aa3542d81fd0b57"}
Jun 09 10:01:30.706905 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.706847    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podStartSLOduration=13.706801197 podStartE2EDuration="13.706801197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:01:30.706638163 +0000 UTC m=+1714.514142919" watchObservedRunningTime="2026-06-09 10:01:30.706801197 +0000 UTC m=+1714.514305929"
Jun 09 10:01:30.932495 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.932387    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:30.932495 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.932468    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:30.932495 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.932491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:30.932779 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.932510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:30.934804 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.934763    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Jun 09 10:01:30.935326 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.934800    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jun 09 10:01:30.935584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.934879    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 10:01:30.935584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:30.934899    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 10:01:33.933340 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:33.933295    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 10:01:33.933842 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:33.933299    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Jun 09 10:01:33.933842 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:33.933296    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jun 09 10:01:33.933842 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:33.933792    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 10:01:34.423530 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:34.423487    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Jun 09 10:01:35.328179 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:35.328142    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 10:01:36.933561 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.933533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934057 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.933717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934057 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.933911    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934057 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.933966    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934245 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.934098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934245 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.934134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934498 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.934478    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934570 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.934535    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.934613 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.934581    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:36.937985 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:36.937968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:37.721960 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:37.721931    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:37.724860 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:37.724842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:01:44.423371 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:44.423311    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Jun 09 10:01:44.423784 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:44.423512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:01:45.328060 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:45.328022    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jun 09 10:01:45.328320 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:45.328139    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:01:48.379613 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.379592    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:01:48.552905 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.552801    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.552905 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.552853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.552905 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.552887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb2qf\" (UniqueName: \"kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.552905 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.552904    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.553312 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.552961    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.553312 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.553078    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") pod \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\" (UID: \"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e\") "
Jun 09 10:01:48.553594 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.553558    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data" (OuterVolumeSpecName: "feast-data") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:01:48.555184 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.555157    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:01:48.555480 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.555450    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:01:48.555574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.555495    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls" (OuterVolumeSpecName: "online-tls") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:01:48.555574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.555531    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf" (OuterVolumeSpecName: "kube-api-access-wb2qf") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "kube-api-access-wb2qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:01:48.555574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.555540    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" (UID: "6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:01:48.654232 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654207    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.654232 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654230    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.654403 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654245    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb2qf\" (UniqueName: \"kubernetes.io/projected/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-kube-api-access-wb2qf\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.654403 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654258    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.654403 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654269    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.654403 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.654280    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:01:48.779937 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.779903    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82" exitCode=137
Jun 09 10:01:48.779937 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.779929    2563 generic.go:356] "Generic (PLEG): container finished" podID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerID="9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf" exitCode=137
Jun 09 10:01:48.780190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.779982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"}
Jun 09 10:01:48.780190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.780027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"}
Jun 09 10:01:48.780190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.780041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg" event={"ID":"6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e","Type":"ContainerDied","Data":"892c8f57b569d402adcdc658151e7557841dee487efb82270defeed396169260"}
Jun 09 10:01:48.780190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.780058    2563 scope.go:117] "RemoveContainer" containerID="8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"
Jun 09 10:01:48.780190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.779988    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"
Jun 09 10:01:48.789011 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.788991    2563 scope.go:117] "RemoveContainer" containerID="7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"
Jun 09 10:01:48.796735 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.796697    2563 scope.go:117] "RemoveContainer" containerID="1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"
Jun 09 10:01:48.799103 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.799083    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 10:01:48.801971 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.801949    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-wcwhg"]
Jun 09 10:01:48.805157 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.805138    2563 scope.go:117] "RemoveContainer" containerID="9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"
Jun 09 10:01:48.812543 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.812519    2563 scope.go:117] "RemoveContainer" containerID="945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"
Jun 09 10:01:48.821970 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.821945    2563 scope.go:117] "RemoveContainer" containerID="211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"
Jun 09 10:01:48.829252 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.829237    2563 scope.go:117] "RemoveContainer" containerID="8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"
Jun 09 10:01:48.829513 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.829495    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41\": container with ID starting with 8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41 not found: ID does not exist" containerID="8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"
Jun 09 10:01:48.829559 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.829521    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"} err="failed to get container status \"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41\": rpc error: code = NotFound desc = could not find container \"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41\": container with ID starting with 8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41 not found: ID does not exist"
Jun 09 10:01:48.829559 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.829540    2563 scope.go:117] "RemoveContainer" containerID="7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"
Jun 09 10:01:48.829782 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.829763    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82\": container with ID starting with 7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82 not found: ID does not exist" containerID="7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"
Jun 09 10:01:48.829868 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.829792    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"} err="failed to get container status \"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82\": rpc error: code = NotFound desc = could not find container \"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82\": container with ID starting with 7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82 not found: ID does not exist"
Jun 09 10:01:48.829868 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.829815    2563 scope.go:117] "RemoveContainer" containerID="1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"
Jun 09 10:01:48.830070 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.830051    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc\": container with ID starting with 1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc not found: ID does not exist" containerID="1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"
Jun 09 10:01:48.830120 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830076    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"} err="failed to get container status \"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc\": rpc error: code = NotFound desc = could not find container \"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc\": container with ID starting with 1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc not found: ID does not exist"
Jun 09 10:01:48.830120 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830092    2563 scope.go:117] "RemoveContainer" containerID="9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"
Jun 09 10:01:48.830297 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.830280    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf\": container with ID starting with 9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf not found: ID does not exist" containerID="9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"
Jun 09 10:01:48.830358 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830304    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"} err="failed to get container status \"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf\": rpc error: code = NotFound desc = could not find container \"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf\": container with ID starting with 9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf not found: ID does not exist"
Jun 09 10:01:48.830358 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830323    2563 scope.go:117] "RemoveContainer" containerID="945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"
Jun 09 10:01:48.830553 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.830537    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295\": container with ID starting with 945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295 not found: ID does not exist" containerID="945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"
Jun 09 10:01:48.830593 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830558    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"} err="failed to get container status \"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295\": rpc error: code = NotFound desc = could not find container \"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295\": container with ID starting with 945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295 not found: ID does not exist"
Jun 09 10:01:48.830593 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830571    2563 scope.go:117] "RemoveContainer" containerID="211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"
Jun 09 10:01:48.830777 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:01:48.830761    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5\": container with ID starting with 211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5 not found: ID does not exist" containerID="211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"
Jun 09 10:01:48.830869 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830784    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"} err="failed to get container status \"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5\": rpc error: code = NotFound desc = could not find container \"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5\": container with ID starting with 211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5 not found: ID does not exist"
Jun 09 10:01:48.830869 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.830803    2563 scope.go:117] "RemoveContainer" containerID="8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"
Jun 09 10:01:48.831062 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831043    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41"} err="failed to get container status \"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41\": rpc error: code = NotFound desc = could not find container \"8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41\": container with ID starting with 8f5a9d0f8e2a5c9323930a1dd4647d83cac37ade71f56f06f799a01d09738e41 not found: ID does not exist"
Jun 09 10:01:48.831145 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831064    2563 scope.go:117] "RemoveContainer" containerID="7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"
Jun 09 10:01:48.831289 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831272    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82"} err="failed to get container status \"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82\": rpc error: code = NotFound desc = could not find container \"7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82\": container with ID starting with 7c4776646a064910e026a30478fda10cb334925b1a92e3d47f3cf0623b51ea82 not found: ID does not exist"
Jun 09 10:01:48.831337 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831290    2563 scope.go:117] "RemoveContainer" containerID="1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"
Jun 09 10:01:48.831491 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831471    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc"} err="failed to get container status \"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc\": rpc error: code = NotFound desc = could not find container \"1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc\": container with ID starting with 1c68ff786df6433d8ef0eed2a1f3e0729cd821b05c5e1e1a40954989fc002fbc not found: ID does not exist"
Jun 09 10:01:48.831491 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831490    2563 scope.go:117] "RemoveContainer" containerID="9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"
Jun 09 10:01:48.831695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831680    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf"} err="failed to get container status \"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf\": rpc error: code = NotFound desc = could not find container \"9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf\": container with ID starting with 9f796b40a7f1aa7993de5ea16bcd7e4374c7c8118b8c38c560267949b0aedcaf not found: ID does not exist"
Jun 09 10:01:48.831744 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831695    2563 scope.go:117] "RemoveContainer" containerID="945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"
Jun 09 10:01:48.831907 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831891    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295"} err="failed to get container status \"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295\": rpc error: code = NotFound desc = could not find container \"945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295\": container with ID starting with 945039dc4ac2d768f2ac516c1b0c023d9b73c814937f515c15f7b2dbf49cf295 not found: ID does not exist"
Jun 09 10:01:48.831952 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.831908    2563 scope.go:117] "RemoveContainer" containerID="211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"
Jun 09 10:01:48.832083 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:48.832068    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5"} err="failed to get container status \"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5\": rpc error: code = NotFound desc = could not find container \"211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5\": container with ID starting with 211a7aaad296aadf488c50b11b5429d7e2867fdc357c3fa4b3567764205fc3a5 not found: ID does not exist"
Jun 09 10:01:50.644465 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:50.644434    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" path="/var/lib/kubelet/pods/6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e/volumes"
Jun 09 10:01:51.585711 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:01:51.585676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.365131 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.365098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.465690 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.465665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.619747 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.619651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.701529 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.701497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.705558 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705537    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:02:39.705881 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705869    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry"
Jun 09 10:02:39.705881 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705882    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705898    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705905    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705923    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="feast-apply"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="feast-apply"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705933    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705938    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705942    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705948    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705954    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="feast-init"
Jun 09 10:02:39.705961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.705959    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="feast-init"
Jun 09 10:02:39.706253 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.706016    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="registry"
Jun 09 10:02:39.706253 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.706028    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="ui"
Jun 09 10:02:39.706253 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.706033    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="online"
Jun 09 10:02:39.706253 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.706039    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5e30f1-d57c-4b1f-8a58-49094b1a2d3e" containerName="offline"
Jun 09 10:02:39.709589 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.709570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.712077 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712047    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 09 10:02:39.712189 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712082    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-fgnw4\""
Jun 09 10:02:39.712189 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712128    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 09 10:02:39.712307 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712228    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 09 10:02:39.712307 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 09 10:02:39.712484 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.712467    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 09 10:02:39.713077 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.713063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 09 10:02:39.720221 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.720199    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:02:39.760818 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.760791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.817678 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.817659    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:39.883700 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.883700 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.883885 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.883885 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62czh\" (UniqueName: \"kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.883885 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.883885 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.883805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985328 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985534 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985534 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985534 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62czh\" (UniqueName: \"kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985714 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985714 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.985714 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:02:39.985663    2563 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 09 10:02:39.985916 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:02:39.985753    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls podName:01fe0ce0-f027-4cb7-aba3-971c55b48ea0 nodeName:}" failed. No retries permitted until 2026-06-09 10:02:40.485730778 +0000 UTC m=+1784.293235487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-s8sbn" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jun 09 10:02:39.985916 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.985793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.986149 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.986126    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.987929 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.987909    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.988016 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.987949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:39.996328 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:39.996303    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62czh\" (UniqueName: \"kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:40.056538 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:40.056509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:02:40.490948 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:40.490913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:40.493238 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:40.493214    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-s8sbn\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:40.620263 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:40.620230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:40.756268 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:40.756243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:02:40.757572 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:02:40.757546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01fe0ce0_f027_4cb7_aba3_971c55b48ea0.slice/crio-2865aa8b0e90fe7dff2bdf7cc979184f94de2ce22991e6ec5b6600bfdb464754 WatchSource:0}: Error finding container 2865aa8b0e90fe7dff2bdf7cc979184f94de2ce22991e6ec5b6600bfdb464754: Status 404 returned error can't find the container with id 2865aa8b0e90fe7dff2bdf7cc979184f94de2ce22991e6ec5b6600bfdb464754
Jun 09 10:02:41.007904 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:41.007149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"}
Jun 09 10:02:41.007904 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:41.007201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"2865aa8b0e90fe7dff2bdf7cc979184f94de2ce22991e6ec5b6600bfdb464754"}
Jun 09 10:02:46.030869 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:46.030808    2563 generic.go:356] "Generic (PLEG): container finished" podID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerID="ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5" exitCode=0
Jun 09 10:02:46.031242 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:46.030885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"}
Jun 09 10:02:47.037888 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:47.037854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"}
Jun 09 10:02:52.063613 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:52.063574    2563 generic.go:356] "Generic (PLEG): container finished" podID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerID="3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195" exitCode=0
Jun 09 10:02:52.064049 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:52.063637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"}
Jun 09 10:02:53.072615 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:53.072577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"}
Jun 09 10:02:53.073111 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:53.072633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"}
Jun 09 10:02:53.073111 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:53.072651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerStarted","Data":"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"}
Jun 09 10:02:53.099126 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:53.099071    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podStartSLOduration=14.099050613 podStartE2EDuration="14.099050613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:02:53.096937556 +0000 UTC m=+1796.904442287" watchObservedRunningTime="2026-06-09 10:02:53.099050613 +0000 UTC m=+1796.906555344"
Jun 09 10:02:55.620922 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.620880    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:55.621413 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.620946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:55.621413 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.620965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:55.622507 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.622470    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
Jun 09 10:02:55.622641 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.622498    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 10:02:55.622641 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:55.622551    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 10:02:56.743324 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:56.743290    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 10:02:56.746032 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:56.746009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 10:02:56.752475 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:56.752458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 10:02:56.754476 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:56.754455    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 10:02:58.621553 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.621522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.622081 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.621648    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.622161 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.622147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.622211 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.622184    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.622293 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.622265    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.622609 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.622595    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:58.625818 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:58.625801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:59.103779 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:59.103750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:02:59.106798 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:02:59.106776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:03:52.103718 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:03:52.103671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:01.118557 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.118523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:01.141752 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.141720    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:04:01.141978 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.141954    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online" containerID="cri-o://63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb" gracePeriod=30
Jun 09 10:04:01.142067 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.142004    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui" containerID="cri-o://a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e" gracePeriod=30
Jun 09 10:04:01.142067 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.142009    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="offline" containerID="cri-o://853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1" gracePeriod=30
Jun 09 10:04:01.218909 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.218581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:01.258036 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.258001    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:04:01.258342 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.258307    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry" containerID="cri-o://38b3491e3b558cfa63694f848de69239bb7f9731e75cec7b2aa3542d81fd0b57" gracePeriod=30
Jun 09 10:04:01.258596 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.258317    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" containerID="cri-o://8327bd910dee769a4c774f610583f2c2e699b135f54ff7a58e99bfd6b3b6f16d" gracePeriod=30
Jun 09 10:04:01.258715 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.258353    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline" containerID="cri-o://643ff04b6edd9d1a91a888fc9893c20fb429025a02651905ee3f9e5760e7cda2" gracePeriod=30
Jun 09 10:04:01.258784 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.258370    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" containerID="cri-o://aab336badfcfbae463103f6b56dbec044c773c8fc3e953d0286b226639179224" gracePeriod=30
Jun 09 10:04:01.290577 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.290544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:01.347814 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:01.347781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:02.382560 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.382528    2563 generic.go:356] "Generic (PLEG): container finished" podID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerID="a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e" exitCode=0
Jun 09 10:04:02.382560 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.382554    2563 generic.go:356] "Generic (PLEG): container finished" podID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerID="63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb" exitCode=0
Jun 09 10:04:02.383030 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.382600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"}
Jun 09 10:04:02.383030 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.382640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"}
Jun 09 10:04:02.385348 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.385326    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="8327bd910dee769a4c774f610583f2c2e699b135f54ff7a58e99bfd6b3b6f16d" exitCode=0
Jun 09 10:04:02.385348 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.385344    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="aab336badfcfbae463103f6b56dbec044c773c8fc3e953d0286b226639179224" exitCode=0
Jun 09 10:04:02.385495 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.385371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"8327bd910dee769a4c774f610583f2c2e699b135f54ff7a58e99bfd6b3b6f16d"}
Jun 09 10:04:02.385495 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:02.385399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"aab336badfcfbae463103f6b56dbec044c773c8fc3e953d0286b226639179224"}
Jun 09 10:04:06.427432 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:06.427350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:06.935136 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:06.935087    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 10:04:07.722717 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:07.722675    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 10:04:08.622653 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:08.622611    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 10:04:09.104972 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:09.104934    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 10:04:16.934456 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:16.934412    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 10:04:17.722461 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:17.722413    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 10:04:18.623183 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:18.623136    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 10:04:19.104172 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:19.104127    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 10:04:26.934390 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:26.934339    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Jun 09 10:04:26.934965 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:26.934517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:04:27.722279 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:27.722238    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jun 09 10:04:27.722427 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:27.722338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:04:28.622372 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:28.622325    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jun 09 10:04:28.622888 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:28.622457    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:04:29.104883 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:29.104814    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jun 09 10:04:29.105068 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:29.104971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:04:31.349972 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.349949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:04:31.460134 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460071    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460134 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460134 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460400 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460166    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62czh\" (UniqueName: \"kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460400 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460186    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460400 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls\") pod \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\" (UID: \"01fe0ce0-f027-4cb7-aba3-971c55b48ea0\") "
Jun 09 10:04:31.460698 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460664    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data" (OuterVolumeSpecName: "feast-data") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:04:31.460698 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.460678    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 10:04:31.462996 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.462972    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.463076 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.462992    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.463076 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.463017    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls" (OuterVolumeSpecName: "online-tls") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.463076 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.463026    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh" (OuterVolumeSpecName: "kube-api-access-62czh") pod "01fe0ce0-f027-4cb7-aba3-971c55b48ea0" (UID: "01fe0ce0-f027-4cb7-aba3-971c55b48ea0"). InnerVolumeSpecName "kube-api-access-62czh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:04:31.513271 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.513241    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="643ff04b6edd9d1a91a888fc9893c20fb429025a02651905ee3f9e5760e7cda2" exitCode=137
Jun 09 10:04:31.513271 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.513266    2563 generic.go:356] "Generic (PLEG): container finished" podID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerID="38b3491e3b558cfa63694f848de69239bb7f9731e75cec7b2aa3542d81fd0b57" exitCode=137
Jun 09 10:04:31.513416 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.513310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"643ff04b6edd9d1a91a888fc9893c20fb429025a02651905ee3f9e5760e7cda2"}
Jun 09 10:04:31.513416 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.513361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"38b3491e3b558cfa63694f848de69239bb7f9731e75cec7b2aa3542d81fd0b57"}
Jun 09 10:04:31.515624 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.515603    2563 generic.go:356] "Generic (PLEG): container finished" podID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerID="853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1" exitCode=137
Jun 09 10:04:31.515670 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.515663    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"
Jun 09 10:04:31.515706 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.515684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"}
Jun 09 10:04:31.515740 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.515723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn" event={"ID":"01fe0ce0-f027-4cb7-aba3-971c55b48ea0","Type":"ContainerDied","Data":"2865aa8b0e90fe7dff2bdf7cc979184f94de2ce22991e6ec5b6600bfdb464754"}
Jun 09 10:04:31.515773 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.515742    2563 scope.go:117] "RemoveContainer" containerID="a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"
Jun 09 10:04:31.525108 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.525093    2563 scope.go:117] "RemoveContainer" containerID="853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"
Jun 09 10:04:31.532517 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.532498    2563 scope.go:117] "RemoveContainer" containerID="63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"
Jun 09 10:04:31.542304 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.542281    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:04:31.543360 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.543343    2563 scope.go:117] "RemoveContainer" containerID="3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"
Jun 09 10:04:31.546039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.546020    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-s8sbn"]
Jun 09 10:04:31.550945 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.550930    2563 scope.go:117] "RemoveContainer" containerID="ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"
Jun 09 10:04:31.558289 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.558275    2563 scope.go:117] "RemoveContainer" containerID="a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"
Jun 09 10:04:31.558528 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:31.558511    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e\": container with ID starting with a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e not found: ID does not exist" containerID="a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"
Jun 09 10:04:31.558582 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.558535    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e"} err="failed to get container status \"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e\": rpc error: code = NotFound desc = could not find container \"a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e\": container with ID starting with a4b87b65ef0531f79e90ac21e810cc430d012249013403643ce652a36341b44e not found: ID does not exist"
Jun 09 10:04:31.558582 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.558552    2563 scope.go:117] "RemoveContainer" containerID="853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"
Jun 09 10:04:31.558772 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:31.558756    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1\": container with ID starting with 853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1 not found: ID does not exist" containerID="853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"
Jun 09 10:04:31.558845 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.558776    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1"} err="failed to get container status \"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1\": rpc error: code = NotFound desc = could not find container \"853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1\": container with ID starting with 853bd929c62db5861d768cff13c0a04018fcd2a1cbddf36da2a2567b9c4ac5a1 not found: ID does not exist"
Jun 09 10:04:31.558845 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.558788    2563 scope.go:117] "RemoveContainer" containerID="63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"
Jun 09 10:04:31.559003 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:31.558987    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb\": container with ID starting with 63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb not found: ID does not exist" containerID="63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"
Jun 09 10:04:31.559043 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.559005    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb"} err="failed to get container status \"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb\": rpc error: code = NotFound desc = could not find container \"63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb\": container with ID starting with 63cf7953ee0dff33eee17d2ba0b8cced338edc59ad1b13fdc495685d3991efeb not found: ID does not exist"
Jun 09 10:04:31.559043 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.559016    2563 scope.go:117] "RemoveContainer" containerID="3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"
Jun 09 10:04:31.559241 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:31.559224    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195\": container with ID starting with 3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195 not found: ID does not exist" containerID="3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"
Jun 09 10:04:31.559285 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.559246    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195"} err="failed to get container status \"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195\": rpc error: code = NotFound desc = could not find container \"3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195\": container with ID starting with 3d5ce552989e3c4055fd36219111424cf84b89edf89143efeaa3e25b75188195 not found: ID does not exist"
Jun 09 10:04:31.559285 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.559261    2563 scope.go:117] "RemoveContainer" containerID="ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"
Jun 09 10:04:31.559463 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:31.559446    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5\": container with ID starting with ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5 not found: ID does not exist" containerID="ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"
Jun 09 10:04:31.559523 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.559470    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5"} err="failed to get container status \"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5\": rpc error: code = NotFound desc = could not find container \"ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5\": container with ID starting with ee660e3caa8c2d1e24391b0002669234d500e0d75b59b46e36716d465fe1e9c5 not found: ID does not exist"
Jun 09 10:04:31.560808 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560793    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.560880 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560811    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.560880 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560820    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.560880 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560843    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62czh\" (UniqueName: \"kubernetes.io/projected/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-kube-api-access-62czh\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.560880 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560851    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.560880 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.560860    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/01fe0ce0-f027-4cb7-aba3-971c55b48ea0-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:31.910944 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.910916    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:04:31.963959 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.963924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.963959 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.963963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.964218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.964001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.964218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.964073    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkxnx\" (UniqueName: \"kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.964218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.964110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.964218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.964163    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data\") pod \"875232d0-4788-4ad9-aab8-6407f49fe1a7\" (UID: \"875232d0-4788-4ad9-aab8-6407f49fe1a7\") "
Jun 09 10:04:31.964793 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.964746    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data" (OuterVolumeSpecName: "feast-data") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:04:31.966183 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.966160    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.966296 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.966185    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.966296 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.966200    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls" (OuterVolumeSpecName: "online-tls") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.966556 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.966538    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:04:31.966599 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:31.966555    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx" (OuterVolumeSpecName: "kube-api-access-gkxnx") pod "875232d0-4788-4ad9-aab8-6407f49fe1a7" (UID: "875232d0-4788-4ad9-aab8-6407f49fe1a7"). InnerVolumeSpecName "kube-api-access-gkxnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065492    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065523    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065532    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkxnx\" (UniqueName: \"kubernetes.io/projected/875232d0-4788-4ad9-aab8-6407f49fe1a7-kube-api-access-gkxnx\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065543    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065551    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/875232d0-4788-4ad9-aab8-6407f49fe1a7-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.065584 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.065559    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/875232d0-4788-4ad9-aab8-6407f49fe1a7-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:32.523105 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.523068    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"
Jun 09 10:04:32.523690 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.523067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9" event={"ID":"875232d0-4788-4ad9-aab8-6407f49fe1a7","Type":"ContainerDied","Data":"182dea122219cabe03127f1e70ba1f582915be7ddb9cb9774509a21376212f71"}
Jun 09 10:04:32.523690 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.523199    2563 scope.go:117] "RemoveContainer" containerID="8327bd910dee769a4c774f610583f2c2e699b135f54ff7a58e99bfd6b3b6f16d"
Jun 09 10:04:32.532159 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.532136    2563 scope.go:117] "RemoveContainer" containerID="643ff04b6edd9d1a91a888fc9893c20fb429025a02651905ee3f9e5760e7cda2"
Jun 09 10:04:32.539662 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.539643    2563 scope.go:117] "RemoveContainer" containerID="aab336badfcfbae463103f6b56dbec044c773c8fc3e953d0286b226639179224"
Jun 09 10:04:32.544652 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.544628    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:04:32.547950 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.547924    2563 scope.go:117] "RemoveContainer" containerID="38b3491e3b558cfa63694f848de69239bb7f9731e75cec7b2aa3542d81fd0b57"
Jun 09 10:04:32.548749 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.548728    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-xfkp9"]
Jun 09 10:04:32.555505 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.555490    2563 scope.go:117] "RemoveContainer" containerID="a4c5aaa7fa2ba336579c2d192f202c7f2c4e79177293a1dce346f58d5ea3f679"
Jun 09 10:04:32.565586 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.565569    2563 scope.go:117] "RemoveContainer" containerID="0ff6a167cabc2bb2867dbe70f586e1943c20ce71424bb8a4c06c1420824de1e2"
Jun 09 10:04:32.644888 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.644854    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" path="/var/lib/kubelet/pods/01fe0ce0-f027-4cb7-aba3-971c55b48ea0/volumes"
Jun 09 10:04:32.645410 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:32.645396    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" path="/var/lib/kubelet/pods/875232d0-4788-4ad9-aab8-6407f49fe1a7/volumes"
Jun 09 10:04:44.209309 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:44.209273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:45.239280 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:45.239229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:50.083692 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.083643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:50.184746 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.184698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:04:50.226419 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.226388    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 10:04:50.226602 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.226580    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" podUID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" containerName="manager" containerID="cri-o://127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d" gracePeriod=10
Jun 09 10:04:50.472870 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.472808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 10:04:50.604225 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.604119    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" containerID="127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d" exitCode=0
Jun 09 10:04:50.604225 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.604162    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"
Jun 09 10:04:50.604225 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.604190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" event={"ID":"e5489796-d68f-4dbf-8596-0c3b3807c3c6","Type":"ContainerDied","Data":"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"}
Jun 09 10:04:50.604515 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.604243    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p" event={"ID":"e5489796-d68f-4dbf-8596-0c3b3807c3c6","Type":"ContainerDied","Data":"e99cf70d36b75c10840280fd158b45923e7be471acd6c2faaf0a4ad6f5437384"}
Jun 09 10:04:50.604515 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.604272    2563 scope.go:117] "RemoveContainer" containerID="127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"
Jun 09 10:04:50.612337 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.612318    2563 scope.go:117] "RemoveContainer" containerID="127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"
Jun 09 10:04:50.612575 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:04:50.612558    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d\": container with ID starting with 127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d not found: ID does not exist" containerID="127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"
Jun 09 10:04:50.612620 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.612584    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d"} err="failed to get container status \"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d\": rpc error: code = NotFound desc = could not find container \"127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d\": container with ID starting with 127413f5f627e2704677160c9189997c9bc3a3e980a684d138900388262b4b5d not found: ID does not exist"
Jun 09 10:04:50.626988 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.626968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5nv4\" (UniqueName: \"kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4\") pod \"e5489796-d68f-4dbf-8596-0c3b3807c3c6\" (UID: \"e5489796-d68f-4dbf-8596-0c3b3807c3c6\") "
Jun 09 10:04:50.629086 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.629065    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4" (OuterVolumeSpecName: "kube-api-access-g5nv4") pod "e5489796-d68f-4dbf-8596-0c3b3807c3c6" (UID: "e5489796-d68f-4dbf-8596-0c3b3807c3c6"). InnerVolumeSpecName "kube-api-access-g5nv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:04:50.728078 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.728048    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5nv4\" (UniqueName: \"kubernetes.io/projected/e5489796-d68f-4dbf-8596-0c3b3807c3c6-kube-api-access-g5nv4\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:04:50.919917 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.919839    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 10:04:50.923707 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:50.923676    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-fb77p"]
Jun 09 10:04:52.643906 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:52.643875    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" path="/var/lib/kubelet/pods/e5489796-d68f-4dbf-8596-0c3b3807c3c6/volumes"
Jun 09 10:04:55.042454 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042413    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"]
Jun 09 10:04:55.042970 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042914    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="feast-apply"
Jun 09 10:04:55.042970 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042933    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="feast-apply"
Jun 09 10:04:55.042970 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042946    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline"
Jun 09 10:04:55.042970 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042954    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042980    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.042988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043004    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="feast-init"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043012    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="feast-init"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043023    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043031    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043039    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="feast-init"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043048    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="feast-init"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" containerName="manager"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043093    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" containerName="manager"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043116    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043130    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043138    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043155    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="feast-apply"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043163    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="feast-apply"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043175    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="offline"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043183    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="offline"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043193    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui"
Jun 09 10:04:55.043200 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043201    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043282    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="registry"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043294    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="ui"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043302    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="ui"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043316    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5489796-d68f-4dbf-8596-0c3b3807c3c6" containerName="manager"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043325    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="offline"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043333    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="online"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="01fe0ce0-f027-4cb7-aba3-971c55b48ea0" containerName="offline"
Jun 09 10:04:55.044196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.043350    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="875232d0-4788-4ad9-aab8-6407f49fe1a7" containerName="online"
Jun 09 10:04:55.048190 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.048170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.050986 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.050966    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jun 09 10:04:55.052025 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.052005    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rnx64\""
Jun 09 10:04:55.052137 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.052008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jun 09 10:04:55.056983 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.056959    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"]
Jun 09 10:04:55.162611 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.162572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5fd\" (UniqueName: \"kubernetes.io/projected/1fbee0c5-327a-4ae3-9b38-317983e678e9-kube-api-access-4k5fd\") pod \"feast-operator-controller-manager-6d54c7db9d-4bx4f\" (UID: \"1fbee0c5-327a-4ae3-9b38-317983e678e9\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.263749 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.263709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5fd\" (UniqueName: \"kubernetes.io/projected/1fbee0c5-327a-4ae3-9b38-317983e678e9-kube-api-access-4k5fd\") pod \"feast-operator-controller-manager-6d54c7db9d-4bx4f\" (UID: \"1fbee0c5-327a-4ae3-9b38-317983e678e9\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.273148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.273125    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5fd\" (UniqueName: \"kubernetes.io/projected/1fbee0c5-327a-4ae3-9b38-317983e678e9-kube-api-access-4k5fd\") pod \"feast-operator-controller-manager-6d54c7db9d-4bx4f\" (UID: \"1fbee0c5-327a-4ae3-9b38-317983e678e9\") " pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.358959 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.358867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.488957 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.488926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"]
Jun 09 10:04:55.491980 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:04:55.491954    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbee0c5_327a_4ae3_9b38_317983e678e9.slice/crio-7dd34e860a8f3d9b485c4de385c8d1315233cbc4b86f893cb8174ad9a7456096 WatchSource:0}: Error finding container 7dd34e860a8f3d9b485c4de385c8d1315233cbc4b86f893cb8174ad9a7456096: Status 404 returned error can't find the container with id 7dd34e860a8f3d9b485c4de385c8d1315233cbc4b86f893cb8174ad9a7456096
Jun 09 10:04:55.629284 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.629188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f" event={"ID":"1fbee0c5-327a-4ae3-9b38-317983e678e9","Type":"ContainerStarted","Data":"a8f4100e2100cc3fcf81c28aec563c2a3242a224332812a0a531bea4af7048ad"}
Jun 09 10:04:55.629284 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.629249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f" event={"ID":"1fbee0c5-327a-4ae3-9b38-317983e678e9","Type":"ContainerStarted","Data":"7dd34e860a8f3d9b485c4de385c8d1315233cbc4b86f893cb8174ad9a7456096"}
Jun 09 10:04:55.629512 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.629344    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:04:55.649047 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:04:55.648996    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f" podStartSLOduration=0.648981118 podStartE2EDuration="648.981118ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:04:55.646903582 +0000 UTC m=+1919.454408313" watchObservedRunningTime="2026-06-09 10:04:55.648981118 +0000 UTC m=+1919.456485849"
Jun 09 10:05:06.636177 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:06.636144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d54c7db9d-4bx4f"
Jun 09 10:05:09.361125 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:09.361084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:09.463293 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:09.463251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.322212 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.322182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.435662 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.435631    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.444406 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.444377    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:05:11.449743 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.449724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.452594 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jun 09 10:05:11.452594 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452583    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jun 09 10:05:11.452777 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jun 09 10:05:11.452863 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jun 09 10:05:11.452986 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452968    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jun 09 10:05:11.452986 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.452979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-b896v\""
Jun 09 10:05:11.453153 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.453140    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jun 09 10:05:11.461161 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.461140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:05:11.497541 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.497505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.501923 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.501900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.502035 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.501933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.502035 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.501981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46scg\" (UniqueName: \"kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.502035 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.502014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.502161 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.502098    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.502161 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.502119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.555562 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.555531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.602874 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.602874 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46scg\" (UniqueName: \"kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:05:11.602938    2563 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.602954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.603022 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:05:11.603005    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls podName:c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d nodeName:}" failed. No retries permitted until 2026-06-09 10:05:12.102987097 +0000 UTC m=+1935.910491807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls") pod "feast-simple-feast-setup-75c64c888b-49jvd" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d") : secret "feast-simple-feast-setup-online-tls" not found
Jun 09 10:05:11.603326 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.603305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.605361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.605340    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.605563 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.605544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.605626 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.605548    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.614210 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.614190    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46scg\" (UniqueName: \"kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:11.657330 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.657300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:11.757680 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:11.757654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:05:12.106764 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.106731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:12.109159 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.109127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-49jvd\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:12.359633 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.359549    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:12.500032 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.500004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:05:12.501483 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:05:12.501456    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4f1d92d_e37e_40b0_8b77_3aeba2c9cb9d.slice/crio-7d9be9a81f39e7a42e6cd77015f0b6e44058277ad52bfbf996621e5a90aa2c24 WatchSource:0}: Error finding container 7d9be9a81f39e7a42e6cd77015f0b6e44058277ad52bfbf996621e5a90aa2c24: Status 404 returned error can't find the container with id 7d9be9a81f39e7a42e6cd77015f0b6e44058277ad52bfbf996621e5a90aa2c24
Jun 09 10:05:12.696698 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.696607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"ff0f85ec774eb4bbd8e58c74f2a226a43d80c1d783542e2853695e4576425d73"}
Jun 09 10:05:12.696698 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:12.696658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"7d9be9a81f39e7a42e6cd77015f0b6e44058277ad52bfbf996621e5a90aa2c24"}
Jun 09 10:05:17.718443 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:17.718408    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="ff0f85ec774eb4bbd8e58c74f2a226a43d80c1d783542e2853695e4576425d73" exitCode=0
Jun 09 10:05:17.718443 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:17.718447    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"ff0f85ec774eb4bbd8e58c74f2a226a43d80c1d783542e2853695e4576425d73"}
Jun 09 10:05:18.723939 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:18.723897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"11f7005cb78b1a0fe05d5dac6e5a7ede53b54b583a4e1f30569c092e800e6d93"}
Jun 09 10:05:23.748739 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:23.748703    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="11f7005cb78b1a0fe05d5dac6e5a7ede53b54b583a4e1f30569c092e800e6d93" exitCode=0
Jun 09 10:05:23.749140 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:23.748747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"11f7005cb78b1a0fe05d5dac6e5a7ede53b54b583a4e1f30569c092e800e6d93"}
Jun 09 10:05:24.759461 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:24.759423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"5a6a987ea3e48ccc183f31383a60772f7f3a161c97d52eb193af4f421c9d7475"}
Jun 09 10:05:24.759975 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:24.759481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"16d33165db3dcc5fd7b8f624288a4d39dca375c2cdf1ad7a4bfa96ac4ef35e4a"}
Jun 09 10:05:24.759975 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:24.759514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"23206dc64057e848d7cc434ee25cece1668042b6f23ecf8ee5f953a6313271fa"}
Jun 09 10:05:24.759975 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:24.759533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerStarted","Data":"b8a6ee31f3a83523994dd7933c8358efb42f1b82a98c59fd740a29a6de21e124"}
Jun 09 10:05:24.785665 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:24.785607    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podStartSLOduration=13.785587489 podStartE2EDuration="13.785587489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:05:24.784366576 +0000 UTC m=+1948.591871308" watchObservedRunningTime="2026-06-09 10:05:24.785587489 +0000 UTC m=+1948.593092222"
Jun 09 10:05:27.359898 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.359836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:27.360487 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.360463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:27.360636 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.360496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:27.360636 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.360514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:27.362265 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.362225    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 10:05:27.362366 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.362253    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Jun 09 10:05:27.362366 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.362351    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 10:05:27.362494 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:27.362429    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jun 09 10:05:30.361629 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.361597    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362061 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.361737    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362147 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362225 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362198    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362382 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362382 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362556    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362637 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.362690 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.362642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.366115 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.366098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.793045 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.793013    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:05:30.795933 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:05:30.795908    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:06:32.797389 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.797339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:32.802435 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.802399    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:06:32.802651 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.802629    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="registry" containerID="cri-o://b8a6ee31f3a83523994dd7933c8358efb42f1b82a98c59fd740a29a6de21e124" gracePeriod=30
Jun 09 10:06:32.802782 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.802752    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="offline" containerID="cri-o://16d33165db3dcc5fd7b8f624288a4d39dca375c2cdf1ad7a4bfa96ac4ef35e4a" gracePeriod=30
Jun 09 10:06:32.803001 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.802760    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui" containerID="cri-o://5a6a987ea3e48ccc183f31383a60772f7f3a161c97d52eb193af4f421c9d7475" gracePeriod=30
Jun 09 10:06:32.803594 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.803269    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online" containerID="cri-o://23206dc64057e848d7cc434ee25cece1668042b6f23ecf8ee5f953a6313271fa" gracePeriod=30
Jun 09 10:06:32.898561 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.898528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:32.997465 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:32.997419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.077581 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.077497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.082149 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.082121    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:06:33.088984 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.087766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.091509 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.091483    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nmzcd\""
Jun 09 10:06:33.098989 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.098967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2vcr\" (UniqueName: \"kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.230531 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.230528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.266992 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.266942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.331859 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.331859 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2vcr\" (UniqueName: \"kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.332039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.332039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.332039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.332039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.331959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.332239 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:06:33.332057    2563 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 10:06:33.332239 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:06:33.332132    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls podName:60db8980-adf5-4de6-9d57-cfdceb29fffe nodeName:}" failed. No retries permitted until 2026-06-09 10:06:33.832108511 +0000 UTC m=+2017.639613227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls") pod "feast-simple-feast-setup-75c64c888b-nz4bj" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe") : secret "feast-simple-feast-setup-registry-tls" not found
Jun 09 10:06:33.332370 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.332345    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.334389 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.334364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.334492 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.334371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.334773 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.334752    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.340982 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.340957    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2vcr\" (UniqueName: \"kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.367268 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.367234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.467676 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.467643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.522939 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.522911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:06:33.837477 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.837435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:33.839925 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:33.839900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") pod \"feast-simple-feast-setup-75c64c888b-nz4bj\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") " pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:34.001742 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.001701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:34.071725 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.071694    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="5a6a987ea3e48ccc183f31383a60772f7f3a161c97d52eb193af4f421c9d7475" exitCode=0
Jun 09 10:06:34.071725 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.071720    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="23206dc64057e848d7cc434ee25cece1668042b6f23ecf8ee5f953a6313271fa" exitCode=0
Jun 09 10:06:34.071921 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.071762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"5a6a987ea3e48ccc183f31383a60772f7f3a161c97d52eb193af4f421c9d7475"}
Jun 09 10:06:34.071921 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.071794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"23206dc64057e848d7cc434ee25cece1668042b6f23ecf8ee5f953a6313271fa"}
Jun 09 10:06:34.144889 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:34.144864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:06:34.146171 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:06:34.146140    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60db8980_adf5_4de6_9d57_cfdceb29fffe.slice/crio-bcddf82b3bc0256b1cff5971cbd9b180502eb23a9327b40135662ea92bf24012 WatchSource:0}: Error finding container bcddf82b3bc0256b1cff5971cbd9b180502eb23a9327b40135662ea92bf24012: Status 404 returned error can't find the container with id bcddf82b3bc0256b1cff5971cbd9b180502eb23a9327b40135662ea92bf24012
Jun 09 10:06:35.078528 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:35.078495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"d61687ff65e5fcc693eb6f1ba94b885a09f1d082d9d8f98f064b09274ced5d88"}
Jun 09 10:06:35.078945 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:35.078542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"bcddf82b3bc0256b1cff5971cbd9b180502eb23a9327b40135662ea92bf24012"}
Jun 09 10:06:39.098020 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:39.097991    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="d61687ff65e5fcc693eb6f1ba94b885a09f1d082d9d8f98f064b09274ced5d88" exitCode=0
Jun 09 10:06:39.098388 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:39.098066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"d61687ff65e5fcc693eb6f1ba94b885a09f1d082d9d8f98f064b09274ced5d88"}
Jun 09 10:06:40.104255 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:40.104222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"8048a2bd16db46cef44b60d324f2f4973cd77e02031d2d527b6ff9d1b370286a"}
Jun 09 10:06:40.362774 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:40.362679    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 10:06:40.794129 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:40.794088    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 10:06:45.128922 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:45.128885    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="8048a2bd16db46cef44b60d324f2f4973cd77e02031d2d527b6ff9d1b370286a" exitCode=0
Jun 09 10:06:45.129289 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:45.128953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"8048a2bd16db46cef44b60d324f2f4973cd77e02031d2d527b6ff9d1b370286a"}
Jun 09 10:06:46.140665 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:46.140621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"08c25ba022f7da84bf2fe376e8c0519ca029fbad473c7c4f5cf3468da16737a6"}
Jun 09 10:06:46.141177 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:46.140686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"888c5cf3cabbdc496df6a3b14356593c2fb182f035e939e7bd86bda9123ed807"}
Jun 09 10:06:46.141177 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:46.140708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"c8df276ec4458a330ced513c82464e1578dd5bc9c212fa1bba4b8a6556cfb4b4"}
Jun 09 10:06:46.141177 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:46.140726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerStarted","Data":"42b4538794c2b9addb8149ccb4057c76cce42a6ae1db0bc13ed0a7503671efc5"}
Jun 09 10:06:46.166338 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:46.166275    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podStartSLOduration=13.166253087 podStartE2EDuration="13.166253087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:06:46.163775595 +0000 UTC m=+2029.971280327" watchObservedRunningTime="2026-06-09 10:06:46.166253087 +0000 UTC m=+2029.973757821"
Jun 09 10:06:49.002706 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.002664    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:49.003196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.002736    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:49.003196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.002756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:49.003196 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.002772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:49.005230 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.005194    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 10:06:49.005467 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.005206    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Jun 09 10:06:49.005551 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.005221    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 10:06:49.005551 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:49.005245    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Jun 09 10:06:50.362780 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:50.362729    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 10:06:50.794025 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:50.793985    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 10:06:52.002669 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.002630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003142 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.002810    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003217 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003148    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003217 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003217 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003210    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003370 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003226    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003626 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003604    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003693 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.003732 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.003693    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.007574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.007552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.177469 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.177437    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:06:52.180302 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:06:52.180276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:07:00.363209 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:00.363161    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jun 09 10:07:00.363765 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:00.363314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:07:00.793226 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:00.793179    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jun 09 10:07:00.793427 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:00.793341    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:07:03.227194 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.227159    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="16d33165db3dcc5fd7b8f624288a4d39dca375c2cdf1ad7a4bfa96ac4ef35e4a" exitCode=137
Jun 09 10:07:03.227194 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.227190    2563 generic.go:356] "Generic (PLEG): container finished" podID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerID="b8a6ee31f3a83523994dd7933c8358efb42f1b82a98c59fd740a29a6de21e124" exitCode=137
Jun 09 10:07:03.227612 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.227228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"16d33165db3dcc5fd7b8f624288a4d39dca375c2cdf1ad7a4bfa96ac4ef35e4a"}
Jun 09 10:07:03.227612 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.227271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"b8a6ee31f3a83523994dd7933c8358efb42f1b82a98c59fd740a29a6de21e124"}
Jun 09 10:07:03.462875 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.462839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:07:03.611042 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.610951    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46scg\" (UniqueName: \"kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611042 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.610993    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611042 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.611014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611291 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.611202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611291 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.611281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611389 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.611327    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") pod \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\" (UID: \"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d\") "
Jun 09 10:07:03.611797 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.611752    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data" (OuterVolumeSpecName: "feast-data") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:07:03.613456 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.613421    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:07:03.613456 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.613431    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg" (OuterVolumeSpecName: "kube-api-access-46scg") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "kube-api-access-46scg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:07:03.613618 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.613494    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:07:03.613733 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.613714    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:07:03.613865 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.613839    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls" (OuterVolumeSpecName: "online-tls") pod "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" (UID: "c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:07:03.712482 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712441    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46scg\" (UniqueName: \"kubernetes.io/projected/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-kube-api-access-46scg\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:03.712482 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712475    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:03.712695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712491    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:03.712695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712505    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:03.712695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712516    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:03.712695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:03.712527    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:07:04.234792 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.234756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd" event={"ID":"c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d","Type":"ContainerDied","Data":"7d9be9a81f39e7a42e6cd77015f0b6e44058277ad52bfbf996621e5a90aa2c24"}
Jun 09 10:07:04.234792 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.234789    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"
Jun 09 10:07:04.235361 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.234819    2563 scope.go:117] "RemoveContainer" containerID="5a6a987ea3e48ccc183f31383a60772f7f3a161c97d52eb193af4f421c9d7475"
Jun 09 10:07:04.244357 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.244338    2563 scope.go:117] "RemoveContainer" containerID="16d33165db3dcc5fd7b8f624288a4d39dca375c2cdf1ad7a4bfa96ac4ef35e4a"
Jun 09 10:07:04.252038 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.252011    2563 scope.go:117] "RemoveContainer" containerID="23206dc64057e848d7cc434ee25cece1668042b6f23ecf8ee5f953a6313271fa"
Jun 09 10:07:04.259394 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.259369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:07:04.259870 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.259855    2563 scope.go:117] "RemoveContainer" containerID="b8a6ee31f3a83523994dd7933c8358efb42f1b82a98c59fd740a29a6de21e124"
Jun 09 10:07:04.263414 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.263393    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-49jvd"]
Jun 09 10:07:04.268111 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.268092    2563 scope.go:117] "RemoveContainer" containerID="11f7005cb78b1a0fe05d5dac6e5a7ede53b54b583a4e1f30569c092e800e6d93"
Jun 09 10:07:04.275451 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.275435    2563 scope.go:117] "RemoveContainer" containerID="ff0f85ec774eb4bbd8e58c74f2a226a43d80c1d783542e2853695e4576425d73"
Jun 09 10:07:04.644428 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:04.644332    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" path="/var/lib/kubelet/pods/c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d/volumes"
Jun 09 10:07:20.859283 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:20.859246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:20.960437 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:20.960403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:26.788094 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:26.788059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.151001 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.150966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.248515 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.248485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.396144 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.396112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.479303 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.479269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.480446 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480424    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:07:54.480752 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480741    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online"
Jun 09 10:07:54.480795 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480754    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online"
Jun 09 10:07:54.480795 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480765    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="feast-apply"
Jun 09 10:07:54.480795 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480771    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="feast-apply"
Jun 09 10:07:54.480795 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480782    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="offline"
Jun 09 10:07:54.480795 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480787    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="offline"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480799    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="feast-init"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480804    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="feast-init"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480819    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480836    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480842    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="registry"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480847    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="registry"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480944    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="ui"
Jun 09 10:07:54.480964 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480951    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="online"
Jun 09 10:07:54.481320 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480988    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="registry"
Jun 09 10:07:54.481320 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.480998    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4f1d92d-e37e-40b0-8b77-3aeba2c9cb9d" containerName="offline"
Jun 09 10:07:54.483537 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.483522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.486296 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.486266    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jun 09 10:07:54.486445 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.486358    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-bq57r\""
Jun 09 10:07:54.486445 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.486359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jun 09 10:07:54.486919 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.486888    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jun 09 10:07:54.487038 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.486922    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jun 09 10:07:54.487433 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.487412    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jun 09 10:07:54.487870 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.487846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jun 09 10:07:54.497027 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.496560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:07:54.562735 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.562894 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.562894 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.562894 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcbs\" (UniqueName: \"kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.562894 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.562894 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.562887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.643886 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.643798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.664036 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcbs\" (UniqueName: \"kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664148 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664348 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664348 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:07:54.664271    2563 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 10:07:54.664348 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:07:54.664279    2563 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 10:07:54.664348 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:07:54.664347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls podName:864c4484-b0c4-4e73-9ff0-10081c25ae03 nodeName:}" failed. No retries permitted until 2026-06-09 10:07:55.164330488 +0000 UTC m=+2098.971835197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-hlvgf" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jun 09 10:07:54.664516 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:07:54.664394    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls podName:864c4484-b0c4-4e73-9ff0-10081c25ae03 nodeName:}" failed. No retries permitted until 2026-06-09 10:07:55.164374677 +0000 UTC m=+2098.971879407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls") pod "feast-simple-feast-remote-setup-669bcf45fc-hlvgf" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jun 09 10:07:54.664586 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664564    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.664890 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.664872    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.666451 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.666426    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.673049 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.673029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcbs\" (UniqueName: \"kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:54.744408 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.744332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:54.844590 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:54.844557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:55.169073 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.168973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:55.169073 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.169049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:55.171451 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.171427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:55.171519 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.171461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") pod \"feast-simple-feast-remote-setup-669bcf45fc-hlvgf\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:55.400381 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.400352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:07:55.541067 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.541044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:07:55.542307 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:07:55.542281    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864c4484_b0c4_4e73_9ff0_10081c25ae03.slice/crio-fef8b1dd65c9d91e93ed0ee5751fe90b72aae0293a4f5275ff306e58eda26b5f WatchSource:0}: Error finding container fef8b1dd65c9d91e93ed0ee5751fe90b72aae0293a4f5275ff306e58eda26b5f: Status 404 returned error can't find the container with id fef8b1dd65c9d91e93ed0ee5751fe90b72aae0293a4f5275ff306e58eda26b5f
Jun 09 10:07:55.543241 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:55.543213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:07:56.459600 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.459566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"1f607e36f9f406473579e2839a93cf7a5c17cd392aa2478c53bbed2e6d970e9b"}
Jun 09 10:07:56.460001 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.459609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"fef8b1dd65c9d91e93ed0ee5751fe90b72aae0293a4f5275ff306e58eda26b5f"}
Jun 09 10:07:56.777005 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.776973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 10:07:56.780620 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.780600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 10:07:56.784963 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.784936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 10:07:56.788651 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:07:56.788633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 10:08:00.483236 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:00.483206    2563 generic.go:356] "Generic (PLEG): container finished" podID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerID="1f607e36f9f406473579e2839a93cf7a5c17cd392aa2478c53bbed2e6d970e9b" exitCode=0
Jun 09 10:08:00.483612 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:00.483286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"1f607e36f9f406473579e2839a93cf7a5c17cd392aa2478c53bbed2e6d970e9b"}
Jun 09 10:08:01.488954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:01.488922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"4cd4f66f6d6fd115c13f97bb6a4e3f02914c952e32bfb1e725e31b7c83ed9a00"}
Jun 09 10:08:06.520293 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:06.520258    2563 generic.go:356] "Generic (PLEG): container finished" podID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerID="4cd4f66f6d6fd115c13f97bb6a4e3f02914c952e32bfb1e725e31b7c83ed9a00" exitCode=0
Jun 09 10:08:06.520673 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:06.520330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"4cd4f66f6d6fd115c13f97bb6a4e3f02914c952e32bfb1e725e31b7c83ed9a00"}
Jun 09 10:08:07.529889 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:07.529853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"d548826fcdecc0cd8904f076c33d6a09b7fa5c46a9c0190cf469e87694a103ee"}
Jun 09 10:08:07.530355 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:07.529906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"7e914c9401078e6b7f8b06ae6a60016bfaee014cf622660058d1a5efd7458441"}
Jun 09 10:08:07.530355 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:07.529924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerStarted","Data":"9bd35c6d142f987d97bb43c89f6f7209841e06a79533b3564f195dd692e5a1e3"}
Jun 09 10:08:07.553289 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:07.553231    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podStartSLOduration=13.553211256 podStartE2EDuration="13.553211256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:08:07.552230191 +0000 UTC m=+2111.359734940" watchObservedRunningTime="2026-06-09 10:08:07.553211256 +0000 UTC m=+2111.360715988"
Jun 09 10:08:10.401101 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.401059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:10.401591 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.401137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:10.401591 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.401158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:10.402931 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.402898    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jun 09 10:08:10.403048 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.402927    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 10:08:10.403048 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:10.402952    2563 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 10:08:13.402125 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.402092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.402517 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.402213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.402639 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.402620    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.402779 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.402761    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.402983 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.402965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.403041 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.403017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.406364 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.406346    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.563536 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.563512    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:08:13.566377 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:08:13.566349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:09:15.523838 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.523789    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:09:15.524326 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.524081    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online" containerID="cri-o://9bd35c6d142f987d97bb43c89f6f7209841e06a79533b3564f195dd692e5a1e3" gracePeriod=30
Jun 09 10:09:15.524326 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.524246    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui" containerID="cri-o://d548826fcdecc0cd8904f076c33d6a09b7fa5c46a9c0190cf469e87694a103ee" gracePeriod=30
Jun 09 10:09:15.525052 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.524506    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="offline" containerID="cri-o://7e914c9401078e6b7f8b06ae6a60016bfaee014cf622660058d1a5efd7458441" gracePeriod=30
Jun 09 10:09:15.525420 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.525389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:15.589944 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.589918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:15.670731 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.670605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:15.679138 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.673873    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:09:15.679138 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.674234    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="registry" containerID="cri-o://42b4538794c2b9addb8149ccb4057c76cce42a6ae1db0bc13ed0a7503671efc5" gracePeriod=30
Jun 09 10:09:15.679138 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.674744    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui" containerID="cri-o://08c25ba022f7da84bf2fe376e8c0519ca029fbad473c7c4f5cf3468da16737a6" gracePeriod=30
Jun 09 10:09:15.679138 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.674927    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online" containerID="cri-o://c8df276ec4458a330ced513c82464e1578dd5bc9c212fa1bba4b8a6556cfb4b4" gracePeriod=30
Jun 09 10:09:15.679138 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.675076    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="offline" containerID="cri-o://888c5cf3cabbdc496df6a3b14356593c2fb182f035e939e7bd86bda9123ed807" gracePeriod=30
Jun 09 10:09:15.768976 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.768949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:15.830240 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:15.830112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:16.836877 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.836847    2563 generic.go:356] "Generic (PLEG): container finished" podID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerID="d548826fcdecc0cd8904f076c33d6a09b7fa5c46a9c0190cf469e87694a103ee" exitCode=0
Jun 09 10:09:16.836877 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.836867    2563 generic.go:356] "Generic (PLEG): container finished" podID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerID="9bd35c6d142f987d97bb43c89f6f7209841e06a79533b3564f195dd692e5a1e3" exitCode=0
Jun 09 10:09:16.837360 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.836885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"d548826fcdecc0cd8904f076c33d6a09b7fa5c46a9c0190cf469e87694a103ee"}
Jun 09 10:09:16.837360 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.836924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"9bd35c6d142f987d97bb43c89f6f7209841e06a79533b3564f195dd692e5a1e3"}
Jun 09 10:09:16.839801 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.839780    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="08c25ba022f7da84bf2fe376e8c0519ca029fbad473c7c4f5cf3468da16737a6" exitCode=0
Jun 09 10:09:16.839801 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.839799    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="c8df276ec4458a330ced513c82464e1578dd5bc9c212fa1bba4b8a6556cfb4b4" exitCode=0
Jun 09 10:09:16.839954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.839855    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"08c25ba022f7da84bf2fe376e8c0519ca029fbad473c7c4f5cf3468da16737a6"}
Jun 09 10:09:16.839954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:16.839890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"c8df276ec4458a330ced513c82464e1578dd5bc9c212fa1bba4b8a6556cfb4b4"}
Jun 09 10:09:20.842675 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:20.842641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:22.003788 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:22.003742    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 10:09:22.178539 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:22.178501    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 10:09:23.403632 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:23.403590    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 10:09:23.564254 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:23.564217    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 10:09:29.270194 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:29.270156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:29.371337 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:29.371304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:32.004070 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:32.004024    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 10:09:32.178507 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:32.178461    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 10:09:33.403096 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:33.403045    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 10:09:33.564115 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:33.564072    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 10:09:42.003976 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:42.003930    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jun 09 10:09:42.004392 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:42.004063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:09:42.177624 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:42.177593    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jun 09 10:09:42.177791 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:42.177712    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:09:43.403337 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:43.403290    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jun 09 10:09:43.403730 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:43.403422    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:09:43.564419 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:43.564383    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jun 09 10:09:43.564623 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:43.564486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:09:45.969254 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.969174    2563 generic.go:356] "Generic (PLEG): container finished" podID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerID="7e914c9401078e6b7f8b06ae6a60016bfaee014cf622660058d1a5efd7458441" exitCode=137
Jun 09 10:09:45.969651 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.969249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"7e914c9401078e6b7f8b06ae6a60016bfaee014cf622660058d1a5efd7458441"}
Jun 09 10:09:45.972296 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.972269    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="888c5cf3cabbdc496df6a3b14356593c2fb182f035e939e7bd86bda9123ed807" exitCode=137
Jun 09 10:09:45.972296 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.972286    2563 generic.go:356] "Generic (PLEG): container finished" podID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerID="42b4538794c2b9addb8149ccb4057c76cce42a6ae1db0bc13ed0a7503671efc5" exitCode=137
Jun 09 10:09:45.972439 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.972346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"888c5cf3cabbdc496df6a3b14356593c2fb182f035e939e7bd86bda9123ed807"}
Jun 09 10:09:45.972439 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:45.972381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"42b4538794c2b9addb8149ccb4057c76cce42a6ae1db0bc13ed0a7503671efc5"}
Jun 09 10:09:46.166515 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.166491    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:09:46.242930 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.242852    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqcbs\" (UniqueName: \"kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.242930 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.242908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.242930 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.242930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.243162 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.242952    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.243162 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.242966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.243162 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.243012    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") pod \"864c4484-b0c4-4e73-9ff0-10081c25ae03\" (UID: \"864c4484-b0c4-4e73-9ff0-10081c25ae03\") "
Jun 09 10:09:46.243423 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.243397    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 10:09:46.243573 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.243542    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data" (OuterVolumeSpecName: "feast-data") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:09:46.245445 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.245386    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs" (OuterVolumeSpecName: "kube-api-access-mqcbs") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "kube-api-access-mqcbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:09:46.245761 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.245727    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.245927 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.245851    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.246100 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.246074    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls" (OuterVolumeSpecName: "online-tls") pod "864c4484-b0c4-4e73-9ff0-10081c25ae03" (UID: "864c4484-b0c4-4e73-9ff0-10081c25ae03"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.332004 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.331981    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:09:46.343649 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343632    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/864c4484-b0c4-4e73-9ff0-10081c25ae03-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.343710 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343652    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.343710 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343660    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/864c4484-b0c4-4e73-9ff0-10081c25ae03-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.343710 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343668    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.343710 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343692    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/864c4484-b0c4-4e73-9ff0-10081c25ae03-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.343710 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.343700    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqcbs\" (UniqueName: \"kubernetes.io/projected/864c4484-b0c4-4e73-9ff0-10081c25ae03-kube-api-access-mqcbs\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.444695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444668    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2vcr\" (UniqueName: \"kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.444695 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.444947 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.444947 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.444947 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444776    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.444947 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.444803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls\") pod \"60db8980-adf5-4de6-9d57-cfdceb29fffe\" (UID: \"60db8980-adf5-4de6-9d57-cfdceb29fffe\") "
Jun 09 10:09:46.445404 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.445365    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data" (OuterVolumeSpecName: "feast-data") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:09:46.446861 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.446808    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.447012 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.446989    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.447063 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.447006    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls" (OuterVolumeSpecName: "online-tls") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.447151 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.447131    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 10:09:46.447239 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.447225    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr" (OuterVolumeSpecName: "kube-api-access-v2vcr") pod "60db8980-adf5-4de6-9d57-cfdceb29fffe" (UID: "60db8980-adf5-4de6-9d57-cfdceb29fffe"). InnerVolumeSpecName "kube-api-access-v2vcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:09:46.545620 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545595    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2vcr\" (UniqueName: \"kubernetes.io/projected/60db8980-adf5-4de6-9d57-cfdceb29fffe-kube-api-access-v2vcr\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.545728 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545622    2563 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-ui-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.545728 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545639    2563 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-offline-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.545728 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545651    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-registry-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.545728 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545663    2563 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/60db8980-adf5-4de6-9d57-cfdceb29fffe-feast-data\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.545728 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.545674    2563 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/60db8980-adf5-4de6-9d57-cfdceb29fffe-online-tls\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:09:46.978630 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.978591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf" event={"ID":"864c4484-b0c4-4e73-9ff0-10081c25ae03","Type":"ContainerDied","Data":"fef8b1dd65c9d91e93ed0ee5751fe90b72aae0293a4f5275ff306e58eda26b5f"}
Jun 09 10:09:46.979132 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.978649    2563 scope.go:117] "RemoveContainer" containerID="d548826fcdecc0cd8904f076c33d6a09b7fa5c46a9c0190cf469e87694a103ee"
Jun 09 10:09:46.979132 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.978606    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"
Jun 09 10:09:46.981950 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.981927    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj" event={"ID":"60db8980-adf5-4de6-9d57-cfdceb29fffe","Type":"ContainerDied","Data":"bcddf82b3bc0256b1cff5971cbd9b180502eb23a9327b40135662ea92bf24012"}
Jun 09 10:09:46.982051 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.981977    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"
Jun 09 10:09:46.988612 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.988593    2563 scope.go:117] "RemoveContainer" containerID="7e914c9401078e6b7f8b06ae6a60016bfaee014cf622660058d1a5efd7458441"
Jun 09 10:09:46.996201 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.996182    2563 scope.go:117] "RemoveContainer" containerID="9bd35c6d142f987d97bb43c89f6f7209841e06a79533b3564f195dd692e5a1e3"
Jun 09 10:09:46.998652 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:46.998630    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:09:47.001871 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.001851    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-669bcf45fc-hlvgf"]
Jun 09 10:09:47.005482 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.005466    2563 scope.go:117] "RemoveContainer" containerID="4cd4f66f6d6fd115c13f97bb6a4e3f02914c952e32bfb1e725e31b7c83ed9a00"
Jun 09 10:09:47.012608 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.012593    2563 scope.go:117] "RemoveContainer" containerID="1f607e36f9f406473579e2839a93cf7a5c17cd392aa2478c53bbed2e6d970e9b"
Jun 09 10:09:47.017186 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.017167    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:09:47.021072 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.021055    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75c64c888b-nz4bj"]
Jun 09 10:09:47.021318 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.021303    2563 scope.go:117] "RemoveContainer" containerID="08c25ba022f7da84bf2fe376e8c0519ca029fbad473c7c4f5cf3468da16737a6"
Jun 09 10:09:47.028655 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.028639    2563 scope.go:117] "RemoveContainer" containerID="888c5cf3cabbdc496df6a3b14356593c2fb182f035e939e7bd86bda9123ed807"
Jun 09 10:09:47.035574 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.035558    2563 scope.go:117] "RemoveContainer" containerID="c8df276ec4458a330ced513c82464e1578dd5bc9c212fa1bba4b8a6556cfb4b4"
Jun 09 10:09:47.042549 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.042535    2563 scope.go:117] "RemoveContainer" containerID="42b4538794c2b9addb8149ccb4057c76cce42a6ae1db0bc13ed0a7503671efc5"
Jun 09 10:09:47.049544 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.049528    2563 scope.go:117] "RemoveContainer" containerID="8048a2bd16db46cef44b60d324f2f4973cd77e02031d2d527b6ff9d1b370286a"
Jun 09 10:09:47.058410 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:47.058395    2563 scope.go:117] "RemoveContainer" containerID="d61687ff65e5fcc693eb6f1ba94b885a09f1d082d9d8f98f064b09274ced5d88"
Jun 09 10:09:48.643708 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:48.643675    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" path="/var/lib/kubelet/pods/60db8980-adf5-4de6-9d57-cfdceb29fffe/volumes"
Jun 09 10:09:48.644320 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:48.644305    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" path="/var/lib/kubelet/pods/864c4484-b0c4-4e73-9ff0-10081c25ae03/volumes"
Jun 09 10:09:58.634981 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:58.634945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:09:59.723310 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:09:59.723244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:04.320352 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.320314    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:04.377330 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.377302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:04.590414 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.590350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:04.594474 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594446    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fzzqr/must-gather-8lxp4"]
Jun 09 10:10:04.594761 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594750    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="feast-init"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594763    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="feast-init"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594779    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="feast-init"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594784    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="feast-init"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594792    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594797    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594804    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="offline"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594808    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="offline"
Jun 09 10:10:04.594813 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594814    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594819    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594848    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="registry"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594853    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="registry"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594863    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="offline"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594868    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="offline"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594876    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594883    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594890    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="feast-apply"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594895    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="feast-apply"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594902    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="feast-apply"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594907    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="feast-apply"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594914    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594918    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594967    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594974    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="offline"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594980    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="ui"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594988    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="registry"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.594994    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c4484-b0c4-4e73-9ff0-10081c25ae03" containerName="offline"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.595000    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="online"
Jun 09 10:10:04.595104 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.595006    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60db8980-adf5-4de6-9d57-cfdceb29fffe" containerName="ui"
Jun 09 10:10:04.599613 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.599594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.602782 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.602763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fzzqr\"/\"default-dockercfg-5qds8\""
Jun 09 10:10:04.603861 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.603847    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzzqr\"/\"kube-root-ca.crt\""
Jun 09 10:10:04.603931 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.603890    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzzqr\"/\"openshift-service-ca.crt\""
Jun 09 10:10:04.610644 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.610619    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzzqr/must-gather-8lxp4"]
Jun 09 10:10:04.683680 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.683657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:04.691776 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.691753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmskn\" (UniqueName: \"kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.691856 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.691781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.793165 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.793130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmskn\" (UniqueName: \"kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.793165 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.793166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.793513 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.793494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.801136 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.801111    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmskn\" (UniqueName: \"kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn\") pod \"must-gather-8lxp4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") " pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:04.908626 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:04.908551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:05.041110 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:05.041086    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzzqr/must-gather-8lxp4"]
Jun 09 10:10:05.043253 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:10:05.043224    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d944bd2_58ea_43fc_9b6d_610abe90ddc4.slice/crio-e883dc24770d82f2b5d6717056f411d126660c1374ecc56eae9e46cd9c4a6767 WatchSource:0}: Error finding container e883dc24770d82f2b5d6717056f411d126660c1374ecc56eae9e46cd9c4a6767: Status 404 returned error can't find the container with id e883dc24770d82f2b5d6717056f411d126660c1374ecc56eae9e46cd9c4a6767
Jun 09 10:10:05.045032 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:05.045018    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 10:10:05.057402 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:05.057375    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" event={"ID":"0d944bd2-58ea-43fc-9b6d-610abe90ddc4","Type":"ContainerStarted","Data":"e883dc24770d82f2b5d6717056f411d126660c1374ecc56eae9e46cd9c4a6767"}
Jun 09 10:10:13.096239 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:13.096202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" event={"ID":"0d944bd2-58ea-43fc-9b6d-610abe90ddc4","Type":"ContainerStarted","Data":"e7fb1cb8a995f77b0dce9df8ce95d8d0878f35f8bde2251d74ffe06eded5bdf9"}
Jun 09 10:10:13.096633 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:13.096254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" event={"ID":"0d944bd2-58ea-43fc-9b6d-610abe90ddc4","Type":"ContainerStarted","Data":"f71190b085c45cce9c227295aec70e6d137a0909a626df1fd7347dbc2318ee79"}
Jun 09 10:10:13.113656 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:13.113602    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" podStartSLOduration=2.080390502 podStartE2EDuration="9.113586026s" totalImagesPullingTime="7.033195524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:10:13.111722457 +0000 UTC m=+2236.919227187" watchObservedRunningTime="2026-06-09 10:10:13.113586026 +0000 UTC m=+2236.921090813"
Jun 09 10:10:22.136628 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:22.136590    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerID="f71190b085c45cce9c227295aec70e6d137a0909a626df1fd7347dbc2318ee79" exitCode=0
Jun 09 10:10:22.137052 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:22.136663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" event={"ID":"0d944bd2-58ea-43fc-9b6d-610abe90ddc4","Type":"ContainerDied","Data":"f71190b085c45cce9c227295aec70e6d137a0909a626df1fd7347dbc2318ee79"}
Jun 09 10:10:22.137052 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:22.136982    2563 scope.go:117] "RemoveContainer" containerID="f71190b085c45cce9c227295aec70e6d137a0909a626df1fd7347dbc2318ee79"
Jun 09 10:10:22.645684 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:22.645642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fzzqr_must-gather-8lxp4_0d944bd2-58ea-43fc-9b6d-610abe90ddc4/gather/0.log"
Jun 09 10:10:23.000640 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:23.000586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:23.134961 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:23.134917    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:23.191901 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:23.191877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:25.990219 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:25.990172    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-znq7n_7f8a360a-445d-4b95-a3d3-e55af866d18d/global-pull-secret-syncer/0.log"
Jun 09 10:10:26.036535 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:26.036513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log"
Jun 09 10:10:26.155604 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:26.155577    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-66.ec2.internal_14fb097f239e19efddd2e39d86ec19ca/haproxy/0.log"
Jun 09 10:10:27.973356 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:27.973315    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-fzzqr/must-gather-8lxp4"]
Jun 09 10:10:27.973805 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:27.973545    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-fzzqr/must-gather-8lxp4" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="copy" containerID="cri-o://e7fb1cb8a995f77b0dce9df8ce95d8d0878f35f8bde2251d74ffe06eded5bdf9" gracePeriod=2
Jun 09 10:10:27.978473 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:27.978442    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-fzzqr/must-gather-8lxp4"]
Jun 09 10:10:28.163201 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.163178    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fzzqr_must-gather-8lxp4_0d944bd2-58ea-43fc-9b6d-610abe90ddc4/copy/0.log"
Jun 09 10:10:28.163561 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.163534    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerID="e7fb1cb8a995f77b0dce9df8ce95d8d0878f35f8bde2251d74ffe06eded5bdf9" exitCode=143
Jun 09 10:10:28.201312 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.201284    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fzzqr_must-gather-8lxp4_0d944bd2-58ea-43fc-9b6d-610abe90ddc4/copy/0.log"
Jun 09 10:10:28.202780 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.202761    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:28.204896 ip-10-0-135-66 kubenswrapper[2563]: E0609 10:10:28.204874    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8lxp4\" is forbidden: User \"system:node:ip-10-0-135-66.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-fzzqr\": no relationship found between node 'ip-10-0-135-66.ec2.internal' and this object" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:28.303034 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.302970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmskn\" (UniqueName: \"kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn\") pod \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") "
Jun 09 10:10:28.303034 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.303025    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output\") pod \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\" (UID: \"0d944bd2-58ea-43fc-9b6d-610abe90ddc4\") "
Jun 09 10:10:28.303391 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.303370    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "0d944bd2-58ea-43fc-9b6d-610abe90ddc4" (UID: "0d944bd2-58ea-43fc-9b6d-610abe90ddc4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 09 10:10:28.305093 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.305074    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn" (OuterVolumeSpecName: "kube-api-access-tmskn") pod "0d944bd2-58ea-43fc-9b6d-610abe90ddc4" (UID: "0d944bd2-58ea-43fc-9b6d-610abe90ddc4"). InnerVolumeSpecName "kube-api-access-tmskn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 10:10:28.403602 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.403555    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmskn\" (UniqueName: \"kubernetes.io/projected/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-kube-api-access-tmskn\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:10:28.403602 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.403597    2563 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0d944bd2-58ea-43fc-9b6d-610abe90ddc4-must-gather-output\") on node \"ip-10-0-135-66.ec2.internal\" DevicePath \"\""
Jun 09 10:10:28.487541 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.487510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:28.585840 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.585739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2tknl_92657a6c-4994-48bd-9cee-1fff67142f33/konnectivity-agent/0.log" limit=1024
Jun 09 10:10:28.645309 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:28.645275    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" path="/var/lib/kubelet/pods/0d944bd2-58ea-43fc-9b6d-610abe90ddc4/volumes"
Jun 09 10:10:29.169570 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:29.169544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-fzzqr_must-gather-8lxp4_0d944bd2-58ea-43fc-9b6d-610abe90ddc4/copy/0.log"
Jun 09 10:10:29.169998 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:29.169952    2563 scope.go:117] "RemoveContainer" containerID="e7fb1cb8a995f77b0dce9df8ce95d8d0878f35f8bde2251d74ffe06eded5bdf9"
Jun 09 10:10:29.169998 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:29.169956    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzzqr/must-gather-8lxp4"
Jun 09 10:10:29.177730 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:29.177717    2563 scope.go:117] "RemoveContainer" containerID="f71190b085c45cce9c227295aec70e6d137a0909a626df1fd7347dbc2318ee79"
Jun 09 10:10:30.040137 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.040107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/alertmanager/0.log"
Jun 09 10:10:30.079566 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.079545    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/config-reloader/0.log"
Jun 09 10:10:30.107493 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.107473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/kube-rbac-proxy-web/0.log"
Jun 09 10:10:30.134731 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.134716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/kube-rbac-proxy/0.log"
Jun 09 10:10:30.162541 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.162522    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/kube-rbac-proxy-metric/0.log"
Jun 09 10:10:30.190547 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.190519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/prom-label-proxy/0.log"
Jun 09 10:10:30.214335 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.214318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a94020ba-7ac4-4b1b-949d-9147b4ce1421/init-config-reloader/0.log"
Jun 09 10:10:30.291001 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.290933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-state-metrics/0.log"
Jun 09 10:10:30.322212 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.322190    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-rbac-proxy-main/0.log"
Jun 09 10:10:30.345218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.345202    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bghpg_1adf0d66-9eba-4deb-a220-f9a771a04a0f/kube-rbac-proxy-self/0.log"
Jun 09 10:10:30.377651 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.377627    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79c7677f76-xvjf6_d14f8d3b-4762-4dfb-b29f-1cd3bea89c3a/metrics-server/0.log"
Jun 09 10:10:30.454002 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.453973    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/node-exporter/0.log"
Jun 09 10:10:30.478078 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.478045    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/kube-rbac-proxy/0.log"
Jun 09 10:10:30.510510 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.510483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-464lx_925e97dc-479f-415b-9088-ac1035493334/init-textfile/0.log"
Jun 09 10:10:30.692711 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.692643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/kube-rbac-proxy-main/0.log"
Jun 09 10:10:30.718643 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.718623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/kube-rbac-proxy-self/0.log"
Jun 09 10:10:30.739800 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:30.739782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-rc74m_728a0053-a83c-4889-8c98-fb197ad08490/openshift-state-metrics/0.log"
Jun 09 10:10:31.087225 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.087202    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-kmwxq_3bb991fc-76d0-4a2d-bd88-5889ea54d136/prometheus-operator-admission-webhook/0.log"
Jun 09 10:10:31.168245 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.168219    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb475cfb6-9czpn_9d87b4c9-0ead-450d-aef1-523c8764fb3e/telemeter-client/0.log"
Jun 09 10:10:31.203540 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.203519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb475cfb6-9czpn_9d87b4c9-0ead-450d-aef1-523c8764fb3e/reload/0.log"
Jun 09 10:10:31.236663 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.236640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb475cfb6-9czpn_9d87b4c9-0ead-450d-aef1-523c8764fb3e/kube-rbac-proxy/0.log"
Jun 09 10:10:31.271224 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.271200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/thanos-query/0.log"
Jun 09 10:10:31.297717 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.297666    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-web/0.log"
Jun 09 10:10:31.323255 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.323238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy/0.log"
Jun 09 10:10:31.348638 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.348613    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/prom-label-proxy/0.log"
Jun 09 10:10:31.379808 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.379789    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-rules/0.log"
Jun 09 10:10:31.408982 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:31.408963    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cd6cf946c-f269c_f4afccdd-5d03-4964-85b0-9da897a72832/kube-rbac-proxy-metrics/0.log"
Jun 09 10:10:32.865691 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:32.865631    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/1.log"
Jun 09 10:10:32.870159 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:32.870138    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-bjwc5_460c232b-ddcc-469f-9f2b-7c66ca881d4e/console-operator/2.log"
Jun 09 10:10:33.124215 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124146    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"]
Jun 09 10:10:33.124473 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124461    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="gather"
Jun 09 10:10:33.124514 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124475    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="gather"
Jun 09 10:10:33.124514 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124483    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="copy"
Jun 09 10:10:33.124514 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124488    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="copy"
Jun 09 10:10:33.124622 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124551    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="copy"
Jun 09 10:10:33.124622 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.124562    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d944bd2-58ea-43fc-9b6d-610abe90ddc4" containerName="gather"
Jun 09 10:10:33.127956 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.127935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.130426 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.130411    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"kube-root-ca.crt\""
Jun 09 10:10:33.131455 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.131437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kgxsx\"/\"default-dockercfg-h772p\""
Jun 09 10:10:33.131546 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.131461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kgxsx\"/\"openshift-service-ca.crt\""
Jun 09 10:10:33.136132 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.136113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"]
Jun 09 10:10:33.245042 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.245014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-sys\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.245193 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.245066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-proc\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.245193 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.245135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-podres\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.245193 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.245156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvqw6\" (UniqueName: \"kubernetes.io/projected/b67ada4b-a8d3-45e4-a462-da89aab381ed-kube-api-access-fvqw6\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.245193 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.245183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-lib-modules\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.328912 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.328889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-jdjdl_e1988dc3-2cff-4c51-b0fc-7cf82584119f/download-server/0.log"
Jun 09 10:10:33.345766 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-podres\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.345766 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvqw6\" (UniqueName: \"kubernetes.io/projected/b67ada4b-a8d3-45e4-a462-da89aab381ed-kube-api-access-fvqw6\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.345954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-lib-modules\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.345954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-sys\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.345954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-proc\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.345954 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-lib-modules\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.346088 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-podres\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.346088 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-sys\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.346088 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.345961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b67ada4b-a8d3-45e4-a462-da89aab381ed-proc\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.353705 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.353678    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvqw6\" (UniqueName: \"kubernetes.io/projected/b67ada4b-a8d3-45e4-a462-da89aab381ed-kube-api-access-fvqw6\") pod \"perf-node-gather-daemonset-l72xt\" (UID: \"b67ada4b-a8d3-45e4-a462-da89aab381ed\") " pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.439482 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.439429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:33.567244 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.567218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"]
Jun 09 10:10:33.569646 ip-10-0-135-66 kubenswrapper[2563]: W0609 10:10:33.569617    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb67ada4b_a8d3_45e4_a462_da89aab381ed.slice/crio-c50527f994fcd814e17de28b66a176b62120b0a0f7514d46effef038f8b13964 WatchSource:0}: Error finding container c50527f994fcd814e17de28b66a176b62120b0a0f7514d46effef038f8b13964: Status 404 returned error can't find the container with id c50527f994fcd814e17de28b66a176b62120b0a0f7514d46effef038f8b13964
Jun 09 10:10:33.789033 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:33.789004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-4zczj_7643d452-ad11-40f8-bbc7-af1efa764031/volume-data-source-validator/0.log"
Jun 09 10:10:34.198430 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.198348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt" event={"ID":"b67ada4b-a8d3-45e4-a462-da89aab381ed","Type":"ContainerStarted","Data":"cca954f8526ec59f7755bf92eca122bbf49924f99bd4f43ace010e68db20573f"}
Jun 09 10:10:34.198430 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.198394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt" event={"ID":"b67ada4b-a8d3-45e4-a462-da89aab381ed","Type":"ContainerStarted","Data":"c50527f994fcd814e17de28b66a176b62120b0a0f7514d46effef038f8b13964"}
Jun 09 10:10:34.198430 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.198425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:34.215216 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.215164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt" podStartSLOduration=1.21515053 podStartE2EDuration="1.21515053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:10:34.213669628 +0000 UTC m=+2258.021174371" watchObservedRunningTime="2026-06-09 10:10:34.21515053 +0000 UTC m=+2258.022655261"
Jun 09 10:10:34.508143 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.508116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7hf6s_fc4bbbbf-18e4-4572-af37-9415a7f0d4bc/dns/0.log"
Jun 09 10:10:34.531293 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.531271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7hf6s_fc4bbbbf-18e4-4572-af37-9415a7f0d4bc/kube-rbac-proxy/0.log"
Jun 09 10:10:34.677171 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:34.677146    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hc2xf_9369b817-e406-4f2f-8bff-f1778ecbaca3/dns-node-resolver/0.log"
Jun 09 10:10:35.086754 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:35.086724    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df5cccb6d-vvm45_767f6769-9aa0-4589-bcb9-030348410b8d/registry/0.log"
Jun 09 10:10:35.094430 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:35.094409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df5cccb6d-vvm45_767f6769-9aa0-4589-bcb9-030348410b8d/registry/1.log"
Jun 09 10:10:35.139493 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:35.139472    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s647z_281b27f8-d59f-489b-9164-e9a08b780af0/node-ca/0.log"
Jun 09 10:10:36.315278 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.315249    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kpsbf_b89759f7-7620-435e-85d0-d4279cac08f1/serve-healthcheck-canary/0.log"
Jun 09 10:10:36.733137 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.733109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hh6zb_717ad8b5-5bda-4ff7-ac03-6933003314ef/insights-operator/0.log"
Jun 09 10:10:36.735456 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.735421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-hh6zb_717ad8b5-5bda-4ff7-ac03-6933003314ef/insights-operator/1.log"
Jun 09 10:10:36.754945 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.754921    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bnrxl_c8777c73-012e-48c3-a294-e1f04a0c5611/kube-rbac-proxy/0.log"
Jun 09 10:10:36.775393 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.775372    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bnrxl_c8777c73-012e-48c3-a294-e1f04a0c5611/exporter/0.log"
Jun 09 10:10:36.795347 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:36.795325    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bnrxl_c8777c73-012e-48c3-a294-e1f04a0c5611/extractor/0.log"
Jun 09 10:10:40.212063 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:40.212032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kgxsx/perf-node-gather-daemonset-l72xt"
Jun 09 10:10:41.275189 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:41.275158    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dng2v_2b1b34b5-fbff-4389-a6c6-4770ee9074d5/kube-storage-version-migrator-operator/1.log"
Jun 09 10:10:41.276009 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:41.275992    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-dng2v_2b1b34b5-fbff-4389-a6c6-4770ee9074d5/kube-storage-version-migrator-operator/0.log"
Jun 09 10:10:42.341290 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.341251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/kube-multus-additional-cni-plugins/0.log"
Jun 09 10:10:42.389232 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.389206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/egress-router-binary-copy/0.log"
Jun 09 10:10:42.432043 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.432018    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/cni-plugins/0.log"
Jun 09 10:10:42.484008 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.483983    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/bond-cni-plugin/0.log"
Jun 09 10:10:42.520103 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.520081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/routeoverride-cni/0.log"
Jun 09 10:10:42.566004 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.565981    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/whereabouts-cni-bincopy/0.log"
Jun 09 10:10:42.594501 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:42.594482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8hxlj_3b387cd7-f7dc-458d-87de-e7d4ae2c7500/whereabouts-cni/0.log"
Jun 09 10:10:43.075633 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:43.075598    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tgtqb_0ba5f058-390f-4bf4-bacd-f61b46c312fa/kube-multus/0.log"
Jun 09 10:10:43.097720 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:43.097694    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kcrvz_5167279c-68fd-4b23-9a4c-0c8cd92cd330/network-metrics-daemon/0.log"
Jun 09 10:10:43.121274 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:43.121215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kcrvz_5167279c-68fd-4b23-9a4c-0c8cd92cd330/kube-rbac-proxy/0.log"
Jun 09 10:10:44.549039 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.549015    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-controller/0.log"
Jun 09 10:10:44.570390 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.570352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/1.log"
Jun 09 10:10:44.570513 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.570404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovn-acl-logging/0.log"
Jun 09 10:10:44.589772 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.589750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/kube-rbac-proxy-node/0.log"
Jun 09 10:10:44.613548 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.613524    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/kube-rbac-proxy-ovn-metrics/0.log"
Jun 09 10:10:44.634383 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.634365    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/northd/0.log"
Jun 09 10:10:44.655876 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.655855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/nbdb/0.log"
Jun 09 10:10:44.678694 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.678671    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/sbdb/0.log"
Jun 09 10:10:44.719218 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:44.719170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lwgk2_ff120835-01c5-41f2-9a39-c42d4fced1ce/ovnkube-controller/0.log"
Jun 09 10:10:45.766522 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:45.766495    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jzv6f_0682753a-991c-46fe-8efb-1e53aa727d83/network-check-target-container/0.log"
Jun 09 10:10:46.815920 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:46.815891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xxhd5_5f4fb18b-e57a-4276-9223-50e8cd75fb27/iptables-alerter/0.log"
Jun 09 10:10:47.430565 ip-10-0-135-66 kubenswrapper[2563]: I0609 10:10:47.430539    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4b6mh_622994b3-c77d-4986-b4d9-14ca1e1ba65c/tuned/0.log"