May 21 18:13:15.315719 ip-10-0-143-212 systemd[1]: Starting Kubernetes Kubelet...
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.816821    2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823205    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823219    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823223    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823226    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823229    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823232    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823235    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823238    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:13:15.939288 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823241    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:13:15.928861 ip-10-0-143-212 systemd[1]: Started Kubernetes Kubelet.
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823246    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823250    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823253    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823257    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823261    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823263    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823266    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823269    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823272    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823275    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823278    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823281    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823284    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823286    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823289    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823292    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823295    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823298    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823300    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:13:15.942364 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823304    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823306    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823309    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823312    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823315    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823319    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823322    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823324    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823327    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823330    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823332    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823335    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823338    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823340    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823343    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823345    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823348    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823350    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823353    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823355    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:13:15.943362 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823359    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823362    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823365    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823368    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823371    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823373    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823376    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823378    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823381    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823384    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823386    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823389    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823392    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823394    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823397    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823399    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823401    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823404    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823408    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:13:15.946323 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823412    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823415    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823418    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823421    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823434    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823436    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823439    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823442    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823444    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823447    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823450    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823452    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823455    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823458    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823461    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823464    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823467    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823469    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823472    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823854    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:13:15.947376 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823858    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823861    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823865    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823868    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823870    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823873    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823876    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823879    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823881    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823884    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823886    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823890    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823892    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823895    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823898    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823900    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823903    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823905    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823908    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823910    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:13:15.950354 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823913    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823915    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823918    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823920    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823923    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823925    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823928    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823931    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823933    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823936    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823939    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823941    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823944    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823947    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823950    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823953    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823955    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823958    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823960    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823965    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:13:15.951381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823969    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823971    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823974    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823977    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823980    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823983    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823985    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823988    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823990    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823993    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823995    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.823998    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824001    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824003    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824006    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824008    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824011    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824014    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824016    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824019    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:13:15.954702 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824022    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824025    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824027    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824030    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824032    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824040    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824042    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824045    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824048    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824050    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824053    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824055    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824058    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824060    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824063    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824065    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824068    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824071    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824073    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824076    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:13:15.955593 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824078    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824081    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824085    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824091    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.824094    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824773    2573 flags.go:64] FLAG: --address="0.0.0.0"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824787    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824795    2573 flags.go:64] FLAG: --anonymous-auth="true"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824799    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824803    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824806    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824811    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824815    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824818    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824822    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824825    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824829    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824833    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824836    2573 flags.go:64] FLAG: --cgroup-root=""
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824839    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824842    2573 flags.go:64] FLAG: --client-ca-file=""
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824845    2573 flags.go:64] FLAG: --cloud-config=""
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824848    2573 flags.go:64] FLAG: --cloud-provider="external"
May 21 18:13:15.957363 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824851    2573 flags.go:64] FLAG: --cluster-dns="[]"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824855    2573 flags.go:64] FLAG: --cluster-domain=""
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824858    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824861    2573 flags.go:64] FLAG: --config-dir=""
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824866    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824869    2573 flags.go:64] FLAG: --container-log-max-files="5"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824873    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824877    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824880    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824883    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824887    2573 flags.go:64] FLAG: --contention-profiling="false"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824890    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824895    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824899    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824901    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824906    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824909    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824912    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824915    2573 flags.go:64] FLAG: --enable-load-reader="false"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824918    2573 flags.go:64] FLAG: --enable-server="true"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824920    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824925    2573 flags.go:64] FLAG: --event-burst="100"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824928    2573 flags.go:64] FLAG: --event-qps="50"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824931    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824934    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 18:13:15.958172 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824938    2573 flags.go:64] FLAG: --eviction-hard=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824944    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824947    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824950    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824953    2573 flags.go:64] FLAG: --eviction-soft=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824956    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824959    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824962    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824965    2573 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824968    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824972    2573 flags.go:64] FLAG: --fail-swap-on="true"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824975    2573 flags.go:64] FLAG: --feature-gates=""
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824979    2573 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824982    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824985    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824989    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824993    2573 flags.go:64] FLAG: --healthz-port="10248"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824996    2573 flags.go:64] FLAG: --help="false"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.824999    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-143-212.ec2.internal"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825003    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825006    2573 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825009    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825013    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 18:13:15.959589 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825017    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825020    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825023    2573 flags.go:64] FLAG: --image-service-endpoint=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825026    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825029    2573 flags.go:64] FLAG: --kube-api-burst="100"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825031    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825035    2573 flags.go:64] FLAG: --kube-api-qps="50"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825037    2573 flags.go:64] FLAG: --kube-reserved=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825040    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825043    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825046    2573 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825049    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825052    2573 flags.go:64] FLAG: --lock-file=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825055    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825058    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825061    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825066    2573 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825069    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825072    2573 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825079    2573 flags.go:64] FLAG: --logging-format="text"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825082    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825086    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825089    2573 flags.go:64] FLAG: --manifest-url=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825091    2573 flags.go:64] FLAG: --manifest-url-header=""
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825096    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 18:13:15.960536 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825099    2573 flags.go:64] FLAG: --max-open-files="1000000"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825104    2573 flags.go:64] FLAG: --max-pods="110"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825107    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825111    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825114    2573 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825117    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825120    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825123    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825126    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825134    2573 flags.go:64] FLAG: --node-status-max-images="50"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825137    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825140    2573 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825143    2573 flags.go:64] FLAG: --pod-cidr=""
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825146    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825153    2573 flags.go:64] FLAG: --pod-manifest-path=""
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825156    2573 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825159    2573 flags.go:64] FLAG: --pods-per-core="0"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825162    2573 flags.go:64] FLAG: --port="10250"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825165    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825168    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005b5586ac668220b"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825171    2573 flags.go:64] FLAG: --qos-reserved=""
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825174    2573 flags.go:64] FLAG: --read-only-port="10255"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825177    2573 flags.go:64] FLAG: --register-node="true"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825180    2573 flags.go:64] FLAG: --register-schedulable="true"
May 21 18:13:15.961748 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825183    2573 flags.go:64] FLAG: --register-with-taints=""
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825187    2573 flags.go:64] FLAG: --registry-burst="10"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825191    2573 flags.go:64] FLAG: --registry-qps="5"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825194    2573 flags.go:64] FLAG: --reserved-cpus=""
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825197    2573 flags.go:64] FLAG: --reserved-memory=""
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825201    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825204    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825208    2573 flags.go:64] FLAG: --rotate-certificates="false"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825211    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825214    2573 flags.go:64] FLAG: --runonce="false"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825217    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825220    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825230    2573 flags.go:64] FLAG: --seccomp-default="false"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825235    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825238    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825242    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825246    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825249    2573 flags.go:64] FLAG: --storage-driver-password="root"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825252    2573 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825255    2573 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825258    2573 flags.go:64] FLAG: --storage-driver-user="root"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825261    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825264    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825267    2573 flags.go:64] FLAG: --system-cgroups=""
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825270    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 18:13:15.962583 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825275    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825279    2573 flags.go:64] FLAG: --tls-cert-file=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825281    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825286    2573 flags.go:64] FLAG: --tls-min-version=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825288    2573 flags.go:64] FLAG: --tls-private-key-file=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825291    2573 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825294    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825297    2573 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825300    2573 flags.go:64] FLAG: --v="2"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825306    2573 flags.go:64] FLAG: --version="false"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825310    2573 flags.go:64] FLAG: --vmodule=""
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825314    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.825317    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825410    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825414    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825418    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825435    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825440    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825443    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825447    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825449    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825452    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:13:15.963263 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825455    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825458    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825461    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825463    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825466    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825469    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825473    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825476    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825479    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825482    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825485    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825488    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825490    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825493    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825495    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825498    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825501    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825503    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825506    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:13:16.204616 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825510    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825512    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825515    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825517    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825520    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825523    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825525    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825528    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825530    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825533    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825537    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825540    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825543    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825545    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825548    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825551    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825553    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825556    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825559    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825562    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:13:16.222594 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825564    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825567    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825570    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825572    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825575    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825578    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825580    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825583    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825586    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825589    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825591    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825594    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825598    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825601    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825603    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825606    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825608    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825611    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825614    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825616    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:13:16.223248 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825619    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825622    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825626    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825629    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825631    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825634    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825637    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825639    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825642    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825644    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825647    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825649    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825652    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825655    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825657    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825660    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825662    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:13:16.223994 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.825665    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.826564    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.833028    2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.833045    2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833093    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833098    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833103    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833106    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833110    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833113    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833116    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833118    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833121    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833124    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833127    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833129    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:13:16.224585 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833132    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833135    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833139    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833143    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833146    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833149    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833152    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833155    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833157    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833161    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833164    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833166    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833169    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833172    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833175    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833177    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833180    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833183    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833185    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:13:16.225392 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833189    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833192    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833195    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833199    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833203    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833207    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833210    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833213    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833216    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833219    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833222    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833224    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833236    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833239    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833242    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833245    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833247    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833251    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833255    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:13:16.225982 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833258    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833261    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833263    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833266    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833269    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833272    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833274    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833277    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833280    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833283    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833286    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833288    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833291    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833294    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833297    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833300    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833303    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833305    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833308    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833310    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:13:16.509536 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833313    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833315    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833318    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833320    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833323    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833325    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833328    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833330    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833334    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833336    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833339    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833345    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833348    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833350    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833353    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.833355    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:13:16.510919 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.833361    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835953    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835976    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835980    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835984    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835987    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835992    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835995    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.835997    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836000    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836007    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836009    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836012    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836015    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836018    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836020    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836023    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836028    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836031    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836034    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:13:16.512114 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836037    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836039    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836042    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836047    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836050    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836053    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836055    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836058    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836061    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836063    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836066    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836069    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836072    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836075    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836091    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836097    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836099    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836102    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836106    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:13:16.512800 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836109    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836113    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836119    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836122    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836125    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836129    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836131    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836134    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836137    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836142    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836146    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836149    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836152    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836154    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836157    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836160    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836163    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836165    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836168    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836170    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:13:16.513332 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836173    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836176    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836181    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836184    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836186    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836189    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836191    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836195    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836212    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836215    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836218    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836222    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836224    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836231    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836239    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836242    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836246    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836249    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836252    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:13:16.760083 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836255    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836258    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836275    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836397    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836404    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836407    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836410    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836413    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:15.836416    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.836422    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.837314    2573 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.839460    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.840592    2573 server.go:1019] "Starting client certificate rotation"
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.840689    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:13:16.760908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.840724    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.865464    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.869707    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.887317    2573 log.go:25] "Validated CRI v1 runtime API"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.893582    2573 log.go:25] "Validated CRI v1 image API"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.895636    2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.898720    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.901783    2573 fs.go:135] Filesystem UUIDs: map[19551fdb-3347-4ff7-8542-eb414a2ba3ec:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 924b6153-8f6b-4c16-984e-888f66f192d6:/dev/nvme0n1p4]
May 21 18:13:16.761970 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.901798    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.906565    2573 manager.go:217] Machine: {Timestamp:2026-05-21 18:13:15.906042947 +0000 UTC m=+0.454861545 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099862 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22ad256b706f4f2b6aa420b9f8b413 SystemUUID:ec22ad25-6b70-6f4f-2b6a-a420b9f8b413 BootID:268e5a8d-a66a-4608-8f71-256fe7ffd6a0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:88:da:00:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:88:da:00:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:f5:89:60:96:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.907272    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.907353    2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.908456    2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.908483    2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-212.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.908938    2573 topology_manager.go:138] "Creating topology manager with none policy"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.908956    2573 container_manager_linux.go:306] "Creating device plugin manager"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.908979    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.909674    2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.911853    2573 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.911979    2573 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.915450    2573 kubelet.go:491] "Attempting to sync node with API server"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.915462    2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.915477    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.915487    2573 kubelet.go:397] "Adding apiserver pod source"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.915496    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.916784    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:13:16.763050 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.916805    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.920129    2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.922199    2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.923985    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924003    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924011    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924022    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924038    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924046    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924054    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924059    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924068    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924076    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924084    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924092    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924819    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.924829    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.928055    2573 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.928110    2573 server.go:1295] "Started kubelet"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.928143    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.928253    2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.928400    2573 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.929730    2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-212.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.929798    2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.929852    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.929865    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.931156    2573 server.go:317] "Adding debug handlers to kubelet server"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.934201    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-212.ec2.internal.18b1a73a232bb6b3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-212.ec2.internal,UID:ip-10-0-143-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-212.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.928065715 +0000 UTC m=+0.476884318,LastTimestamp:2026-05-21 18:13:15.928065715 +0000 UTC m=+0.476884318,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-212.ec2.internal,}"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.936957    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.937459    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.937931    2573 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.937943    2573 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.938030    2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.938091    2573 reconstruct.go:97] "Volume reconstruction finished"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.938097    2573 reconciler.go:26] "Reconciler: start to sync state"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.938488    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939058    2573 factory.go:55] Registering systemd factory
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939069    2573 factory.go:223] Registration of the systemd container factory successfully
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.938558    2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939597    2573 factory.go:153] Registering CRI-O factory
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939620    2573 factory.go:223] Registration of the crio container factory successfully
May 21 18:13:16.764639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939670    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939686    2573 factory.go:103] Registering Raw factory
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.939700    2573 manager.go:1196] Started watching for new ooms in manager
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.940877    2573 manager.go:319] Starting recovery of all containers
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.951954    2573 manager.go:324] Recovery completed
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.952772    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-212.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.952840    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.957649    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.959485    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.959519    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.959532    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.960096    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.960112    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.960133    2573 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.961412    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-212.ec2.internal.18b1a73a250b66fa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-212.ec2.internal,UID:ip-10-0-143-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-212.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-212.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.959502586 +0000 UTC m=+0.508321186,LastTimestamp:2026-05-21 18:13:15.959502586 +0000 UTC m=+0.508321186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-212.ec2.internal,}"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.962940    2573 policy_none.go:49] "None policy: Start"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.962964    2573 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.962980    2573 state_mem.go:35] "Initializing new in-memory state store"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.968868    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-212.ec2.internal.18b1a73a250bc0a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-212.ec2.internal,UID:ip-10-0-143-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-212.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-212.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.959525537 +0000 UTC m=+0.508344139,LastTimestamp:2026-05-21 18:13:15.959525537 +0000 UTC m=+0.508344139,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-212.ec2.internal,}"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.981259    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-212.ec2.internal.18b1a73a250bf12c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-212.ec2.internal,UID:ip-10-0-143-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-212.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-212.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.959537964 +0000 UTC m=+0.508356566,LastTimestamp:2026-05-21 18:13:15.959537964 +0000 UTC m=+0.508356566,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-212.ec2.internal,}"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.996956    2573 manager.go:341] "Starting Device Plugin manager"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.996988    2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.996998    2573 server.go:85] "Starting device plugin registration server"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.997236    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.997247    2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.997320    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.997384    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 18:13:16.766240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:15.997390    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.998230    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:15.998267    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.008747    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-212.ec2.internal.18b1a73a2768a9a4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-212.ec2.internal,UID:ip-10-0-143-212.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-212.ec2.internal,},FirstTimestamp:2026-05-21 18:13:15.999168932 +0000 UTC m=+0.547987523,LastTimestamp:2026-05-21 18:13:15.999168932 +0000 UTC m=+0.547987523,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-212.ec2.internal,}"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.023178    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nctnq"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.031840    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nctnq"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.043881    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.045073    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.045089    2573 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.045109    2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.045118    2573 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.045222    2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.056929    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.097948    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.098972    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.099002    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.099011    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.099036    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-212.ec2.internal"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.111341    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-212.ec2.internal"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.111365    2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-212.ec2.internal\": node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.136036    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.145521    2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"]
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.145591    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.146444    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.146468    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.146478    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148115    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148242    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148275    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148771    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148783    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148801    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148816    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148803    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.148882    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.767293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.150250    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.150276    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.151521    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.151542    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.151555    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeHasSufficientPID"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.178213    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-212.ec2.internal\" not found" node="ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.183003    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-212.ec2.internal\" not found" node="ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.236832    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.239969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.239991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.240009    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b01b9b61a0c59290285bf57aa48a1d46-config\") pod \"kube-apiserver-proxy-ip-10-0-143-212.ec2.internal\" (UID: \"b01b9b61a0c59290285bf57aa48a1d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.337829    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341102    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b01b9b61a0c59290285bf57aa48a1d46-config\") pod \"kube-apiserver-proxy-ip-10-0-143-212.ec2.internal\" (UID: \"b01b9b61a0c59290285bf57aa48a1d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341131    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341152    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341183    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341191    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b01b9b61a0c59290285bf57aa48a1d46-config\") pod \"kube-apiserver-proxy-ip-10-0-143-212.ec2.internal\" (UID: \"b01b9b61a0c59290285bf57aa48a1d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.341219    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0ccdc1fb82bf683a68c723b1425d29-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal\" (UID: \"ae0ccdc1fb82bf683a68c723b1425d29\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.438546    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.481831    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.485655    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.539320    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.639742    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.768721 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.740269    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.792538 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.792513    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:16.840499 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.840469    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 18:13:16.840499 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.840474    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.840671 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.840614    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:13:16.840671 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.840614    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:13:16.937376 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.937346    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 18:13:16.941298 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:16.941276    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:16.953260 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:16.953237    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:13:17.034368 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.034287    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:08:16 +0000 UTC" deadline="2027-11-28 14:03:11.14008139 +0000 UTC"
May 21 18:13:17.034368 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.034322    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13339h49m54.105762591s"
May 21 18:13:17.042116 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:17.042090    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:17.058299 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.058273    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-967jt"
May 21 18:13:17.066896 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.066873    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-967jt"
May 21 18:13:17.097621 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:17.097459    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0ccdc1fb82bf683a68c723b1425d29.slice/crio-3da93cbd7ef606f7fc0245964cd24a082af7aa0f95ac595956e275c7a88c3557 WatchSource:0}: Error finding container 3da93cbd7ef606f7fc0245964cd24a082af7aa0f95ac595956e275c7a88c3557: Status 404 returned error can't find the container with id 3da93cbd7ef606f7fc0245964cd24a082af7aa0f95ac595956e275c7a88c3557
May 21 18:13:17.097882 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:17.097867    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01b9b61a0c59290285bf57aa48a1d46.slice/crio-75878495f370d028ac2c379a54a18c8e5399065e1e51f230e431e75028a8e5d7 WatchSource:0}: Error finding container 75878495f370d028ac2c379a54a18c8e5399065e1e51f230e431e75028a8e5d7: Status 404 returned error can't find the container with id 75878495f370d028ac2c379a54a18c8e5399065e1e51f230e431e75028a8e5d7
May 21 18:13:17.101516 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.101499    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:13:17.142797 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:17.142764    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:17.242976 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:17.242940    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-212.ec2.internal\" not found"
May 21 18:13:17.244799 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.244781    2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:17.251288 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.251272    2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:17.338522 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.338418    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal"
May 21 18:13:17.355040 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.355016    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:13:17.355162 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.355121    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"
May 21 18:13:17.363487 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.363471    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:13:17.916206 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.916175    2573 apiserver.go:52] "Watching apiserver"
May 21 18:13:17.927177 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.927152    2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 18:13:17.927580 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.927554    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb","openshift-cluster-node-tuning-operator/tuned-qn9r8","openshift-dns/node-resolver-j7ljj","openshift-multus/multus-2z6pj","openshift-multus/network-metrics-daemon-cm8sn","openshift-network-diagnostics/network-check-target-k7c4k","openshift-network-operator/iptables-alerter-lgg89","kube-system/konnectivity-agent-ktf6t","openshift-image-registry/node-ca-6562x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal","openshift-multus/multus-additional-cni-plugins-kd7c8","openshift-ovn-kubernetes/ovnkube-node-6qm47","kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal"]
May 21 18:13:17.929161 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.929139    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:17.930568 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.930308    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.931608 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.931589    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 18:13:17.931727 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.931694    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:17.932197 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.932177    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rhn4h\""
May 21 18:13:17.932278 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.932225    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 18:13:17.932278 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.932234    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 18:13:17.933255 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.932920    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4lt6f\""
May 21 18:13:17.933255 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.933093    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 18:13:17.933255 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.933189    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 18:13:17.934055 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.934037    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 18:13:17.934140 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.934107    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:17.934201 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:17.934176    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:17.934263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.934238    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7kd5p\""
May 21 18:13:17.934319 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.934269    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 18:13:17.936217 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.936053    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.938001 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.937571    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:17.938001 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:17.937644    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:17.938979 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.938726    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 18:13:17.938979 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.938726    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g7bhq\""
May 21 18:13:17.938979 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.938749    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 18:13:17.939157 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.938980    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 18:13:17.939157 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.939002    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 18:13:17.940073 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.939778    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.941174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.941153    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:17.942152 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.942132    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 18:13:17.942571 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.942205    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 18:13:17.942571 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.942317    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 18:13:17.942571 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.942416    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pskrn\""
May 21 18:13:17.943639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.943613    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 18:13:17.944692 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.944675    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:17.945288 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.945269    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:17.945561 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.945540    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4r8nq\""
May 21 18:13:17.947254 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.946880    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 18:13:17.947648 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.947566    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 18:13:17.948020 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.947994    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:17.948411 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.948391    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 18:13:17.949506 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949377    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-cnibin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgw8\" (UniqueName: \"kubernetes.io/projected/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-kube-api-access-4jgw8\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949854    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hwvp9\""
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949875    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-run\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-tmp\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7f6a98f-e927-4a9e-9d61-420047628f67-iptables-alerter-script\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.949981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-multus\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950012    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-conf-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950045    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysconfig\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-kubernetes\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-var-lib-kubelet\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.950187 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-etc-tuned\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbrfc\" (UniqueName: \"kubernetes.io/projected/1e567af8-9733-43b7-a179-6f7a46691c1d-kube-api-access-zbrfc\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950329    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-socket-dir-parent\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950367    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-kubelet\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-device-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950456    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950469    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-systemd\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skcd8\" (UniqueName: \"kubernetes.io/projected/59337285-a801-4c92-b843-630747a1145c-kube-api-access-skcd8\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-cni-binary-copy\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.950584    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951447    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jkmh\""
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-multus-certs\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-etc-kubernetes\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.951642 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951615    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-system-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-bin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951780    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qtwk\" (UniqueName: \"kubernetes.io/projected/10dc5157-386e-4845-8af7-2eaf2047445a-kube-api-access-9qtwk\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951896    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-sys\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951921    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ttvzl\""
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951944    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952015    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.951944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e567af8-9733-43b7-a179-6f7a46691c1d-tmp-dir\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-hostroot\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952144    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-daemon-config\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-registration-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952253    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952276    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-konnectivity-ca\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:17.952302 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952277    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952348    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-host\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7f6a98f-e927-4a9e-9d61-420047628f67-host-slash\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmgb\" (UniqueName: \"kubernetes.io/projected/d7f6a98f-e927-4a9e-9d61-420047628f67-kube-api-access-fjmgb\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-k8s-cni-cncf-io\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-774gh\" (UniqueName: \"kubernetes.io/projected/9060fbbe-3b62-4347-8b39-7efbae1ced53-kube-api-access-774gh\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952602    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952643    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952663    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-agent-certs\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952686    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-netns\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-socket-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-sys-fs\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952763    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-modprobe-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.953074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952832    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-conf\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.953952 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-lib-modules\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:17.953952 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-os-release\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:17.953952 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:17.952929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e567af8-9733-43b7-a179-6f7a46691c1d-hosts-file\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.040390 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.040360    2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 18:13:18.049001 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.048944    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal" event={"ID":"ae0ccdc1fb82bf683a68c723b1425d29","Type":"ContainerStarted","Data":"3da93cbd7ef606f7fc0245964cd24a082af7aa0f95ac595956e275c7a88c3557"}
May 21 18:13:18.049861 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.049836    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal" event={"ID":"b01b9b61a0c59290285bf57aa48a1d46","Type":"ContainerStarted","Data":"75878495f370d028ac2c379a54a18c8e5399065e1e51f230e431e75028a8e5d7"}
May 21 18:13:18.054004 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.053979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-kubelet\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-systemd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054046    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.054119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054070    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-774gh\" (UniqueName: \"kubernetes.io/projected/9060fbbe-3b62-4347-8b39-7efbae1ced53-kube-api-access-774gh\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.054119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054094    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.054119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054118    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-agent-certs\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054142    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjl4p\" (UniqueName: \"kubernetes.io/projected/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-kube-api-access-fjl4p\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054209    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-socket-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054236    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-conf\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054245    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qz6v\" (UniqueName: \"kubernetes.io/projected/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-kube-api-access-4qz6v\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.054348 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-etc-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-netd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054402    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysctl-conf\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js7dk\" (UniqueName: \"kubernetes.io/projected/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-kube-api-access-js7dk\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054488    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e567af8-9733-43b7-a179-6f7a46691c1d-hosts-file\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054488    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-socket-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054527    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-cnibin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054541    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054567    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e567af8-9733-43b7-a179-6f7a46691c1d-hosts-file\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054629    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgw8\" (UniqueName: \"kubernetes.io/projected/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-kube-api-access-4jgw8\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054657    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-tmp\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054630    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-cnibin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-netns\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.054716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054717    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7f6a98f-e927-4a9e-9d61-420047628f67-iptables-alerter-script\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054733    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-multus\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054765    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysconfig\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054822    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-var-lib-kubelet\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054849    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-etc-tuned\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054875    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-socket-dir-parent\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054978    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-kubelet\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.054981    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-sysconfig\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-host\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-serviceca\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-multus\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-var-lib-kubelet\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-bin\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovn-node-metrics-cert\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-script-lib\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055232 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055231    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-cni-binary-copy\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055266    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055310    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7f6a98f-e927-4a9e-9d61-420047628f67-iptables-alerter-script\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055350    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-var-lib-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055383    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055411    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-system-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055454    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-bin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055501    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-sys\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-node-log\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-config\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-env-overrides\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055686    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-hostroot\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055717    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-daemon-config\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-slash\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055815    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7f6a98f-e927-4a9e-9d61-420047628f67-host-slash\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.055987 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055843    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmgb\" (UniqueName: \"kubernetes.io/projected/d7f6a98f-e927-4a9e-9d61-420047628f67-kube-api-access-fjmgb\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055870    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-k8s-cni-cncf-io\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055903    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055929    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-modprobe-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-log-socket\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055989    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-cni-binary-copy\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.055995    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-netns\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056046    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-netns\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056079    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-sys-fs\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056111    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-lib-modules\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056162    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-os-release\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056200    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-run\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056257    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-conf-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-daemon-config\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056283    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-kubernetes\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056336    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-kubernetes\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-k8s-cni-cncf-io\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056364    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-skcd8\" (UniqueName: \"kubernetes.io/projected/59337285-a801-4c92-b843-630747a1145c-kube-api-access-skcd8\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.056726 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-systemd-units\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056444    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-sys-fs\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056463    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-ovn\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056529    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbrfc\" (UniqueName: \"kubernetes.io/projected/1e567af8-9733-43b7-a179-6f7a46691c1d-kube-api-access-zbrfc\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-lib-modules\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056532    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-modprobe-d\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7f6a98f-e927-4a9e-9d61-420047628f67-host-slash\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056568    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-device-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056597    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-systemd\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cnibin\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056631    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-run\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056654    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-multus-certs\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056687    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-etc-kubernetes\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056674    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-conf-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.057577 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-os-release\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-etc-systemd\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056820    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-run-multus-certs\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056853    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-device-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056901    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-system-cni-dir\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-hostroot\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.056951    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-kubelet\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057066    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-host-var-lib-cni-bin\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057099    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-sys\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-multus-socket-dir-parent\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057109    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9060fbbe-3b62-4347-8b39-7efbae1ced53-etc-kubernetes\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057163    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qtwk\" (UniqueName: \"kubernetes.io/projected/10dc5157-386e-4845-8af7-2eaf2047445a-kube-api-access-9qtwk\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-system-cni-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-os-release\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057380    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e567af8-9733-43b7-a179-6f7a46691c1d-tmp-dir\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057452    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057512    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-registration-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057538    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-konnectivity-ca\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:18.058271 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057588    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-host\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.057754    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057776    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e567af8-9733-43b7-a179-6f7a46691c1d-tmp-dir\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.057827    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:18.557792543 +0000 UTC m=+3.106611144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.057866    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10dc5157-386e-4845-8af7-2eaf2047445a-registration-dir\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.058102    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59337285-a801-4c92-b843-630747a1145c-host\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.058109    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-tmp\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.059026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.058364    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-konnectivity-ca\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:18.059258 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.059126    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772-agent-certs\") pod \"konnectivity-agent-ktf6t\" (UID: \"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772\") " pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:18.059572 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.059507    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/59337285-a801-4c92-b843-630747a1145c-etc-tuned\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.063750 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.063726    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:18.063849 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.063765    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:18.063849 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.063789    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:18.063960 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.063884    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:18.563858269 +0000 UTC m=+3.112676868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.067634    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:17 +0000 UTC" deadline="2028-01-15 16:04:23.622088808 +0000 UTC"
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.067658    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-774gh\" (UniqueName: \"kubernetes.io/projected/9060fbbe-3b62-4347-8b39-7efbae1ced53-kube-api-access-774gh\") pod \"multus-2z6pj\" (UID: \"9060fbbe-3b62-4347-8b39-7efbae1ced53\") " pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.067664    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14493h51m5.554429001s"
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.068106    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgw8\" (UniqueName: \"kubernetes.io/projected/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-kube-api-access-4jgw8\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.068142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qtwk\" (UniqueName: \"kubernetes.io/projected/10dc5157-386e-4845-8af7-2eaf2047445a-kube-api-access-9qtwk\") pod \"aws-ebs-csi-driver-node-p6jrb\" (UID: \"10dc5157-386e-4845-8af7-2eaf2047445a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.068174 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.068167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmgb\" (UniqueName: \"kubernetes.io/projected/d7f6a98f-e927-4a9e-9d61-420047628f67-kube-api-access-fjmgb\") pod \"iptables-alerter-lgg89\" (UID: \"d7f6a98f-e927-4a9e-9d61-420047628f67\") " pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.069069 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.068887    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbrfc\" (UniqueName: \"kubernetes.io/projected/1e567af8-9733-43b7-a179-6f7a46691c1d-kube-api-access-zbrfc\") pod \"node-resolver-j7ljj\" (UID: \"1e567af8-9733-43b7-a179-6f7a46691c1d\") " pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.070136 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.070111    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skcd8\" (UniqueName: \"kubernetes.io/projected/59337285-a801-4c92-b843-630747a1145c-kube-api-access-skcd8\") pod \"tuned-qn9r8\" (UID: \"59337285-a801-4c92-b843-630747a1145c\") " pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.157995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157883    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-systemd-units\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.157995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157919    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-ovn\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.157995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157937    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.157995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157962    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cnibin\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.157995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157993    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.157991    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-systemd-units\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158010    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-ovn\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158021    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-system-cni-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158022    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cnibin\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158057    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-os-release\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158071    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158089    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-kubelet\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-system-cni-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158104    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-systemd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-systemd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158150    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-os-release\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158155    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjl4p\" (UniqueName: \"kubernetes.io/projected/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-kube-api-access-fjl4p\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158165    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-kubelet\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158193    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qz6v\" (UniqueName: \"kubernetes.io/projected/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-kube-api-access-4qz6v\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158215    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158232    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-etc-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.158336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158264    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-etc-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158280    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-netd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158312    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-js7dk\" (UniqueName: \"kubernetes.io/projected/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-kube-api-access-js7dk\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158344    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-netns\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158370    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-netd\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158378    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-host\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158413    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-netns\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158436    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-host\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158454    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-serviceca\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158475    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158490    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-bin\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158526    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovn-node-metrics-cert\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158634    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-script-lib\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158672    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158684    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158710    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-var-lib-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159134 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158755    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-var-lib-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158780    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-cni-bin\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158808    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158835    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158857    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-node-log\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158879    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-config\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158900    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158923    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-env-overrides\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-serviceca\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158938    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158953    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-slash\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158988    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-run-openvswitch\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158993    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-host-slash\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.158999    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-log-socket\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159005    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159021    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-node-log\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159062    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-log-socket\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159227    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-script-lib\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.159835 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159368    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovnkube-config\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.160501 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.159375    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-env-overrides\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.161394 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.161373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-ovn-node-metrics-cert\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.167293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.167268    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qz6v\" (UniqueName: \"kubernetes.io/projected/b43dc239-9ad2-41bf-a1c2-14dd188ed3f1-kube-api-access-4qz6v\") pod \"node-ca-6562x\" (UID: \"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1\") " pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.167416 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.167400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjl4p\" (UniqueName: \"kubernetes.io/projected/b59fce9a-fff5-4a41-8cef-4f4a83f222cd-kube-api-access-fjl4p\") pod \"multus-additional-cni-plugins-kd7c8\" (UID: \"b59fce9a-fff5-4a41-8cef-4f4a83f222cd\") " pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.167502 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.167484    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js7dk\" (UniqueName: \"kubernetes.io/projected/7cd38dce-e6cd-4a14-b6d6-6480d1b2c468-kube-api-access-js7dk\") pod \"ovnkube-node-6qm47\" (UID: \"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.244558 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.244522    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgg89"
May 21 18:13:18.256418 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.256390    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qn9r8"
May 21 18:13:18.270925 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.270903    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6562x"
May 21 18:13:18.277588 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.277440    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7ljj"
May 21 18:13:18.284129 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.284115    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2z6pj"
May 21 18:13:18.292696 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.292678    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb"
May 21 18:13:18.300215 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.300192    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:18.306725 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.306709    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kd7c8"
May 21 18:13:18.312325 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.312307    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:18.330623 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.330602    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:18.561266 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.561176    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:18.561453 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.561332    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:18.561453 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.561402    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:19.561385286 +0000 UTC m=+4.110203879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:18.662463 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:18.662415    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:18.662630 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.662615    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:18.662694 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.662639    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:18.662694 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.662652    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:18.662788 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:18.662716    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:19.662696804 +0000 UTC m=+4.211515393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:18.845903 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.845866    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd38dce_e6cd_4a14_b6d6_6480d1b2c468.slice/crio-274239124e3220be9924754679c16b88270720f3b3f1f32c599bdbb0a2b24331 WatchSource:0}: Error finding container 274239124e3220be9924754679c16b88270720f3b3f1f32c599bdbb0a2b24331: Status 404 returned error can't find the container with id 274239124e3220be9924754679c16b88270720f3b3f1f32c599bdbb0a2b24331
May 21 18:13:18.847900 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.847837    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9060fbbe_3b62_4347_8b39_7efbae1ced53.slice/crio-2c8cd5ef39912b82bd905a8c9a518cdd71fae30ce09bbe54f24fc0362966648c WatchSource:0}: Error finding container 2c8cd5ef39912b82bd905a8c9a518cdd71fae30ce09bbe54f24fc0362966648c: Status 404 returned error can't find the container with id 2c8cd5ef39912b82bd905a8c9a518cdd71fae30ce09bbe54f24fc0362966648c
May 21 18:13:18.852874 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.852792    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43dc239_9ad2_41bf_a1c2_14dd188ed3f1.slice/crio-44d780c02676df5b00af7d12cb0781a15333742aaf141f51c26cb25b3bec5d9d WatchSource:0}: Error finding container 44d780c02676df5b00af7d12cb0781a15333742aaf141f51c26cb25b3bec5d9d: Status 404 returned error can't find the container with id 44d780c02676df5b00af7d12cb0781a15333742aaf141f51c26cb25b3bec5d9d
May 21 18:13:18.853280 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.853257    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6bf68a_2523_4d9f_9a5f_33dcaa2fb772.slice/crio-194bc0229a33d602642e928dfcc212538fd68e8d209ea0a9607c7bedf734f0b1 WatchSource:0}: Error finding container 194bc0229a33d602642e928dfcc212538fd68e8d209ea0a9607c7bedf734f0b1: Status 404 returned error can't find the container with id 194bc0229a33d602642e928dfcc212538fd68e8d209ea0a9607c7bedf734f0b1
May 21 18:13:18.854828 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.854797    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59fce9a_fff5_4a41_8cef_4f4a83f222cd.slice/crio-c757286c448bcdf49a5950d30dd86a983d4cb4891afbdc45972420d125b7afe8 WatchSource:0}: Error finding container c757286c448bcdf49a5950d30dd86a983d4cb4891afbdc45972420d125b7afe8: Status 404 returned error can't find the container with id c757286c448bcdf49a5950d30dd86a983d4cb4891afbdc45972420d125b7afe8
May 21 18:13:18.856111 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.856087    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e567af8_9733_43b7_a179_6f7a46691c1d.slice/crio-bd00afc4ec4a50b42f894de0ad7b792280c68b774ffd4a85732d548c29b7e053 WatchSource:0}: Error finding container bd00afc4ec4a50b42f894de0ad7b792280c68b774ffd4a85732d548c29b7e053: Status 404 returned error can't find the container with id bd00afc4ec4a50b42f894de0ad7b792280c68b774ffd4a85732d548c29b7e053
May 21 18:13:18.857233 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.857196    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f6a98f_e927_4a9e_9d61_420047628f67.slice/crio-867c2b2c909ffc49941ecc788aa3b1864dfbab72b9d2c8c73a812703df9bf87e WatchSource:0}: Error finding container 867c2b2c909ffc49941ecc788aa3b1864dfbab72b9d2c8c73a812703df9bf87e: Status 404 returned error can't find the container with id 867c2b2c909ffc49941ecc788aa3b1864dfbab72b9d2c8c73a812703df9bf87e
May 21 18:13:18.857641 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.857620    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59337285_a801_4c92_b843_630747a1145c.slice/crio-d63ed67d9e5c865729b66730bfc7b2b74a69961f95b5562193afa76277655031 WatchSource:0}: Error finding container d63ed67d9e5c865729b66730bfc7b2b74a69961f95b5562193afa76277655031: Status 404 returned error can't find the container with id d63ed67d9e5c865729b66730bfc7b2b74a69961f95b5562193afa76277655031
May 21 18:13:18.858789 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:18.858758    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dc5157_386e_4845_8af7_2eaf2047445a.slice/crio-8241ed3cb193f207dc9f585b2df7df7b4663ec8707af1c2620f92a64ab10df88 WatchSource:0}: Error finding container 8241ed3cb193f207dc9f585b2df7df7b4663ec8707af1c2620f92a64ab10df88: Status 404 returned error can't find the container with id 8241ed3cb193f207dc9f585b2df7df7b4663ec8707af1c2620f92a64ab10df88
May 21 18:13:19.045625 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.045593    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:19.045990 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.045593    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:19.045990 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.045722    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:19.045990 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.045836    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:19.052928 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.052887    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"274239124e3220be9924754679c16b88270720f3b3f1f32c599bdbb0a2b24331"}
May 21 18:13:19.053843 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.053816    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb" event={"ID":"10dc5157-386e-4845-8af7-2eaf2047445a","Type":"ContainerStarted","Data":"8241ed3cb193f207dc9f585b2df7df7b4663ec8707af1c2620f92a64ab10df88"}
May 21 18:13:19.054815 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.054779    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qn9r8" event={"ID":"59337285-a801-4c92-b843-630747a1145c","Type":"ContainerStarted","Data":"d63ed67d9e5c865729b66730bfc7b2b74a69961f95b5562193afa76277655031"}
May 21 18:13:19.055686 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.055662    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgg89" event={"ID":"d7f6a98f-e927-4a9e-9d61-420047628f67","Type":"ContainerStarted","Data":"867c2b2c909ffc49941ecc788aa3b1864dfbab72b9d2c8c73a812703df9bf87e"}
May 21 18:13:19.056597 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.056574    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7ljj" event={"ID":"1e567af8-9733-43b7-a179-6f7a46691c1d","Type":"ContainerStarted","Data":"bd00afc4ec4a50b42f894de0ad7b792280c68b774ffd4a85732d548c29b7e053"}
May 21 18:13:19.057442 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.057413    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktf6t" event={"ID":"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772","Type":"ContainerStarted","Data":"194bc0229a33d602642e928dfcc212538fd68e8d209ea0a9607c7bedf734f0b1"}
May 21 18:13:19.060345 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.060322    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6562x" event={"ID":"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1","Type":"ContainerStarted","Data":"44d780c02676df5b00af7d12cb0781a15333742aaf141f51c26cb25b3bec5d9d"}
May 21 18:13:19.061959 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.061933    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal" event={"ID":"b01b9b61a0c59290285bf57aa48a1d46","Type":"ContainerStarted","Data":"c2c0d3904ae20d43af0d170a25323ab5d62ffa79bbda8d7a324a442af138609c"}
May 21 18:13:19.062983 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.062961    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerStarted","Data":"c757286c448bcdf49a5950d30dd86a983d4cb4891afbdc45972420d125b7afe8"}
May 21 18:13:19.063877 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.063859    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2z6pj" event={"ID":"9060fbbe-3b62-4347-8b39-7efbae1ced53","Type":"ContainerStarted","Data":"2c8cd5ef39912b82bd905a8c9a518cdd71fae30ce09bbe54f24fc0362966648c"}
May 21 18:13:19.067964 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.067929    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:08:17 +0000 UTC" deadline="2028-01-05 13:15:41.975815466 +0000 UTC"
May 21 18:13:19.067964 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.067962    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14251h2m22.907858178s"
May 21 18:13:19.075033 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.074995    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-212.ec2.internal" podStartSLOduration=2.074983106 podStartE2EDuration="2.074983106s" podCreationTimestamp="2026-05-21 18:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:19.074200415 +0000 UTC m=+3.623019023" watchObservedRunningTime="2026-05-21 18:13:19.074983106 +0000 UTC m=+3.623801715"
May 21 18:13:19.570360 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.569709    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:19.570360 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.569860    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:19.570360 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.569927    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:21.569908475 +0000 UTC m=+6.118727067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:19.671545 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.670888    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:19.671545 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.671063    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:19.671545 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.671111    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:19.671545 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.671125    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:19.671545 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:19.671185    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:21.671166677 +0000 UTC m=+6.219985269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:19.866092 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:19.865818    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:13:20.080973 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:20.080937    2573 generic.go:358] "Generic (PLEG): container finished" podID="ae0ccdc1fb82bf683a68c723b1425d29" containerID="9137ba3d733b58f976d8ff722111b2c473fa0a7acf6e64ddb2800742f7175e5d" exitCode=0
May 21 18:13:20.081469 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:20.081030    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal" event={"ID":"ae0ccdc1fb82bf683a68c723b1425d29","Type":"ContainerDied","Data":"9137ba3d733b58f976d8ff722111b2c473fa0a7acf6e64ddb2800742f7175e5d"}
May 21 18:13:21.052462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.046180    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:21.052462 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.046310    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:21.052462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.046760    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:21.052462 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.046864    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:21.089802 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.089765    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal" event={"ID":"ae0ccdc1fb82bf683a68c723b1425d29","Type":"ContainerStarted","Data":"0ad20ca7994199b3292c74cd2058bd3222fb494681618c60407dae9a0b05591f"}
May 21 18:13:21.104968 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.104917    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-212.ec2.internal" podStartSLOduration=4.104900454 podStartE2EDuration="4.104900454s" podCreationTimestamp="2026-05-21 18:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:13:21.104611247 +0000 UTC m=+5.653429858" watchObservedRunningTime="2026-05-21 18:13:21.104900454 +0000 UTC m=+5.653719064"
May 21 18:13:21.586810 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.586770    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:21.587033 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.586942    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:21.587033 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.587002    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:25.586982267 +0000 UTC m=+10.135800862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:21.687482 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:21.687390    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:21.687634 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.687567    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:21.687634 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.687589    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:21.687634 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.687605    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:21.687832 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:21.687662    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:25.6876445 +0000 UTC m=+10.236463099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:23.046875 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:23.046130    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:23.046875 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:23.046263    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:23.046875 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:23.046713    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:23.046875 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:23.046830    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:25.046175 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:25.045956    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:25.046626 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.046289    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:25.046626 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:25.046381    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:25.046626 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.046538    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:25.620613 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:25.620256    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:25.620613 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.620458    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:25.620613 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.620522    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:33.620503645 +0000 UTC m=+18.169322238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:25.721596 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:25.721509    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:25.721776 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.721639    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:25.721776 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.721659    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:25.721776 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.721672    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:25.721776 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:25.721737    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:33.721716296 +0000 UTC m=+18.270534895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:27.046251 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:27.046206    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:27.046739 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:27.046336    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:27.046739 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:27.046460    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:27.046739 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:27.046569    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:28.049096 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:28.049063    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:28.049579 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:28.049180    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:29.046100 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:29.046021    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:29.046246 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:29.046159    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:30.045398 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:30.045356    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:30.045866 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:30.045489    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:31.045740 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:31.045706    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:31.046132 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:31.045828    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:32.047673 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:32.047644    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:32.047979 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:32.047738    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:33.045346 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:33.045309    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:33.045530 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.045456    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:33.674520 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:33.674480    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:33.675010 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.674617    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:33.675010 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.674674    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.674659679 +0000 UTC m=+34.223478266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:33.775303 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:33.775261    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:33.775486 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.775463    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:33.775486 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.775486    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:33.775614 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.775497    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:33.775614 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:33.775550    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:49.775535922 +0000 UTC m=+34.324354523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:34.049119 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:34.049031    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:34.049291 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:34.049148    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:35.046161 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:35.046119    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:35.046633 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:35.046267    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:36.046228 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:36.046194    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:36.046626 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:36.046301    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:37.045764 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.045621    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:37.045862 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:37.045846    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:37.117289 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.117256    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerStarted","Data":"98b1f5b056886cb4d1a93949abd8c7edfc57d2a342249689f8095ad9fa31640e"}
May 21 18:13:37.118598 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.118574    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2z6pj" event={"ID":"9060fbbe-3b62-4347-8b39-7efbae1ced53","Type":"ContainerStarted","Data":"66f1066f6aab05d386dee76d43133e31da079ba25d7deaae692748e89d458218"}
May 21 18:13:37.119793 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.119760    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"3538e9cf937d020d703f2cf8f9ef15b8d818d8f5b5e1fbfb8cbc41cc17fbf91a"}
May 21 18:13:37.120881 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.120863    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb" event={"ID":"10dc5157-386e-4845-8af7-2eaf2047445a","Type":"ContainerStarted","Data":"391b4032a7eaa5c9a43780dff1de4ef7f6ba0dff8f508ecdda65c1bb299178b5"}
May 21 18:13:37.121975 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.121954    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qn9r8" event={"ID":"59337285-a801-4c92-b843-630747a1145c","Type":"ContainerStarted","Data":"7ebcfe6b13b5433380a9e86e3e88d3a27870f11733a373e9d5e709e303820b29"}
May 21 18:13:37.123168 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.123148    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7ljj" event={"ID":"1e567af8-9733-43b7-a179-6f7a46691c1d","Type":"ContainerStarted","Data":"4a04e28d7b4bff53a32e48e7fd233c9132249a935283fcce024f688ee6f661b8"}
May 21 18:13:37.124345 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.124324    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktf6t" event={"ID":"9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772","Type":"ContainerStarted","Data":"1a7b1bb5c6e6136c60e5b922d8debe9783cfc801f5eb5966cfadf5f7276420cb"}
May 21 18:13:37.125464 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.125440    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6562x" event={"ID":"b43dc239-9ad2-41bf-a1c2-14dd188ed3f1","Type":"ContainerStarted","Data":"21442e495f5633278e1e02dc56b859377918040c740e0ba22f1f6caff8592d3e"}
May 21 18:13:37.167411 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.167358    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktf6t" podStartSLOduration=7.988212463 podStartE2EDuration="21.167339481s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.855287472 +0000 UTC m=+3.404106068" lastFinishedPulling="2026-05-21 18:13:32.034414487 +0000 UTC m=+16.583233086" observedRunningTime="2026-05-21 18:13:37.167307979 +0000 UTC m=+21.716126602" watchObservedRunningTime="2026-05-21 18:13:37.167339481 +0000 UTC m=+21.716158090"
May 21 18:13:37.193767 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.193720    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2z6pj" podStartSLOduration=3.302031826 podStartE2EDuration="21.193706392s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.850022556 +0000 UTC m=+3.398841142" lastFinishedPulling="2026-05-21 18:13:36.741697118 +0000 UTC m=+21.290515708" observedRunningTime="2026-05-21 18:13:37.193284645 +0000 UTC m=+21.742103253" watchObservedRunningTime="2026-05-21 18:13:37.193706392 +0000 UTC m=+21.742525000"
May 21 18:13:37.208281 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.208225    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6562x" podStartSLOduration=3.32404855 podStartE2EDuration="21.208207328s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.85597071 +0000 UTC m=+3.404789295" lastFinishedPulling="2026-05-21 18:13:36.740129475 +0000 UTC m=+21.288948073" observedRunningTime="2026-05-21 18:13:37.207361459 +0000 UTC m=+21.756180069" watchObservedRunningTime="2026-05-21 18:13:37.208207328 +0000 UTC m=+21.757025936"
May 21 18:13:37.228788 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.228718    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qn9r8" podStartSLOduration=3.34964019 podStartE2EDuration="21.228705894s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.860392564 +0000 UTC m=+3.409211176" lastFinishedPulling="2026-05-21 18:13:36.739458284 +0000 UTC m=+21.288276880" observedRunningTime="2026-05-21 18:13:37.228549582 +0000 UTC m=+21.777368190" watchObservedRunningTime="2026-05-21 18:13:37.228705894 +0000 UTC m=+21.777524501"
May 21 18:13:37.256516 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.256354    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7ljj" podStartSLOduration=3.376872188 podStartE2EDuration="21.256292492s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.858570586 +0000 UTC m=+3.407389184" lastFinishedPulling="2026-05-21 18:13:36.737990886 +0000 UTC m=+21.286809488" observedRunningTime="2026-05-21 18:13:37.255867232 +0000 UTC m=+21.804685841" watchObservedRunningTime="2026-05-21 18:13:37.256292492 +0000 UTC m=+21.805111100"
May 21 18:13:37.994963 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:37.994816    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 18:13:38.009080 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.008997    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:13:37.994958729Z","UUID":"b12bb57e-906b-4b41-856d-b5cd50883eb1","Handler":null,"Name":"","Endpoint":""}
May 21 18:13:38.010359 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.010341    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 18:13:38.010447 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.010365    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 18:13:38.046000 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.045979    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:38.046125 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:38.046068    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:38.128935 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.128901    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb" event={"ID":"10dc5157-386e-4845-8af7-2eaf2047445a","Type":"ContainerStarted","Data":"a6d9e2cd4ebac57d0deff8153d8d103b2ea16e64104311c34cb6d4d100692c27"}
May 21 18:13:38.130212 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.130186    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="98b1f5b056886cb4d1a93949abd8c7edfc57d2a342249689f8095ad9fa31640e" exitCode=0
May 21 18:13:38.130320 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.130265    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"98b1f5b056886cb4d1a93949abd8c7edfc57d2a342249689f8095ad9fa31640e"}
May 21 18:13:38.132703 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.132688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:13:38.133026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133005    2573 generic.go:358] "Generic (PLEG): container finished" podID="7cd38dce-e6cd-4a14-b6d6-6480d1b2c468" containerID="b66e13d95068b7c6c2f065e416ed1e5b04c3ed6a911f15be47e863ebc8f7793f" exitCode=1
May 21 18:13:38.133124 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133100    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"36a57d6fbdf9ee4b6728d52c332e7d88de1e3ecf6dda4028c641332b2b29fe65"}
May 21 18:13:38.133176 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133135    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"2c10c001051a5f8b5f532cff29d48c049b9bf4efa68a28a69a0e77c69bb8fccb"}
May 21 18:13:38.133176 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133160    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"6ec3406153742d360e5ca376fad2f60393b8910274407d5139dd1d081469bcd6"}
May 21 18:13:38.133176 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133172    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"4da946db64fff52b0085985e1652010aad71d9851cfb06be1f3c1fb7109c1253"}
May 21 18:13:38.133292 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:38.133184    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerDied","Data":"b66e13d95068b7c6c2f065e416ed1e5b04c3ed6a911f15be47e863ebc8f7793f"}
May 21 18:13:39.030598 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.030560    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:39.031261 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.031239    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:39.045320 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.045302    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:39.045451 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:39.045418    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:39.136730 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.136669    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgg89" event={"ID":"d7f6a98f-e927-4a9e-9d61-420047628f67","Type":"ContainerStarted","Data":"2d6497807ec09ba0e1ae9f4081039b73eae80a3fbfeace5ef8f83d2738bb47f8"}
May 21 18:13:39.138618 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.138586    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb" event={"ID":"10dc5157-386e-4845-8af7-2eaf2047445a","Type":"ContainerStarted","Data":"07dd4d1cee784652dcc1de6a43762f47f1dde57fc8c848c2e42bce1faa24cdb1"}
May 21 18:13:39.169009 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.168956    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6jrb" podStartSLOduration=3.07676777 podStartE2EDuration="23.168938094s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.860886501 +0000 UTC m=+3.409705091" lastFinishedPulling="2026-05-21 18:13:38.953056828 +0000 UTC m=+23.501875415" observedRunningTime="2026-05-21 18:13:39.16852062 +0000 UTC m=+23.717339229" watchObservedRunningTime="2026-05-21 18:13:39.168938094 +0000 UTC m=+23.717756703"
May 21 18:13:39.169321 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:39.169289    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lgg89" podStartSLOduration=5.291308064 podStartE2EDuration="23.16928186s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.859765675 +0000 UTC m=+3.408584261" lastFinishedPulling="2026-05-21 18:13:36.737739464 +0000 UTC m=+21.286558057" observedRunningTime="2026-05-21 18:13:39.150459081 +0000 UTC m=+23.699277689" watchObservedRunningTime="2026-05-21 18:13:39.16928186 +0000 UTC m=+23.718100470"
May 21 18:13:40.045791 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:40.045760    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:40.045960 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:40.045897    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:40.143597 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:40.143570    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:13:40.144100 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:40.143987    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 18:13:40.144100 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:40.143999    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"4373076a8e92f23b7500cc9ab442feb9ed536703431477f0b11a48bcbb9e8704"}
May 21 18:13:41.045467 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:41.045438    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:41.045640 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:41.045567    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:42.046790 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.046586    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:42.047215 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:42.047045    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:42.150176 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.150115    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerStarted","Data":"84c82019d46be61d712bfd9de09992020193f6cd818a7bc4ab4237178771cbfa"}
May 21 18:13:42.153472 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.153449    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:13:42.153882 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.153853    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"e2b27ad3401f70a9ea83f1a0f07886b0e1e1649b0fe81604fb852ced74413146"}
May 21 18:13:42.154190 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.154171    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:42.154269 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.154214    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:42.154269 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.154228    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:42.154362 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.154339    2573 scope.go:117] "RemoveContainer" containerID="b66e13d95068b7c6c2f065e416ed1e5b04c3ed6a911f15be47e863ebc8f7793f"
May 21 18:13:42.174688 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.174664    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:42.174816 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:42.174760    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:13:43.038306 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.038275    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:43.038462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.038395    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 18:13:43.038969 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.038948    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktf6t"
May 21 18:13:43.045827 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.045810    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:43.045937 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:43.045919    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:43.157891 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.157867    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:13:43.158298 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.158203    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" event={"ID":"7cd38dce-e6cd-4a14-b6d6-6480d1b2c468","Type":"ContainerStarted","Data":"3e09336907da7d8a28f8849dadc7578580b90ddc5eebd34840cdde5ea18a6574"}
May 21 18:13:43.159673 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.159647    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="84c82019d46be61d712bfd9de09992020193f6cd818a7bc4ab4237178771cbfa" exitCode=0
May 21 18:13:43.159802 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.159733    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"84c82019d46be61d712bfd9de09992020193f6cd818a7bc4ab4237178771cbfa"}
May 21 18:13:43.185443 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.185131    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47" podStartSLOduration=9.233639064 podStartE2EDuration="27.185118702s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.848147733 +0000 UTC m=+3.396966336" lastFinishedPulling="2026-05-21 18:13:36.799627386 +0000 UTC m=+21.348445974" observedRunningTime="2026-05-21 18:13:43.183362572 +0000 UTC m=+27.732181172" watchObservedRunningTime="2026-05-21 18:13:43.185118702 +0000 UTC m=+27.733937346"
May 21 18:13:43.975290 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.975048    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cm8sn"]
May 21 18:13:43.975450 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.975402    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:43.975546 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:43.975516    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:43.977914 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.977894    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7c4k"]
May 21 18:13:43.978063 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:43.977983    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:43.978122 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:43.978057    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:44.163387 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:44.163354    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="fd10f2297be13a4995ece6df4a81942ce444cc2f856e78bef59e65d7fba94837" exitCode=0
May 21 18:13:44.163903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:44.163451    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"fd10f2297be13a4995ece6df4a81942ce444cc2f856e78bef59e65d7fba94837"}
May 21 18:13:45.167154 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:45.167119    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="684b9533a42cf787cb6bf2a7b942f6ba90b5a667938975d1ba7c8105204c0623" exitCode=0
May 21 18:13:45.167564 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:45.167160    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"684b9533a42cf787cb6bf2a7b942f6ba90b5a667938975d1ba7c8105204c0623"}
May 21 18:13:46.047151 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:46.047116    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:46.047314 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:46.047237    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:46.047378 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:46.047361    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:46.047508 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:46.047477    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:48.046100 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:48.046065    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:48.046796 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:48.046192    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:13:48.046796 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:48.046235    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:48.046796 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:48.046330    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-k7c4k" podUID="398cc28c-3f3b-46ce-b201-1a5efe0980c4"
May 21 18:13:49.696192 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.695932    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:49.696192 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.696129    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:49.696710 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.696218    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.696196258 +0000 UTC m=+66.245014851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:13:49.748153 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.748128    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-212.ec2.internal" event="NodeReady"
May 21 18:13:49.748310 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.748271    2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 18:13:49.790251 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.790220    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s8jd4"]
May 21 18:13:49.792938 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.792917    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.793068 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.792998    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jkkwr"]
May 21 18:13:49.795173 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.795156    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:49.795651 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.795632    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\""
May 21 18:13:49.795770 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.795652    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 18:13:49.795951 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.795933    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 18:13:49.796650 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.796609    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:49.796759 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.796719    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:13:49.796759 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.796735    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:13:49.796759 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.796747    2573 projected.go:194] Error preparing data for projected volume kube-api-access-jp9l5 for pod openshift-network-diagnostics/network-check-target-k7c4k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:49.796895 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.796803    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5 podName:398cc28c-3f3b-46ce-b201-1a5efe0980c4 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.796786322 +0000 UTC m=+66.345604918 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jp9l5" (UniqueName: "kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5") pod "network-check-target-k7c4k" (UID: "398cc28c-3f3b-46ce-b201-1a5efe0980c4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:13:49.797541 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.797522    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 18:13:49.797632 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.797575    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 18:13:49.797847 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.797828    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 18:13:49.797938 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.797830    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\""
May 21 18:13:49.802591 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.802560    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8jd4"]
May 21 18:13:49.804754 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.804728    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkkwr"]
May 21 18:13:49.897439 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897390    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:49.897606 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9gg\" (UniqueName: \"kubernetes.io/projected/7350ad5a-e1a4-4142-bf02-013532600586-kube-api-access-mq9gg\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:49.897606 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-config-volume\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.897704 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.897704 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88q7m\" (UniqueName: \"kubernetes.io/projected/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-kube-api-access-88q7m\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.897792 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.897714    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-tmp-dir\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.998582 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998464    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9gg\" (UniqueName: \"kubernetes.io/projected/7350ad5a-e1a4-4142-bf02-013532600586-kube-api-access-mq9gg\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:49.998582 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998572    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-config-volume\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998598    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998621    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88q7m\" (UniqueName: \"kubernetes.io/projected/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-kube-api-access-88q7m\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998655    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-tmp-dir\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.998720    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.998730    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:13:49.998801 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.998801    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:13:49.999136 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.998846    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:50.498812417 +0000 UTC m=+35.047631014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:13:49.999136 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:49.998865    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:50.498855791 +0000 UTC m=+35.047674384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:13:49.999136 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.999022    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-tmp-dir\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:49.999290 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:49.999261    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-config-volume\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:50.008916 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.008888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88q7m\" (UniqueName: \"kubernetes.io/projected/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-kube-api-access-88q7m\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:50.009057 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.008975    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9gg\" (UniqueName: \"kubernetes.io/projected/7350ad5a-e1a4-4142-bf02-013532600586-kube-api-access-mq9gg\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:50.046013 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.045941    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:13:50.046185 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.046160    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:13:50.049058 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.049033    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:13:50.049183 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.049105    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\""
May 21 18:13:50.049485 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.049465    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:13:50.049592 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.049510    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:13:50.049592 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.049520    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\""
May 21 18:13:50.503901 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.503862    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:50.504088 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:50.504025    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:50.504088 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:50.504032    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:13:50.504195 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:50.504108    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:51.504088884 +0000 UTC m=+36.052907470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:13:50.504195 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:50.504123    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:13:50.504195 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:50.504173    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:51.504156699 +0000 UTC m=+36.052975286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:13:51.421687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.421653    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8x9pf"]
May 21 18:13:51.439478 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.439446    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8x9pf"]
May 21 18:13:51.439641 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.439542    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.442178 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.442160    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 18:13:51.511695 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.511670    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:51.511792 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.511708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-original-pull-secret\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.511792 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.511740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-dbus\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.511871 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.511808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-kubelet-config\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.511871 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.511842    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:51.511871 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:51.511817    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:13:51.514553 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:51.512240    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:13:51.514553 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:51.512267    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:53.512233854 +0000 UTC m=+38.061052455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:13:51.514553 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:51.512317    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:53.512287753 +0000 UTC m=+38.061106343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:13:51.613098 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.613056    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-dbus\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.613098 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.613104    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-kubelet-config\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.613336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.613205    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-original-pull-secret\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.613336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.613258    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-kubelet-config\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.613336 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.613318    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-dbus\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.615596 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.615576    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/15582ef4-2ce2-43fa-a745-9caaa5d52a2f-original-pull-secret\") pod \"global-pull-secret-syncer-8x9pf\" (UID: \"15582ef4-2ce2-43fa-a745-9caaa5d52a2f\") " pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.748517 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.748437    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8x9pf"
May 21 18:13:51.900804 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:51.900774    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8x9pf"]
May 21 18:13:51.904381 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:13:51.904356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15582ef4_2ce2_43fa_a745_9caaa5d52a2f.slice/crio-e3691d0ec699c12dd4d14278beba382139b96cae0b4f6db808bf6dabc76c011c WatchSource:0}: Error finding container e3691d0ec699c12dd4d14278beba382139b96cae0b4f6db808bf6dabc76c011c: Status 404 returned error can't find the container with id e3691d0ec699c12dd4d14278beba382139b96cae0b4f6db808bf6dabc76c011c
May 21 18:13:52.182230 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:52.182197    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8x9pf" event={"ID":"15582ef4-2ce2-43fa-a745-9caaa5d52a2f","Type":"ContainerStarted","Data":"e3691d0ec699c12dd4d14278beba382139b96cae0b4f6db808bf6dabc76c011c"}
May 21 18:13:52.184506 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:52.184480    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="f5e4c09658a394c1463010ca385354307f0d619d1c00ddb98b1a36aaa854a5ae" exitCode=0
May 21 18:13:52.184633 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:52.184519    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"f5e4c09658a394c1463010ca385354307f0d619d1c00ddb98b1a36aaa854a5ae"}
May 21 18:13:53.189733 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:53.189489    2573 generic.go:358] "Generic (PLEG): container finished" podID="b59fce9a-fff5-4a41-8cef-4f4a83f222cd" containerID="b3b1d7c679f3953968009264fc1d55a9edc97e35d495b1cdd868007d583be428" exitCode=0
May 21 18:13:53.190156 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:53.189585    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerDied","Data":"b3b1d7c679f3953968009264fc1d55a9edc97e35d495b1cdd868007d583be428"}
May 21 18:13:53.528673 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:53.528641    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:53.528834 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:53.528698    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:53.528834 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:53.528789    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:13:53.528834 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:53.528792    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:13:53.528973 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:53.528847    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:57.528829775 +0000 UTC m=+42.077648375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:13:53.528973 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:53.528862    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:13:57.528855694 +0000 UTC m=+42.077674279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:13:54.194351 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:54.194315    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" event={"ID":"b59fce9a-fff5-4a41-8cef-4f4a83f222cd","Type":"ContainerStarted","Data":"b6a822f2b90937c3696c494210a8c2151857771e51e259a3ba7f8ba7fe48e59c"}
May 21 18:13:54.220079 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:54.218772    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kd7c8" podStartSLOduration=5.86708022 podStartE2EDuration="38.218754568s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:13:18.857013623 +0000 UTC m=+3.405832226" lastFinishedPulling="2026-05-21 18:13:51.208687974 +0000 UTC m=+35.757506574" observedRunningTime="2026-05-21 18:13:54.215896497 +0000 UTC m=+38.764715106" watchObservedRunningTime="2026-05-21 18:13:54.218754568 +0000 UTC m=+38.767573177"
May 21 18:13:56.200554 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:56.200511    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8x9pf" event={"ID":"15582ef4-2ce2-43fa-a745-9caaa5d52a2f","Type":"ContainerStarted","Data":"5abe83ae00993d753738dbafca8afe5d970f3e98add774227384f27ccb7e6c55"}
May 21 18:13:56.215365 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:56.215319    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8x9pf" podStartSLOduration=1.118493862 podStartE2EDuration="5.215304162s" podCreationTimestamp="2026-05-21 18:13:51 +0000 UTC" firstStartedPulling="2026-05-21 18:13:51.905912766 +0000 UTC m=+36.454731351" lastFinishedPulling="2026-05-21 18:13:56.002723065 +0000 UTC m=+40.551541651" observedRunningTime="2026-05-21 18:13:56.214701937 +0000 UTC m=+40.763520549" watchObservedRunningTime="2026-05-21 18:13:56.215304162 +0000 UTC m=+40.764122766"
May 21 18:13:57.556604 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:57.556569    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:13:57.557057 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:13:57.556616    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:13:57.557057 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:57.556720    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:13:57.557057 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:57.556747    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:13:57.557057 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:57.556784    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:05.556760768 +0000 UTC m=+50.105579355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:13:57.557057 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:13:57.556819    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:05.55680056 +0000 UTC m=+50.105619163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:14:05.615530 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:05.615491    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:14:05.616079 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:05.615543    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:14:05.616079 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:05.615629    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:14:05.616079 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:05.615635    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:14:05.616079 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:05.615678    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.615665232 +0000 UTC m=+66.164483818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:14:05.616079 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:05.615693    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:21.615684579 +0000 UTC m=+66.164503164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:14:14.179205 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:14.179178    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qm47"
May 21 18:14:21.622033 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.621993    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:14:21.622033 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.622045    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:14:21.622580 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.622145    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:14:21.622580 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.622149    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:14:21.622580 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.622208    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:53.622193884 +0000 UTC m=+98.171012469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:14:21.622580 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.622220    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:14:53.622214801 +0000 UTC m=+98.171033387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:14:21.722939 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.722905    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:14:21.725293 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.725277    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:14:21.733346 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.733330    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:14:21.733420 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:21.733386    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:25.733371693 +0000 UTC m=+130.282190280 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : secret "metrics-daemon-secret" not found
May 21 18:14:21.824064 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.824029    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:14:21.826549 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.826533    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:14:21.836713 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.836698    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:14:21.849124 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.849097    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9l5\" (UniqueName: \"kubernetes.io/projected/398cc28c-3f3b-46ce-b201-1a5efe0980c4-kube-api-access-jp9l5\") pod \"network-check-target-k7c4k\" (UID: \"398cc28c-3f3b-46ce-b201-1a5efe0980c4\") " pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:14:21.861079 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.861050    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w9qjh\""
May 21 18:14:21.869397 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:21.869382    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:14:22.003388 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:22.003302    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-k7c4k"]
May 21 18:14:22.005853 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:14:22.005823    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398cc28c_3f3b_46ce_b201_1a5efe0980c4.slice/crio-ad2ed33fe8446b8c9a6db79fd60eb458571353a41f3ee3ecdb12c97ff60302bd WatchSource:0}: Error finding container ad2ed33fe8446b8c9a6db79fd60eb458571353a41f3ee3ecdb12c97ff60302bd: Status 404 returned error can't find the container with id ad2ed33fe8446b8c9a6db79fd60eb458571353a41f3ee3ecdb12c97ff60302bd
May 21 18:14:22.251786 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:22.251700    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7c4k" event={"ID":"398cc28c-3f3b-46ce-b201-1a5efe0980c4","Type":"ContainerStarted","Data":"ad2ed33fe8446b8c9a6db79fd60eb458571353a41f3ee3ecdb12c97ff60302bd"}
May 21 18:14:24.232993 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.232953    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"]
May 21 18:14:24.236361 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.236340    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.238852 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.238827    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 18:14:24.240265 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.240136    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 18:14:24.240265 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.240139    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 18:14:24.240265 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.240173    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 18:14:24.240265 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.240252    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-b6j5w\""
May 21 18:14:24.243568 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.243542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f48bf700-a096-4636-92c3-247107dff58b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.243680 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.243592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndpbz\" (UniqueName: \"kubernetes.io/projected/f48bf700-a096-4636-92c3-247107dff58b-kube-api-access-ndpbz\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.243680 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.243650    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"]
May 21 18:14:24.245695 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.245677    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"]
May 21 18:14:24.245821 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.245770    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.248391 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.248224    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 18:14:24.248391 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.248241    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 18:14:24.248391 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.248281    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 18:14:24.248391 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.248297    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 18:14:24.257887 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.257868    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"]
May 21 18:14:24.344493 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.344679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.344679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344583    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f48bf700-a096-4636-92c3-247107dff58b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.344679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344638    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndpbz\" (UniqueName: \"kubernetes.io/projected/f48bf700-a096-4636-92c3-247107dff58b-kube-api-access-ndpbz\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.344679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.344888 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.344888 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.344888 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.344792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glnxb\" (UniqueName: \"kubernetes.io/projected/9ccaed2d-9174-4406-98b1-362ea69ddf1c-kube-api-access-glnxb\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.347723 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.347697    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f48bf700-a096-4636-92c3-247107dff58b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.353362 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.353341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndpbz\" (UniqueName: \"kubernetes.io/projected/f48bf700-a096-4636-92c3-247107dff58b-kube-api-access-ndpbz\") pod \"managed-serviceaccount-addon-agent-865bfd88cb-dcmcz\" (UID: \"f48bf700-a096-4636-92c3-247107dff58b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.445764 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445726    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.445908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445776    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.445908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445824    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.445908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445875    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.446066 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445906    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.446066 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.445936    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glnxb\" (UniqueName: \"kubernetes.io/projected/9ccaed2d-9174-4406-98b1-362ea69ddf1c-kube-api-access-glnxb\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.446733 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.446684    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.448616 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.448594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-ca\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.448885 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.448864    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.449146 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.449126    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.449437 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.449404    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9ccaed2d-9174-4406-98b1-362ea69ddf1c-hub\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.453988 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.453971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glnxb\" (UniqueName: \"kubernetes.io/projected/9ccaed2d-9174-4406-98b1-362ea69ddf1c-kube-api-access-glnxb\") pod \"cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh\" (UID: \"9ccaed2d-9174-4406-98b1-362ea69ddf1c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.557196 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.557116    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"
May 21 18:14:24.566044 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.566014    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:14:24.990931 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:24.990903    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz"]
May 21 18:14:24.993683 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:14:24.993648    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48bf700_a096_4636_92c3_247107dff58b.slice/crio-f615108b75d93dea7c37480ba34a1d14d775a61be249d358d41f2d4a32f1706c WatchSource:0}: Error finding container f615108b75d93dea7c37480ba34a1d14d775a61be249d358d41f2d4a32f1706c: Status 404 returned error can't find the container with id f615108b75d93dea7c37480ba34a1d14d775a61be249d358d41f2d4a32f1706c
May 21 18:14:25.010294 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.010273    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"]
May 21 18:14:25.013112 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:14:25.013088    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ccaed2d_9174_4406_98b1_362ea69ddf1c.slice/crio-2d390ecaacaeef7c9cb7bb7426cfb6a2b7ee9dbbd2041eac6fad2937768029ab WatchSource:0}: Error finding container 2d390ecaacaeef7c9cb7bb7426cfb6a2b7ee9dbbd2041eac6fad2937768029ab: Status 404 returned error can't find the container with id 2d390ecaacaeef7c9cb7bb7426cfb6a2b7ee9dbbd2041eac6fad2937768029ab
May 21 18:14:25.258668 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.258632    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerStarted","Data":"2d390ecaacaeef7c9cb7bb7426cfb6a2b7ee9dbbd2041eac6fad2937768029ab"}
May 21 18:14:25.259824 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.259801    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-k7c4k" event={"ID":"398cc28c-3f3b-46ce-b201-1a5efe0980c4","Type":"ContainerStarted","Data":"3d212db3c7866e80a284bfd7a0ff6f2a114acb32601d67a132454d299825bddf"}
May 21 18:14:25.259934 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.259899    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:14:25.260857 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.260832    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz" event={"ID":"f48bf700-a096-4636-92c3-247107dff58b","Type":"ContainerStarted","Data":"f615108b75d93dea7c37480ba34a1d14d775a61be249d358d41f2d4a32f1706c"}
May 21 18:14:25.275154 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:25.274986    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-k7c4k" podStartSLOduration=66.390424893 podStartE2EDuration="1m9.274972695s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:14:22.00775681 +0000 UTC m=+66.556575413" lastFinishedPulling="2026-05-21 18:14:24.892304626 +0000 UTC m=+69.441123215" observedRunningTime="2026-05-21 18:14:25.274684091 +0000 UTC m=+69.823502699" watchObservedRunningTime="2026-05-21 18:14:25.274972695 +0000 UTC m=+69.823791309"
May 21 18:14:30.273695 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:30.273657    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz" event={"ID":"f48bf700-a096-4636-92c3-247107dff58b","Type":"ContainerStarted","Data":"13d83c842894471a1c81b8469b62d1c560745450ccf02b34baf1cb6397450121"}
May 21 18:14:30.274867 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:30.274840    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerStarted","Data":"8af3e26c271cadc36d08f12316764778869f945fdf105c272d9d4220be298b89"}
May 21 18:14:30.288479 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:30.288441    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-865bfd88cb-dcmcz" podStartSLOduration=1.189332844 podStartE2EDuration="6.288415225s" podCreationTimestamp="2026-05-21 18:14:24 +0000 UTC" firstStartedPulling="2026-05-21 18:14:24.995707134 +0000 UTC m=+69.544525740" lastFinishedPulling="2026-05-21 18:14:30.094789521 +0000 UTC m=+74.643608121" observedRunningTime="2026-05-21 18:14:30.287725729 +0000 UTC m=+74.836544336" watchObservedRunningTime="2026-05-21 18:14:30.288415225 +0000 UTC m=+74.837233832"
May 21 18:14:33.283538 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:33.283502    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerStarted","Data":"b179d5badc34547c0997b5f7c9284d160b987b0a6d2f434173553f434a6b78cc"}
May 21 18:14:33.283538 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:33.283539    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerStarted","Data":"49dbadfdb3ab945023127ba01ee5d88480c7d2e69e425225816d4fce4043b7e0"}
May 21 18:14:33.300923 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:33.300877    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" podStartSLOduration=1.529081044 podStartE2EDuration="9.300863314s" podCreationTimestamp="2026-05-21 18:14:24 +0000 UTC" firstStartedPulling="2026-05-21 18:14:25.014765842 +0000 UTC m=+69.563584432" lastFinishedPulling="2026-05-21 18:14:32.786548113 +0000 UTC m=+77.335366702" observedRunningTime="2026-05-21 18:14:33.300245943 +0000 UTC m=+77.849064552" watchObservedRunningTime="2026-05-21 18:14:33.300863314 +0000 UTC m=+77.849681924"
May 21 18:14:53.648210 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:53.648156    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:14:53.648681 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:53.648230    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:14:53.648681 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:53.648314    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:14:53.648681 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:53.648352    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:14:53.648681 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:53.648376    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls podName:5ee131c5-ff5b-413e-b9fb-fcdf532034c7 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:57.648360795 +0000 UTC m=+162.197179380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls") pod "dns-default-s8jd4" (UID: "5ee131c5-ff5b-413e-b9fb-fcdf532034c7") : secret "dns-default-metrics-tls" not found
May 21 18:14:53.648681 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:14:53.648405    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert podName:7350ad5a-e1a4-4142-bf02-013532600586 nodeName:}" failed. No retries permitted until 2026-05-21 18:15:57.648388001 +0000 UTC m=+162.197206593 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert") pod "ingress-canary-jkkwr" (UID: "7350ad5a-e1a4-4142-bf02-013532600586") : secret "canary-serving-cert" not found
May 21 18:14:56.265279 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:14:56.265244    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-k7c4k"
May 21 18:15:25.763221 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:25.763173    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:15:25.763742 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:15:25.763292    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:15:25.763742 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:15:25.763354    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs podName:e69e9e6a-c6b5-4970-bc1c-c4204c3002f3 nodeName:}" failed. No retries permitted until 2026-05-21 18:17:27.763339555 +0000 UTC m=+252.312158141 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs") pod "network-metrics-daemon-cm8sn" (UID: "e69e9e6a-c6b5-4970-bc1c-c4204c3002f3") : secret "metrics-daemon-secret" not found
May 21 18:15:35.182299 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:35.182262    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7ljj_1e567af8-9733-43b7-a179-6f7a46691c1d/dns-node-resolver/0.log"
May 21 18:15:35.982749 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:35.982723    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6562x_b43dc239-9ad2-41bf-a1c2-14dd188ed3f1/node-ca/0.log"
May 21 18:15:52.807816 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:15:52.807766    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s8jd4" podUID="5ee131c5-ff5b-413e-b9fb-fcdf532034c7"
May 21 18:15:52.812920 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:15:52.812883    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jkkwr" podUID="7350ad5a-e1a4-4142-bf02-013532600586"
May 21 18:15:53.065759 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:15:53.065671    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cm8sn" podUID="e69e9e6a-c6b5-4970-bc1c-c4204c3002f3"
May 21 18:15:53.463646 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:53.463614    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:15:53.463809 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:53.463674    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8jd4"
May 21 18:15:55.351211 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.351181    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pzlch"]
May 21 18:15:55.353611 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.353588    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.357288 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.357267    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 18:15:55.357288 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.357278    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhnx6\""
May 21 18:15:55.357488 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.357416    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 18:15:55.357488 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.357459    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 18:15:55.357586 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.357570    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 18:15:55.369041 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.369022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40ebec92-b634-4813-8fad-fa6642d7c7d0-crio-socket\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.369150 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.369048    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.369150 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.369070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlcx\" (UniqueName: \"kubernetes.io/projected/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-api-access-qrlcx\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.369263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.369189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ebec92-b634-4813-8fad-fa6642d7c7d0-data-volume\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.369263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.369224    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40ebec92-b634-4813-8fad-fa6642d7c7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.370679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.370652    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pzlch"]
May 21 18:15:55.394358 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.394332    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-667794b779-5jl2b"]
May 21 18:15:55.396568 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.396550    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.399071 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.399052    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 18:15:55.399071 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.399070    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 18:15:55.399316 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.399302    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sjddb\""
May 21 18:15:55.399368 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.399316    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 18:15:55.410549 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.410527    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667794b779-5jl2b"]
May 21 18:15:55.410926 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.410908    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 18:15:55.470327 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-image-registry-private-configuration\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470508 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-installation-pull-secrets\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470508 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31a31bdb-6ce0-4e0c-a034-90441a70d832-ca-trust-extracted\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470508 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470377    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40ebec92-b634-4813-8fad-fa6642d7c7d0-crio-socket\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.470508 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470400    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.470508 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct2tb\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-kube-api-access-ct2tb\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470503    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40ebec92-b634-4813-8fad-fa6642d7c7d0-crio-socket\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.470763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-bound-sa-token\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-tls\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.470763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470670    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlcx\" (UniqueName: \"kubernetes.io/projected/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-api-access-qrlcx\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.470763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470731    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ebec92-b634-4813-8fad-fa6642d7c7d0-data-volume\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.471008 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470772    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40ebec92-b634-4813-8fad-fa6642d7c7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.471008 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-trusted-ca\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.471008 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470826    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-certificates\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.471008 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470967    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.471008 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.470984    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40ebec92-b634-4813-8fad-fa6642d7c7d0-data-volume\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.473038 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.473017    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40ebec92-b634-4813-8fad-fa6642d7c7d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.479886 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.479865    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlcx\" (UniqueName: \"kubernetes.io/projected/40ebec92-b634-4813-8fad-fa6642d7c7d0-kube-api-access-qrlcx\") pod \"insights-runtime-extractor-pzlch\" (UID: \"40ebec92-b634-4813-8fad-fa6642d7c7d0\") " pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.571099 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571067    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-image-registry-private-configuration\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571099 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571101    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-installation-pull-secrets\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571316 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571123    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31a31bdb-6ce0-4e0c-a034-90441a70d832-ca-trust-extracted\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571316 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571151    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ct2tb\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-kube-api-access-ct2tb\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571316 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571169    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-bound-sa-token\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571316 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571194    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-tls\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571550 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571357    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-trusted-ca\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.571550 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.571403    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-certificates\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.572251 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.572223    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-certificates\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.572374 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.572223    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31a31bdb-6ce0-4e0c-a034-90441a70d832-ca-trust-extracted\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.572455 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.572385    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31a31bdb-6ce0-4e0c-a034-90441a70d832-trusted-ca\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.573599 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.573582    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-installation-pull-secrets\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.573717 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.573697    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31a31bdb-6ce0-4e0c-a034-90441a70d832-image-registry-private-configuration\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.573767 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.573735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-registry-tls\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.588333 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.588313    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-bound-sa-token\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.589717 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.589696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct2tb\" (UniqueName: \"kubernetes.io/projected/31a31bdb-6ce0-4e0c-a034-90441a70d832-kube-api-access-ct2tb\") pod \"image-registry-667794b779-5jl2b\" (UID: \"31a31bdb-6ce0-4e0c-a034-90441a70d832\") " pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.662878 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.662847    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pzlch"
May 21 18:15:55.710576 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.710545    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:55.795758 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.795704    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pzlch"]
May 21 18:15:55.800033 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:15:55.800007    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ebec92_b634_4813_8fad_fa6642d7c7d0.slice/crio-126f2174f26586624a54f3aebcf95748d7bc354aeab4031a682103b096b1fc17 WatchSource:0}: Error finding container 126f2174f26586624a54f3aebcf95748d7bc354aeab4031a682103b096b1fc17: Status 404 returned error can't find the container with id 126f2174f26586624a54f3aebcf95748d7bc354aeab4031a682103b096b1fc17
May 21 18:15:55.843465 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:55.843421    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-667794b779-5jl2b"]
May 21 18:15:55.847417 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:15:55.847388    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a31bdb_6ce0_4e0c_a034_90441a70d832.slice/crio-f4661bf5a603cd3ad7955ddf99847830f0415bf27eda36a251f21fcecf57e1af WatchSource:0}: Error finding container f4661bf5a603cd3ad7955ddf99847830f0415bf27eda36a251f21fcecf57e1af: Status 404 returned error can't find the container with id f4661bf5a603cd3ad7955ddf99847830f0415bf27eda36a251f21fcecf57e1af
May 21 18:15:56.472183 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.472143    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzlch" event={"ID":"40ebec92-b634-4813-8fad-fa6642d7c7d0","Type":"ContainerStarted","Data":"ae7959cd2bdfa3df1dc3f650ff8948ff7cd85389c39c89412641a9e098aec962"}
May 21 18:15:56.472183 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.472185    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzlch" event={"ID":"40ebec92-b634-4813-8fad-fa6642d7c7d0","Type":"ContainerStarted","Data":"126f2174f26586624a54f3aebcf95748d7bc354aeab4031a682103b096b1fc17"}
May 21 18:15:56.473696 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.473669    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667794b779-5jl2b" event={"ID":"31a31bdb-6ce0-4e0c-a034-90441a70d832","Type":"ContainerStarted","Data":"3bbadbbd4896568723181c0b1ed41342ce24d610de087ddf1cc64f37840f2fc1"}
May 21 18:15:56.473862 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.473704    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-667794b779-5jl2b" event={"ID":"31a31bdb-6ce0-4e0c-a034-90441a70d832","Type":"ContainerStarted","Data":"f4661bf5a603cd3ad7955ddf99847830f0415bf27eda36a251f21fcecf57e1af"}
May 21 18:15:56.473862 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.473837    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:15:56.491476 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:56.491418    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-667794b779-5jl2b" podStartSLOduration=1.4914039190000001 podStartE2EDuration="1.491403919s" podCreationTimestamp="2026-05-21 18:15:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:15:56.490321106 +0000 UTC m=+161.039139714" watchObservedRunningTime="2026-05-21 18:15:56.491403919 +0000 UTC m=+161.040222527"
May 21 18:15:57.477755 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.477714    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzlch" event={"ID":"40ebec92-b634-4813-8fad-fa6642d7c7d0","Type":"ContainerStarted","Data":"a3db480a5d528799686e2cdef652bfb860663e1e98f76217b912c4fbc57d9916"}
May 21 18:15:57.687557 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.687522    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:15:57.687705 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.687572    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:15:57.689877 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.689852    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7350ad5a-e1a4-4142-bf02-013532600586-cert\") pod \"ingress-canary-jkkwr\" (UID: \"7350ad5a-e1a4-4142-bf02-013532600586\") " pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:15:57.689983 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.689857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ee131c5-ff5b-413e-b9fb-fcdf532034c7-metrics-tls\") pod \"dns-default-s8jd4\" (UID: \"5ee131c5-ff5b-413e-b9fb-fcdf532034c7\") " pod="openshift-dns/dns-default-s8jd4"
May 21 18:15:57.967814 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.967773    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8zgcw\""
May 21 18:15:57.968851 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.968824    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xmgqj\""
May 21 18:15:57.975465 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.975421    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jkkwr"
May 21 18:15:57.975598 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:57.975466    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8jd4"
May 21 18:15:58.321982 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.321945    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8jd4"]
May 21 18:15:58.324519 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:15:58.324489    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee131c5_ff5b_413e_b9fb_fcdf532034c7.slice/crio-22544b53e4362be577ce92485f43d052fd2670284147216bd382a4c45997fe21 WatchSource:0}: Error finding container 22544b53e4362be577ce92485f43d052fd2670284147216bd382a4c45997fe21: Status 404 returned error can't find the container with id 22544b53e4362be577ce92485f43d052fd2670284147216bd382a4c45997fe21
May 21 18:15:58.338474 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.338447    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jkkwr"]
May 21 18:15:58.340995 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:15:58.340975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7350ad5a_e1a4_4142_bf02_013532600586.slice/crio-1c8d8f17fa270f20909004944596e055aceb1158697441b6f00476a600033abe WatchSource:0}: Error finding container 1c8d8f17fa270f20909004944596e055aceb1158697441b6f00476a600033abe: Status 404 returned error can't find the container with id 1c8d8f17fa270f20909004944596e055aceb1158697441b6f00476a600033abe
May 21 18:15:58.480769 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.480684    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkkwr" event={"ID":"7350ad5a-e1a4-4142-bf02-013532600586","Type":"ContainerStarted","Data":"1c8d8f17fa270f20909004944596e055aceb1158697441b6f00476a600033abe"}
May 21 18:15:58.482326 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.482305    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pzlch" event={"ID":"40ebec92-b634-4813-8fad-fa6642d7c7d0","Type":"ContainerStarted","Data":"c0facd204d0cf15ab1a95652dd6e75ff47e52857932beb69ec05b71129db1595"}
May 21 18:15:58.483273 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.483251    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8jd4" event={"ID":"5ee131c5-ff5b-413e-b9fb-fcdf532034c7","Type":"ContainerStarted","Data":"22544b53e4362be577ce92485f43d052fd2670284147216bd382a4c45997fe21"}
May 21 18:15:58.498807 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:15:58.498769    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pzlch" podStartSLOduration=1.123320673 podStartE2EDuration="3.498756872s" podCreationTimestamp="2026-05-21 18:15:55 +0000 UTC" firstStartedPulling="2026-05-21 18:15:55.853039117 +0000 UTC m=+160.401857709" lastFinishedPulling="2026-05-21 18:15:58.228475302 +0000 UTC m=+162.777293908" observedRunningTime="2026-05-21 18:15:58.498274334 +0000 UTC m=+163.047092942" watchObservedRunningTime="2026-05-21 18:15:58.498756872 +0000 UTC m=+163.047575483"
May 21 18:16:00.490351 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.490314    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jkkwr" event={"ID":"7350ad5a-e1a4-4142-bf02-013532600586","Type":"ContainerStarted","Data":"37bb5c02b38cf2e1157ba8449da999203125f58ca8caf8a581c5977a15e58cad"}
May 21 18:16:00.491903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.491873    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8jd4" event={"ID":"5ee131c5-ff5b-413e-b9fb-fcdf532034c7","Type":"ContainerStarted","Data":"453f242c07173eea5d02542e8790ac8bf9f7ba6c3498f00e36f915ba5f05b201"}
May 21 18:16:00.491903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.491904    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8jd4" event={"ID":"5ee131c5-ff5b-413e-b9fb-fcdf532034c7","Type":"ContainerStarted","Data":"bae4e89655835531c5089391ac23860d57154dff708de43e269a053bd6ab031c"}
May 21 18:16:00.492071 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.492007    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s8jd4"
May 21 18:16:00.505396 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.505353    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jkkwr" podStartSLOduration=129.499325025 podStartE2EDuration="2m11.505341092s" podCreationTimestamp="2026-05-21 18:13:49 +0000 UTC" firstStartedPulling="2026-05-21 18:15:58.342779601 +0000 UTC m=+162.891598190" lastFinishedPulling="2026-05-21 18:16:00.348795671 +0000 UTC m=+164.897614257" observedRunningTime="2026-05-21 18:16:00.504899351 +0000 UTC m=+165.053717961" watchObservedRunningTime="2026-05-21 18:16:00.505341092 +0000 UTC m=+165.054159700"
May 21 18:16:00.520256 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:00.520204    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-s8jd4" podStartSLOduration=130.267526205 podStartE2EDuration="2m11.520188265s" podCreationTimestamp="2026-05-21 18:13:49 +0000 UTC" firstStartedPulling="2026-05-21 18:15:58.326305182 +0000 UTC m=+162.875123770" lastFinishedPulling="2026-05-21 18:15:59.57896724 +0000 UTC m=+164.127785830" observedRunningTime="2026-05-21 18:16:00.519760076 +0000 UTC m=+165.068578685" watchObservedRunningTime="2026-05-21 18:16:00.520188265 +0000 UTC m=+165.069006875"
May 21 18:16:07.046156 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:07.046067    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:16:10.348788 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.348750    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-snpk8"]
May 21 18:16:10.351544 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.351522    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.354087 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.354064    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vpjw5\""
May 21 18:16:10.355340 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355307    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 18:16:10.355340 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355333    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 18:16:10.355522 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355347    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 18:16:10.355522 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355381    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 18:16:10.355522 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355436    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 18:16:10.355634 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.355540    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 18:16:10.376601 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376694 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376613    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-metrics-client-ca\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376694 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-tls\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376766 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-sys\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376766 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-accelerators-collector-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376766 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-root\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376891 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-textfile\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376891 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzp8c\" (UniqueName: \"kubernetes.io/projected/17bf9b7a-e9c1-45e7-a573-e41f46db476d-kube-api-access-tzp8c\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.376891 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.376878    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-wtmp\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477752 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477717    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-root\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477771    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-textfile\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477799    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzp8c\" (UniqueName: \"kubernetes.io/projected/17bf9b7a-e9c1-45e7-a573-e41f46db476d-kube-api-access-tzp8c\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477821    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-wtmp\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477855    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.477903 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477902    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-metrics-client-ca\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.478164 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477966    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-tls\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.478164 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.477999    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-sys\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.478164 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.478023    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-accelerators-collector-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479276 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.478372    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-root\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479276 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.478634    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-textfile\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479276 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.478664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-accelerators-collector-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479276 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.479075    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17bf9b7a-e9c1-45e7-a573-e41f46db476d-metrics-client-ca\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479276 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.479212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-wtmp\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.479614 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.479522    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17bf9b7a-e9c1-45e7-a573-e41f46db476d-sys\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.489849 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.489830    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-tls\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.490275 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.490248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17bf9b7a-e9c1-45e7-a573-e41f46db476d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.492063 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.492041    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzp8c\" (UniqueName: \"kubernetes.io/projected/17bf9b7a-e9c1-45e7-a573-e41f46db476d-kube-api-access-tzp8c\") pod \"node-exporter-snpk8\" (UID: \"17bf9b7a-e9c1-45e7-a573-e41f46db476d\") " pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.499354 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.499336    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s8jd4"
May 21 18:16:10.661237 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:10.661208    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-snpk8"
May 21 18:16:10.669750 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:16:10.669724    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bf9b7a_e9c1_45e7_a573_e41f46db476d.slice/crio-b15dc3d4702d9dae3a093a25f23a9059d17aef485cb05622adc735bb77142110 WatchSource:0}: Error finding container b15dc3d4702d9dae3a093a25f23a9059d17aef485cb05622adc735bb77142110: Status 404 returned error can't find the container with id b15dc3d4702d9dae3a093a25f23a9059d17aef485cb05622adc735bb77142110
May 21 18:16:11.520848 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:11.520811    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snpk8" event={"ID":"17bf9b7a-e9c1-45e7-a573-e41f46db476d","Type":"ContainerStarted","Data":"b15dc3d4702d9dae3a093a25f23a9059d17aef485cb05622adc735bb77142110"}
May 21 18:16:12.525098 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:12.525065    2573 generic.go:358] "Generic (PLEG): container finished" podID="17bf9b7a-e9c1-45e7-a573-e41f46db476d" containerID="b1f05e7a2ec60332c0d049c436a4a7c02881e3b2319b44941ee7892e66258603" exitCode=0
May 21 18:16:12.525489 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:12.525126    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snpk8" event={"ID":"17bf9b7a-e9c1-45e7-a573-e41f46db476d","Type":"ContainerDied","Data":"b1f05e7a2ec60332c0d049c436a4a7c02881e3b2319b44941ee7892e66258603"}
May 21 18:16:13.529201 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:13.529162    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snpk8" event={"ID":"17bf9b7a-e9c1-45e7-a573-e41f46db476d","Type":"ContainerStarted","Data":"a9ab412dc2d13c8fd7bb70294a8ed88df922ed7bcf21e4d98520a987b87de43b"}
May 21 18:16:13.529596 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:13.529206    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snpk8" event={"ID":"17bf9b7a-e9c1-45e7-a573-e41f46db476d","Type":"ContainerStarted","Data":"1e350c28a3425c448107acc05348d7e6cc7631e7ff82c1900ba3fab75686208c"}
May 21 18:16:13.548443 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:13.548383    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-snpk8" podStartSLOduration=2.588513782 podStartE2EDuration="3.548371462s" podCreationTimestamp="2026-05-21 18:16:10 +0000 UTC" firstStartedPulling="2026-05-21 18:16:10.671442439 +0000 UTC m=+175.220261033" lastFinishedPulling="2026-05-21 18:16:11.631300126 +0000 UTC m=+176.180118713" observedRunningTime="2026-05-21 18:16:13.548120693 +0000 UTC m=+178.096939302" watchObservedRunningTime="2026-05-21 18:16:13.548371462 +0000 UTC m=+178.097190070"
May 21 18:16:15.714732 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:15.714684    2573 patch_prober.go:28] interesting pod/image-registry-667794b779-5jl2b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 18:16:15.715087 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:15.714753    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-667794b779-5jl2b" podUID="31a31bdb-6ce0-4e0c-a034-90441a70d832" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 18:16:17.481640 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:17.481615    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-667794b779-5jl2b"
May 21 18:16:52.216682 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:52.216654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/init-textfile/0.log"
May 21 18:16:52.417285 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:52.417258    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/node-exporter/0.log"
May 21 18:16:52.617067 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:16:52.616987    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/kube-rbac-proxy/0.log"
May 21 18:17:04.567190 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:04.567153    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" podUID="9ccaed2d-9174-4406-98b1-362ea69ddf1c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:17:14.567504 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:14.567467    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" podUID="9ccaed2d-9174-4406-98b1-362ea69ddf1c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:17:24.567110 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.567069    2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" podUID="9ccaed2d-9174-4406-98b1-362ea69ddf1c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 18:17:24.567533 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.567161    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh"
May 21 18:17:24.567664 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.567635    2573 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b179d5badc34547c0997b5f7c9284d160b987b0a6d2f434173553f434a6b78cc"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 18:17:24.567714 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.567696    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" podUID="9ccaed2d-9174-4406-98b1-362ea69ddf1c" containerName="service-proxy" containerID="cri-o://b179d5badc34547c0997b5f7c9284d160b987b0a6d2f434173553f434a6b78cc" gracePeriod=30
May 21 18:17:24.701843 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.701818    2573 generic.go:358] "Generic (PLEG): container finished" podID="9ccaed2d-9174-4406-98b1-362ea69ddf1c" containerID="b179d5badc34547c0997b5f7c9284d160b987b0a6d2f434173553f434a6b78cc" exitCode=2
May 21 18:17:24.701927 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:24.701877    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerDied","Data":"b179d5badc34547c0997b5f7c9284d160b987b0a6d2f434173553f434a6b78cc"}
May 21 18:17:25.705972 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:25.705932    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d8b9bcf98-hm6hh" event={"ID":"9ccaed2d-9174-4406-98b1-362ea69ddf1c","Type":"ContainerStarted","Data":"53bffc2754a58f53f33c406b05e1b2738834e6816427ca157318f3970d0584fb"}
May 21 18:17:27.856185 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:27.856147    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:17:27.858362 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:27.858342    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e69e9e6a-c6b5-4970-bc1c-c4204c3002f3-metrics-certs\") pod \"network-metrics-daemon-cm8sn\" (UID: \"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3\") " pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:17:28.049829 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:28.049798    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tccs\""
May 21 18:17:28.057596 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:28.057573    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cm8sn"
May 21 18:17:28.175246 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:28.175213    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cm8sn"]
May 21 18:17:28.178124 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:17:28.178098    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69e9e6a_c6b5_4970_bc1c_c4204c3002f3.slice/crio-df0aa9f0d46f48f06ffaa863bc8fb034a06a2a7223538453803bfc5c453b9371 WatchSource:0}: Error finding container df0aa9f0d46f48f06ffaa863bc8fb034a06a2a7223538453803bfc5c453b9371: Status 404 returned error can't find the container with id df0aa9f0d46f48f06ffaa863bc8fb034a06a2a7223538453803bfc5c453b9371
May 21 18:17:28.714637 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:28.714596    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cm8sn" event={"ID":"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3","Type":"ContainerStarted","Data":"df0aa9f0d46f48f06ffaa863bc8fb034a06a2a7223538453803bfc5c453b9371"}
May 21 18:17:29.718362 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:29.718326    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cm8sn" event={"ID":"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3","Type":"ContainerStarted","Data":"7cf94283c97100606e479b086d3f6cb38b73b44cc017b81728ed98f6089d7933"}
May 21 18:17:29.718362 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:29.718362    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cm8sn" event={"ID":"e69e9e6a-c6b5-4970-bc1c-c4204c3002f3","Type":"ContainerStarted","Data":"ea048aef66c615eed4533fd996bb25f790abf144edcb960006364cc521e461fb"}
May 21 18:17:29.736306 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:29.736260    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cm8sn" podStartSLOduration=252.801675865 podStartE2EDuration="4m13.73624618s" podCreationTimestamp="2026-05-21 18:13:16 +0000 UTC" firstStartedPulling="2026-05-21 18:17:28.179936915 +0000 UTC m=+252.728755501" lastFinishedPulling="2026-05-21 18:17:29.114507227 +0000 UTC m=+253.663325816" observedRunningTime="2026-05-21 18:17:29.73520319 +0000 UTC m=+254.284021801" watchObservedRunningTime="2026-05-21 18:17:29.73624618 +0000 UTC m=+254.285064789"
May 21 18:17:34.598668 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.598628    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"]
May 21 18:17:34.600906 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.600890    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.603441 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603399    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 21 18:17:34.603578 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603405    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 21 18:17:34.603578 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603535    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 21 18:17:34.603578 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603541    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6kjst\""
May 21 18:17:34.603791 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603775    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 21 18:17:34.603865 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.603807    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 21 18:17:34.608676 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.608654    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 21 18:17:34.612695 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.612670    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"]
May 21 18:17:34.704118 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704118 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704129    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9lj\" (UniqueName: \"kubernetes.io/projected/bd57fe10-f869-4303-8781-8b0622054ec9-kube-api-access-rf9lj\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704372 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-federate-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704372 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704247    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-serving-certs-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704372 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704300    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704372 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704572 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704374    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.704572 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.704402    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-metrics-client-ca\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805506 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805478    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-serving-certs-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805660 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805522    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805660 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805563    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805660 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805589    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805660 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805611    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-metrics-client-ca\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805805 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805735    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805805 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805777    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9lj\" (UniqueName: \"kubernetes.io/projected/bd57fe10-f869-4303-8781-8b0622054ec9-kube-api-access-rf9lj\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.805902 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.805805    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-federate-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.806227 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.806193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-serving-certs-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.806759 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.806735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-metrics-client-ca\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.806873 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.806735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.808210 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.808181    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.808328 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.808278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-federate-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.808507 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.808489    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-telemeter-client-tls\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.808566 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.808511    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bd57fe10-f869-4303-8781-8b0622054ec9-secret-telemeter-client\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.813096 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.813075    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9lj\" (UniqueName: \"kubernetes.io/projected/bd57fe10-f869-4303-8781-8b0622054ec9-kube-api-access-rf9lj\") pod \"telemeter-client-9b6bfd8d5-zz55g\" (UID: \"bd57fe10-f869-4303-8781-8b0622054ec9\") " pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:34.910736 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:34.910707    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"
May 21 18:17:35.034578 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:35.034546    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g"]
May 21 18:17:35.037829 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:17:35.037801    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd57fe10_f869_4303_8781_8b0622054ec9.slice/crio-94de64949a4dfc72adbda44ae66cbae03c7641c19b80ed49510e1dc8efd98f46 WatchSource:0}: Error finding container 94de64949a4dfc72adbda44ae66cbae03c7641c19b80ed49510e1dc8efd98f46: Status 404 returned error can't find the container with id 94de64949a4dfc72adbda44ae66cbae03c7641c19b80ed49510e1dc8efd98f46
May 21 18:17:35.736520 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:35.736488    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g" event={"ID":"bd57fe10-f869-4303-8781-8b0622054ec9","Type":"ContainerStarted","Data":"94de64949a4dfc72adbda44ae66cbae03c7641c19b80ed49510e1dc8efd98f46"}
May 21 18:17:36.740791 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:36.740759    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g" event={"ID":"bd57fe10-f869-4303-8781-8b0622054ec9","Type":"ContainerStarted","Data":"e279b2ffcd449d8b0bec5a5c04447500e7d7b9e13d0e327bc5321fa7cfc6ea60"}
May 21 18:17:37.745608 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:37.745572    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g" event={"ID":"bd57fe10-f869-4303-8781-8b0622054ec9","Type":"ContainerStarted","Data":"a16a3bf8ce495a4cc0c47ee8cfd9b6ecf991373ddfb6e32f19148bbadca09e0e"}
May 21 18:17:37.745913 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:37.745619    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g" event={"ID":"bd57fe10-f869-4303-8781-8b0622054ec9","Type":"ContainerStarted","Data":"a9e615da4642108acbdf1c643525191b3668500a34175628ba5aaafc7c086e12"}
May 21 18:17:37.769908 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:17:37.769864    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9b6bfd8d5-zz55g" podStartSLOduration=1.1990735080000001 podStartE2EDuration="3.769849897s" podCreationTimestamp="2026-05-21 18:17:34 +0000 UTC" firstStartedPulling="2026-05-21 18:17:35.039550973 +0000 UTC m=+259.588369559" lastFinishedPulling="2026-05-21 18:17:37.610327348 +0000 UTC m=+262.159145948" observedRunningTime="2026-05-21 18:17:37.769146976 +0000 UTC m=+262.317965585" watchObservedRunningTime="2026-05-21 18:17:37.769849897 +0000 UTC m=+262.318668504"
May 21 18:18:15.953842 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:18:15.953811    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:18:15.954921 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:18:15.954901    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:18:15.957765 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:18:15.957747    2573 kubelet.go:1628] "Image garbage collection succeeded"
May 21 18:20:54.794160 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.794118    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"]
May 21 18:20:54.796537 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.796521    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.799255 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.799229    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 18:20:54.799392 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.799239    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xnk8k\""
May 21 18:20:54.799494 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.799478    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 18:20:54.799549 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.799507    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 18:20:54.799549 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.799480    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 18:20:54.811470 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.811445    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"]
May 21 18:20:54.883762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.883723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.883762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.883767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqpwj\" (UniqueName: \"kubernetes.io/projected/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-kube-api-access-tqpwj\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.883958 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.883831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.984358 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.984324    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.984358 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.984364    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqpwj\" (UniqueName: \"kubernetes.io/projected/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-kube-api-access-tqpwj\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.984622 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.984403    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.986851 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.986829    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.986851 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.986847    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:54.993243 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:54.993222    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqpwj\" (UniqueName: \"kubernetes.io/projected/e0638aa4-75b4-4d39-b99e-ca7a65cc17b6-kube-api-access-tqpwj\") pod \"opendatahub-operator-controller-manager-5948ffb7d5-v7lsb\" (UID: \"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6\") " pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:55.106777 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:55.106695    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:55.240055 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:55.239982    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"]
May 21 18:20:55.242039 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:20:55.242001    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0638aa4_75b4_4d39_b99e_ca7a65cc17b6.slice/crio-ce62286dca1c7c93fcff987ab47834f63972981897a50c77bbd8e93f1d5ac767 WatchSource:0}: Error finding container ce62286dca1c7c93fcff987ab47834f63972981897a50c77bbd8e93f1d5ac767: Status 404 returned error can't find the container with id ce62286dca1c7c93fcff987ab47834f63972981897a50c77bbd8e93f1d5ac767
May 21 18:20:55.243618 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:55.243598    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:20:56.231891 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:56.231846    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb" event={"ID":"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6","Type":"ContainerStarted","Data":"ce62286dca1c7c93fcff987ab47834f63972981897a50c77bbd8e93f1d5ac767"}
May 21 18:20:58.237687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:58.237652    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb" event={"ID":"e0638aa4-75b4-4d39-b99e-ca7a65cc17b6","Type":"ContainerStarted","Data":"90ead8c556323cc615e94eda9776d296d75dbe9ad4b95693c63ec255e234a868"}
May 21 18:20:58.238078 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:58.237746    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:20:58.265389 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:20:58.265332    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb" podStartSLOduration=1.746546412 podStartE2EDuration="4.265317769s" podCreationTimestamp="2026-05-21 18:20:54 +0000 UTC" firstStartedPulling="2026-05-21 18:20:55.24372307 +0000 UTC m=+459.792541656" lastFinishedPulling="2026-05-21 18:20:57.762494414 +0000 UTC m=+462.311313013" observedRunningTime="2026-05-21 18:20:58.263301146 +0000 UTC m=+462.812119765" watchObservedRunningTime="2026-05-21 18:20:58.265317769 +0000 UTC m=+462.814136376"
May 21 18:21:09.242963 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:09.242935    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5948ffb7d5-v7lsb"
May 21 18:21:15.125066 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.125033    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fnsbv"]
May 21 18:21:15.127090 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.127075    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.129650 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.129630    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 18:21:15.129807 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.129789    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5cft4\""
May 21 18:21:15.135804 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.135754    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fnsbv"]
May 21 18:21:15.232646 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.232616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.232803 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.232673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9dl\" (UniqueName: \"kubernetes.io/projected/67eed7e4-42df-4f29-b4c0-848347fbd62e-kube-api-access-pw9dl\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.333227 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.333194    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9dl\" (UniqueName: \"kubernetes.io/projected/67eed7e4-42df-4f29-b4c0-848347fbd62e-kube-api-access-pw9dl\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.333404 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.333252    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.333404 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:15.333371    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 18:21:15.333556 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:15.333443    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert podName:67eed7e4-42df-4f29-b4c0-848347fbd62e nodeName:}" failed. No retries permitted until 2026-05-21 18:21:15.833404769 +0000 UTC m=+480.382223368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert") pod "odh-model-controller-858dbf95b8-fnsbv" (UID: "67eed7e4-42df-4f29-b4c0-848347fbd62e") : secret "odh-model-controller-webhook-cert" not found
May 21 18:21:15.342520 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.342498    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9dl\" (UniqueName: \"kubernetes.io/projected/67eed7e4-42df-4f29-b4c0-848347fbd62e-kube-api-access-pw9dl\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.837863 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:15.837826    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:15.838034 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:15.837963    2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 18:21:15.838034 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:15.838030    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert podName:67eed7e4-42df-4f29-b4c0-848347fbd62e nodeName:}" failed. No retries permitted until 2026-05-21 18:21:16.83801335 +0000 UTC m=+481.386831936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert") pod "odh-model-controller-858dbf95b8-fnsbv" (UID: "67eed7e4-42df-4f29-b4c0-848347fbd62e") : secret "odh-model-controller-webhook-cert" not found
May 21 18:21:16.843959 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:16.843906    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:16.846311 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:16.846293    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67eed7e4-42df-4f29-b4c0-848347fbd62e-cert\") pod \"odh-model-controller-858dbf95b8-fnsbv\" (UID: \"67eed7e4-42df-4f29-b4c0-848347fbd62e\") " pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:16.940803 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:16.940768    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5cft4\""
May 21 18:21:16.948291 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:16.948267    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:17.075309 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:17.075277    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fnsbv"]
May 21 18:21:17.078445 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:21:17.078403    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67eed7e4_42df_4f29_b4c0_848347fbd62e.slice/crio-369561f2f866989c3eea7e26705c649d71a111a7dc81b01c0c026c538d92bfcb WatchSource:0}: Error finding container 369561f2f866989c3eea7e26705c649d71a111a7dc81b01c0c026c538d92bfcb: Status 404 returned error can't find the container with id 369561f2f866989c3eea7e26705c649d71a111a7dc81b01c0c026c538d92bfcb
May 21 18:21:17.287666 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:17.287625    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" event={"ID":"67eed7e4-42df-4f29-b4c0-848347fbd62e","Type":"ContainerStarted","Data":"369561f2f866989c3eea7e26705c649d71a111a7dc81b01c0c026c538d92bfcb"}
May 21 18:21:20.296404 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.296308    2573 generic.go:358] "Generic (PLEG): container finished" podID="67eed7e4-42df-4f29-b4c0-848347fbd62e" containerID="3ee00d928246a2414b102dd5af1f95098f2d195224f37ed10f67cf22633dfa73" exitCode=1
May 21 18:21:20.296763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.296400    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" event={"ID":"67eed7e4-42df-4f29-b4c0-848347fbd62e","Type":"ContainerDied","Data":"3ee00d928246a2414b102dd5af1f95098f2d195224f37ed10f67cf22633dfa73"}
May 21 18:21:20.296763 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.296629    2573 scope.go:117] "RemoveContainer" containerID="3ee00d928246a2414b102dd5af1f95098f2d195224f37ed10f67cf22633dfa73"
May 21 18:21:20.584329 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.584301    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hlx4w"]
May 21 18:21:20.586284 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.586266    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:20.589700 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.589680    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-96499\""
May 21 18:21:20.589806 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.589699    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 18:21:20.599448 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.599398    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hlx4w"]
May 21 18:21:20.673850 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.673809    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:20.674026 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.673971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8pf\" (UniqueName: \"kubernetes.io/projected/e1120a83-6184-4710-9fe3-d499f0d3d7a6-kube-api-access-vr8pf\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:20.775380 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.775352    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8pf\" (UniqueName: \"kubernetes.io/projected/e1120a83-6184-4710-9fe3-d499f0d3d7a6-kube-api-access-vr8pf\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:20.775486 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.775397    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:20.775553 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:20.775533    2573 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 18:21:20.775612 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:20.775601    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert podName:e1120a83-6184-4710-9fe3-d499f0d3d7a6 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:21.275582831 +0000 UTC m=+485.824401426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert") pod "kserve-controller-manager-856948b99f-hlx4w" (UID: "e1120a83-6184-4710-9fe3-d499f0d3d7a6") : secret "kserve-webhook-server-cert" not found
May 21 18:21:20.786907 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:20.786873    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8pf\" (UniqueName: \"kubernetes.io/projected/e1120a83-6184-4710-9fe3-d499f0d3d7a6-kube-api-access-vr8pf\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:21.279678 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.279641    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:21.281989 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.281969    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1120a83-6184-4710-9fe3-d499f0d3d7a6-cert\") pod \"kserve-controller-manager-856948b99f-hlx4w\" (UID: \"e1120a83-6184-4710-9fe3-d499f0d3d7a6\") " pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:21.300456 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.300401    2573 generic.go:358] "Generic (PLEG): container finished" podID="67eed7e4-42df-4f29-b4c0-848347fbd62e" containerID="1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b" exitCode=1
May 21 18:21:21.300822 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.300463    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" event={"ID":"67eed7e4-42df-4f29-b4c0-848347fbd62e","Type":"ContainerDied","Data":"1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b"}
May 21 18:21:21.300822 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.300502    2573 scope.go:117] "RemoveContainer" containerID="3ee00d928246a2414b102dd5af1f95098f2d195224f37ed10f67cf22633dfa73"
May 21 18:21:21.300822 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.300716    2573 scope.go:117] "RemoveContainer" containerID="1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b"
May 21 18:21:21.301008 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:21.300906    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fnsbv_opendatahub(67eed7e4-42df-4f29-b4c0-848347fbd62e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" podUID="67eed7e4-42df-4f29-b4c0-848347fbd62e"
May 21 18:21:21.515181 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.515145    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:21.639675 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:21.639644    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hlx4w"]
May 21 18:21:21.642375 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:21:21.642342    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1120a83_6184_4710_9fe3_d499f0d3d7a6.slice/crio-9d0f64ffa5f1fe63f971c7038094a88cec627234928a26460d1ea322d1767969 WatchSource:0}: Error finding container 9d0f64ffa5f1fe63f971c7038094a88cec627234928a26460d1ea322d1767969: Status 404 returned error can't find the container with id 9d0f64ffa5f1fe63f971c7038094a88cec627234928a26460d1ea322d1767969
May 21 18:21:22.304229 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:22.304201    2573 scope.go:117] "RemoveContainer" containerID="1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b"
May 21 18:21:22.304699 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:22.304384    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fnsbv_opendatahub(67eed7e4-42df-4f29-b4c0-848347fbd62e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" podUID="67eed7e4-42df-4f29-b4c0-848347fbd62e"
May 21 18:21:22.304991 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:22.304972    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w" event={"ID":"e1120a83-6184-4710-9fe3-d499f0d3d7a6","Type":"ContainerStarted","Data":"9d0f64ffa5f1fe63f971c7038094a88cec627234928a26460d1ea322d1767969"}
May 21 18:21:23.132758 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.132717    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"]
May 21 18:21:23.134873 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.134846    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.137861 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.137838    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 18:21:23.138226 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.138206    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 18:21:23.138343 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.138242    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 18:21:23.138801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.138782    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 18:21:23.151058 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.151035    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"]
May 21 18:21:23.192872 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.192839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0a269ad-4160-4656-9c47-1860e5c69426-tmp\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.193016 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.192885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.193016 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.192904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-282ff\" (UniqueName: \"kubernetes.io/projected/f0a269ad-4160-4656-9c47-1860e5c69426-kube-api-access-282ff\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.294322 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.294291    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0a269ad-4160-4656-9c47-1860e5c69426-tmp\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.294524 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.294327    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.294524 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.294347    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-282ff\" (UniqueName: \"kubernetes.io/projected/f0a269ad-4160-4656-9c47-1860e5c69426-kube-api-access-282ff\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.294524 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:23.294479    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 21 18:21:23.294704 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:23.294544    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs podName:f0a269ad-4160-4656-9c47-1860e5c69426 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:23.794525206 +0000 UTC m=+488.343343803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs") pod "kube-auth-proxy-78678676dd-5sn6d" (UID: "f0a269ad-4160-4656-9c47-1860e5c69426") : secret "kube-auth-proxy-tls" not found
May 21 18:21:23.296520 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.296503    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0a269ad-4160-4656-9c47-1860e5c69426-tmp\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.308584 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.308554    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-282ff\" (UniqueName: \"kubernetes.io/projected/f0a269ad-4160-4656-9c47-1860e5c69426-kube-api-access-282ff\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.798893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.798858    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:23.801248 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:23.801229    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0a269ad-4160-4656-9c47-1860e5c69426-tls-certs\") pod \"kube-auth-proxy-78678676dd-5sn6d\" (UID: \"f0a269ad-4160-4656-9c47-1860e5c69426\") " pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:24.046848 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:24.046808    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"
May 21 18:21:24.167114 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:24.167089    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78678676dd-5sn6d"]
May 21 18:21:24.169253 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:21:24.169224    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a269ad_4160_4656_9c47_1860e5c69426.slice/crio-f26d92479c3a7580ab41670925f6acabe08db97136375ef25e7527cd15954926 WatchSource:0}: Error finding container f26d92479c3a7580ab41670925f6acabe08db97136375ef25e7527cd15954926: Status 404 returned error can't find the container with id f26d92479c3a7580ab41670925f6acabe08db97136375ef25e7527cd15954926
May 21 18:21:24.315330 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:24.315250    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d" event={"ID":"f0a269ad-4160-4656-9c47-1860e5c69426","Type":"ContainerStarted","Data":"f26d92479c3a7580ab41670925f6acabe08db97136375ef25e7527cd15954926"}
May 21 18:21:26.948488 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:26.948456    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:26.948978 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:26.948960    2573 scope.go:117] "RemoveContainer" containerID="1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b"
May 21 18:21:26.949175 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:21:26.949155    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-fnsbv_opendatahub(67eed7e4-42df-4f29-b4c0-848347fbd62e)\"" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" podUID="67eed7e4-42df-4f29-b4c0-848347fbd62e"
May 21 18:21:27.324811 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:27.324718    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w" event={"ID":"e1120a83-6184-4710-9fe3-d499f0d3d7a6","Type":"ContainerStarted","Data":"5d339f187616cfc7f0ce53357df2cdc7b0e2c44dedfe3ed8cac8202a3320ef15"}
May 21 18:21:27.324811 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:27.324789    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:27.347228 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:27.347176    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w" podStartSLOduration=2.386232524 podStartE2EDuration="7.34716144s" podCreationTimestamp="2026-05-21 18:21:20 +0000 UTC" firstStartedPulling="2026-05-21 18:21:21.643603277 +0000 UTC m=+486.192421863" lastFinishedPulling="2026-05-21 18:21:26.60453218 +0000 UTC m=+491.153350779" observedRunningTime="2026-05-21 18:21:27.345359385 +0000 UTC m=+491.894177994" watchObservedRunningTime="2026-05-21 18:21:27.34716144 +0000 UTC m=+491.895980047"
May 21 18:21:28.328444 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:28.328387    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d" event={"ID":"f0a269ad-4160-4656-9c47-1860e5c69426","Type":"ContainerStarted","Data":"511d7b1e2323a8bea4dd89277a17e0e9ac198c52d7c58c374bd64c67fe6fcd19"}
May 21 18:21:28.349573 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:28.345807    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78678676dd-5sn6d" podStartSLOduration=1.896050215 podStartE2EDuration="5.345788586s" podCreationTimestamp="2026-05-21 18:21:23 +0000 UTC" firstStartedPulling="2026-05-21 18:21:24.170928628 +0000 UTC m=+488.719747214" lastFinishedPulling="2026-05-21 18:21:27.620666997 +0000 UTC m=+492.169485585" observedRunningTime="2026-05-21 18:21:28.344382615 +0000 UTC m=+492.893201232" watchObservedRunningTime="2026-05-21 18:21:28.345788586 +0000 UTC m=+492.894607198"
May 21 18:21:36.948825 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:36.948790    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:36.949202 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:36.949143    2573 scope.go:117] "RemoveContainer" containerID="1223f67177a7156889f0d42b0e9f08fcd99548f4ca5455f1f0be3445c31b938b"
May 21 18:21:37.355679 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:37.355644    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" event={"ID":"67eed7e4-42df-4f29-b4c0-848347fbd62e","Type":"ContainerStarted","Data":"a98080d5a02c1e8166bbdbe44f61918976d3ebd20784f71f872d4b6c26a3e1cc"}
May 21 18:21:37.355869 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:37.355857    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:38.724665 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.724613    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv" podStartSLOduration=3.5936678090000003 podStartE2EDuration="23.724596682s" podCreationTimestamp="2026-05-21 18:21:15 +0000 UTC" firstStartedPulling="2026-05-21 18:21:17.079772406 +0000 UTC m=+481.628590991" lastFinishedPulling="2026-05-21 18:21:37.210701278 +0000 UTC m=+501.759519864" observedRunningTime="2026-05-21 18:21:37.399000702 +0000 UTC m=+501.947819311" watchObservedRunningTime="2026-05-21 18:21:38.724596682 +0000 UTC m=+503.273415291"
May 21 18:21:38.725541 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.725521    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"]
May 21 18:21:38.727627 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.727613    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.730166 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.730145    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-48zhp\""
May 21 18:21:38.731411 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.731373    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 18:21:38.731553 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.731538    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 18:21:38.744004 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.743982    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"]
May 21 18:21:38.822169 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.822134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rlzp\" (UniqueName: \"kubernetes.io/projected/735a9cad-7f36-41de-916b-110ba62b8da3-kube-api-access-2rlzp\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.822320 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.822172    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/735a9cad-7f36-41de-916b-110ba62b8da3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.923533 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.923495    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlzp\" (UniqueName: \"kubernetes.io/projected/735a9cad-7f36-41de-916b-110ba62b8da3-kube-api-access-2rlzp\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.923722 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.923541    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/735a9cad-7f36-41de-916b-110ba62b8da3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.926093 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.926070    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/735a9cad-7f36-41de-916b-110ba62b8da3-operator-config\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:38.933844 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:38.933823    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rlzp\" (UniqueName: \"kubernetes.io/projected/735a9cad-7f36-41de-916b-110ba62b8da3-kube-api-access-2rlzp\") pod \"servicemesh-operator3-55f49c5f94-xg24x\" (UID: \"735a9cad-7f36-41de-916b-110ba62b8da3\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:39.036200 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:39.036124    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:39.178417 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:39.178388    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"]
May 21 18:21:39.182317 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:21:39.182285    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735a9cad_7f36_41de_916b_110ba62b8da3.slice/crio-1916e04f71f71cd9fa938314afb901cc0c58764f522f2de491bf9eee540c460a WatchSource:0}: Error finding container 1916e04f71f71cd9fa938314afb901cc0c58764f522f2de491bf9eee540c460a: Status 404 returned error can't find the container with id 1916e04f71f71cd9fa938314afb901cc0c58764f522f2de491bf9eee540c460a
May 21 18:21:39.362828 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:39.362743    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x" event={"ID":"735a9cad-7f36-41de-916b-110ba62b8da3","Type":"ContainerStarted","Data":"1916e04f71f71cd9fa938314afb901cc0c58764f522f2de491bf9eee540c460a"}
May 21 18:21:42.373500 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:42.373459    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x" event={"ID":"735a9cad-7f36-41de-916b-110ba62b8da3","Type":"ContainerStarted","Data":"c65485d760f51e74499c1089a3d991615f8b79698fabffbf1e1b84f8f4048146"}
May 21 18:21:42.373872 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:42.373597    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:42.402269 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:42.402212    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x" podStartSLOduration=1.750672948 podStartE2EDuration="4.402196604s" podCreationTimestamp="2026-05-21 18:21:38 +0000 UTC" firstStartedPulling="2026-05-21 18:21:39.184656158 +0000 UTC m=+503.733474750" lastFinishedPulling="2026-05-21 18:21:41.836179805 +0000 UTC m=+506.384998406" observedRunningTime="2026-05-21 18:21:42.401553741 +0000 UTC m=+506.950372351" watchObservedRunningTime="2026-05-21 18:21:42.402196604 +0000 UTC m=+506.951015212"
May 21 18:21:48.361019 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:48.360991    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-fnsbv"
May 21 18:21:53.378614 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:53.378586    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-xg24x"
May 21 18:21:54.647907 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.647877    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"]
May 21 18:21:54.650075 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.650050    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.658013 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.657990    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 18:21:54.658254 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.658231    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 18:21:54.658771 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.658745    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 18:21:54.658887 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.658781    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 18:21:54.659623 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.659604    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-97g79\""
May 21 18:21:54.669498 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.669477    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"]
May 21 18:21:54.747762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.747732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.747762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.747765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.747991 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.747790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.747991 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.747910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.747991 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.747952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b620a995-5cda-477b-a792-22371cdabcee-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.748131 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.748008    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.748131 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.748034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qt6\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-kube-api-access-67qt6\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849170 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849123    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849170 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849196    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849230    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b620a995-5cda-477b-a792-22371cdabcee-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849262    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849294    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67qt6\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-kube-api-access-67qt6\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849348    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.849687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849371    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.850104 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.849838    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.852224 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.852192    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.852584 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.852560    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.857645 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.857621    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b620a995-5cda-477b-a792-22371cdabcee-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.857760 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.857681    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b620a995-5cda-477b-a792-22371cdabcee-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.861900 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.861877    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.862940 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.862920    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qt6\" (UniqueName: \"kubernetes.io/projected/b620a995-5cda-477b-a792-22371cdabcee-kube-api-access-67qt6\") pod \"istiod-openshift-gateway-798958bb55-zs6zs\" (UID: \"b620a995-5cda-477b-a792-22371cdabcee\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:54.959273 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:54.959182    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:55.109994 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:55.109963    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"]
May 21 18:21:55.114032 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:21:55.114002    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb620a995_5cda_477b_a792_22371cdabcee.slice/crio-66cde0e5c593278fcd11ed335892aa3754d3f377f2ba6be01cc1660a68b10ef6 WatchSource:0}: Error finding container 66cde0e5c593278fcd11ed335892aa3754d3f377f2ba6be01cc1660a68b10ef6: Status 404 returned error can't find the container with id 66cde0e5c593278fcd11ed335892aa3754d3f377f2ba6be01cc1660a68b10ef6
May 21 18:21:55.414797 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:55.414761    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs" event={"ID":"b620a995-5cda-477b-a792-22371cdabcee","Type":"ContainerStarted","Data":"66cde0e5c593278fcd11ed335892aa3754d3f377f2ba6be01cc1660a68b10ef6"}
May 21 18:21:57.895118 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:57.895074    2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:21:57.895389 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:57.895161    2573 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 21 18:21:58.334710 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.334619    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-hlx4w"
May 21 18:21:58.428141 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.428105    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs" event={"ID":"b620a995-5cda-477b-a792-22371cdabcee","Type":"ContainerStarted","Data":"21663f5c632bcac36d52b118f4c6a5c0417bd36a7e8542e33770dc5055983ad7"}
May 21 18:21:58.428309 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.428275    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:21:58.429809 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.429784    2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-zs6zs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 18:21:58.429916 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.429842    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs" podUID="b620a995-5cda-477b-a792-22371cdabcee" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 18:21:58.452112 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:58.452054    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs" podStartSLOduration=1.673289858 podStartE2EDuration="4.452037114s" podCreationTimestamp="2026-05-21 18:21:54 +0000 UTC" firstStartedPulling="2026-05-21 18:21:55.116066293 +0000 UTC m=+519.664884878" lastFinishedPulling="2026-05-21 18:21:57.894813541 +0000 UTC m=+522.443632134" observedRunningTime="2026-05-21 18:21:58.450836635 +0000 UTC m=+522.999655243" watchObservedRunningTime="2026-05-21 18:21:58.452037114 +0000 UTC m=+523.000855723"
May 21 18:21:59.431414 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:21:59.431384    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zs6zs"
May 21 18:22:12.589993 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.589905    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:12.596096 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.596068    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:12.598926 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.598907    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:22:12.599064 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.599046    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:22:12.600117 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.600094    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6t7j8\""
May 21 18:22:12.604886 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.604866    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:12.694364 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.694320    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d8t7\" (UniqueName: \"kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7\") pod \"kuadrant-operator-catalog-4crhj\" (UID: \"3efa938c-f014-4286-bbfe-098407b50bfa\") " pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:12.795068 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.795027    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6d8t7\" (UniqueName: \"kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7\") pod \"kuadrant-operator-catalog-4crhj\" (UID: \"3efa938c-f014-4286-bbfe-098407b50bfa\") " pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:12.804075 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.804042    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d8t7\" (UniqueName: \"kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7\") pod \"kuadrant-operator-catalog-4crhj\" (UID: \"3efa938c-f014-4286-bbfe-098407b50bfa\") " pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:12.905512 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.905473    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:12.931330 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:12.931301    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:13.035004 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:13.034963    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:13.041631 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:22:13.041603    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efa938c_f014_4286_bbfe_098407b50bfa.slice/crio-f5003707dc20fb3fa0e0c86437517545d584bacca96e8da4c3caaf74a32f5534 WatchSource:0}: Error finding container f5003707dc20fb3fa0e0c86437517545d584bacca96e8da4c3caaf74a32f5534: Status 404 returned error can't find the container with id f5003707dc20fb3fa0e0c86437517545d584bacca96e8da4c3caaf74a32f5534
May 21 18:22:13.473535 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:13.473495    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" event={"ID":"3efa938c-f014-4286-bbfe-098407b50bfa","Type":"ContainerStarted","Data":"f5003707dc20fb3fa0e0c86437517545d584bacca96e8da4c3caaf74a32f5534"}
May 21 18:22:15.481068 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.480978    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" event={"ID":"3efa938c-f014-4286-bbfe-098407b50bfa","Type":"ContainerStarted","Data":"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"}
May 21 18:22:15.481501 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.481044    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" podUID="3efa938c-f014-4286-bbfe-098407b50bfa" containerName="registry-server" containerID="cri-o://6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338" gracePeriod=2
May 21 18:22:15.523841 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.523797    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" podStartSLOduration=1.422240217 podStartE2EDuration="3.523783596s" podCreationTimestamp="2026-05-21 18:22:12 +0000 UTC" firstStartedPulling="2026-05-21 18:22:13.04306822 +0000 UTC m=+537.591886807" lastFinishedPulling="2026-05-21 18:22:15.144611598 +0000 UTC m=+539.693430186" observedRunningTime="2026-05-21 18:22:15.523191391 +0000 UTC m=+540.072009998" watchObservedRunningTime="2026-05-21 18:22:15.523783596 +0000 UTC m=+540.072602203"
May 21 18:22:15.718350 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.718328    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:15.817827 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.817751    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d8t7\" (UniqueName: \"kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7\") pod \"3efa938c-f014-4286-bbfe-098407b50bfa\" (UID: \"3efa938c-f014-4286-bbfe-098407b50bfa\") "
May 21 18:22:15.819815 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.819784    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7" (OuterVolumeSpecName: "kube-api-access-6d8t7") pod "3efa938c-f014-4286-bbfe-098407b50bfa" (UID: "3efa938c-f014-4286-bbfe-098407b50bfa"). InnerVolumeSpecName "kube-api-access-6d8t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:22:15.918856 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:15.918827    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d8t7\" (UniqueName: \"kubernetes.io/projected/3efa938c-f014-4286-bbfe-098407b50bfa-kube-api-access-6d8t7\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:22:16.484972 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.484935    2573 generic.go:358] "Generic (PLEG): container finished" podID="3efa938c-f014-4286-bbfe-098407b50bfa" containerID="6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338" exitCode=0
May 21 18:22:16.485471 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.484999    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4crhj"
May 21 18:22:16.485471 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.485020    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" event={"ID":"3efa938c-f014-4286-bbfe-098407b50bfa","Type":"ContainerDied","Data":"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"}
May 21 18:22:16.485471 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.485056    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4crhj" event={"ID":"3efa938c-f014-4286-bbfe-098407b50bfa","Type":"ContainerDied","Data":"f5003707dc20fb3fa0e0c86437517545d584bacca96e8da4c3caaf74a32f5534"}
May 21 18:22:16.485471 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.485073    2573 scope.go:117] "RemoveContainer" containerID="6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"
May 21 18:22:16.498542 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.498511    2573 scope.go:117] "RemoveContainer" containerID="6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"
May 21 18:22:16.498792 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:22:16.498771    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338\": container with ID starting with 6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338 not found: ID does not exist" containerID="6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"
May 21 18:22:16.498837 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.498800    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338"} err="failed to get container status \"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338\": rpc error: code = NotFound desc = could not find container \"6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338\": container with ID starting with 6480f92cc1ec07d2c29caf541c418acd7b2191bbf0ec8ba6cfd84efad5356338 not found: ID does not exist"
May 21 18:22:16.506475 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.506446    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:16.513216 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:16.513194    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4crhj"]
May 21 18:22:18.049830 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:18.049796    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efa938c-f014-4286-bbfe-098407b50bfa" path="/var/lib/kubelet/pods/3efa938c-f014-4286-bbfe-098407b50bfa/volumes"
May 21 18:22:46.030074 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.030031    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"]
May 21 18:22:46.030687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.030456    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efa938c-f014-4286-bbfe-098407b50bfa" containerName="registry-server"
May 21 18:22:46.030687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.030474    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efa938c-f014-4286-bbfe-098407b50bfa" containerName="registry-server"
May 21 18:22:46.030687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.030568    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="3efa938c-f014-4286-bbfe-098407b50bfa" containerName="registry-server"
May 21 18:22:46.033332 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.033303    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.037662 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.037638    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:22:46.037777 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.037699    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-k6dnk\""
May 21 18:22:46.038115 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.038102    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:22:46.060366 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.060340    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"]
May 21 18:22:46.155662 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.155634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhfn\" (UniqueName: \"kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.155826 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.155693    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.256658 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.256620    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhfn\" (UniqueName: \"kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.256824 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.256682    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.257043 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.257024    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.282341 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.282266    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhfn\" (UniqueName: \"kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.342944 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.342908    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:46.489200 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.489175    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"]
May 21 18:22:46.491065 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:22:46.491036    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1cc3ba_3532_49c8_a343_83febd4501b4.slice/crio-fe5bbc2750622946dba46fd8fc08035a259939b18385fde3f631ae20de0d0136 WatchSource:0}: Error finding container fe5bbc2750622946dba46fd8fc08035a259939b18385fde3f631ae20de0d0136: Status 404 returned error can't find the container with id fe5bbc2750622946dba46fd8fc08035a259939b18385fde3f631ae20de0d0136
May 21 18:22:46.579021 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:46.578935    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" event={"ID":"6d1cc3ba-3532-49c8-a343-83febd4501b4","Type":"ContainerStarted","Data":"fe5bbc2750622946dba46fd8fc08035a259939b18385fde3f631ae20de0d0136"}
May 21 18:22:51.599813 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:51.599733    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" event={"ID":"6d1cc3ba-3532-49c8-a343-83febd4501b4","Type":"ContainerStarted","Data":"1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe"}
May 21 18:22:51.600234 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:51.599889    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:22:51.656966 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:51.656918    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" podStartSLOduration=1.942286556 podStartE2EDuration="6.656903048s" podCreationTimestamp="2026-05-21 18:22:45 +0000 UTC" firstStartedPulling="2026-05-21 18:22:46.493975238 +0000 UTC m=+571.042793825" lastFinishedPulling="2026-05-21 18:22:51.208591728 +0000 UTC m=+575.757410317" observedRunningTime="2026-05-21 18:22:51.653984367 +0000 UTC m=+576.202802986" watchObservedRunningTime="2026-05-21 18:22:51.656903048 +0000 UTC m=+576.205721655"
May 21 18:22:53.209968 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.209933    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-k86pz"]
May 21 18:22:53.213356 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.213333    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:53.218727 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.218709    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d5cmm\""
May 21 18:22:53.240103 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.240080    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-k86pz"]
May 21 18:22:53.313981 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.313950    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgl56\" (UniqueName: \"kubernetes.io/projected/675ff6d2-7bfd-4cbc-965d-058e1dd668ab-kube-api-access-xgl56\") pod \"authorino-operator-657f44b778-k86pz\" (UID: \"675ff6d2-7bfd-4cbc-965d-058e1dd668ab\") " pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:53.415123 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.415080    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgl56\" (UniqueName: \"kubernetes.io/projected/675ff6d2-7bfd-4cbc-965d-058e1dd668ab-kube-api-access-xgl56\") pod \"authorino-operator-657f44b778-k86pz\" (UID: \"675ff6d2-7bfd-4cbc-965d-058e1dd668ab\") " pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:53.447658 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.447622    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgl56\" (UniqueName: \"kubernetes.io/projected/675ff6d2-7bfd-4cbc-965d-058e1dd668ab-kube-api-access-xgl56\") pod \"authorino-operator-657f44b778-k86pz\" (UID: \"675ff6d2-7bfd-4cbc-965d-058e1dd668ab\") " pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:53.523096 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.523068    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:53.679451 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:53.679410    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-k86pz"]
May 21 18:22:53.680906 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:22:53.680876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675ff6d2_7bfd_4cbc_965d_058e1dd668ab.slice/crio-8b3cb0ee7876ea528d83733423ff0d939db701994a37e588fbb195b9c8f08095 WatchSource:0}: Error finding container 8b3cb0ee7876ea528d83733423ff0d939db701994a37e588fbb195b9c8f08095: Status 404 returned error can't find the container with id 8b3cb0ee7876ea528d83733423ff0d939db701994a37e588fbb195b9c8f08095
May 21 18:22:54.611474 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:54.611416    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-k86pz" event={"ID":"675ff6d2-7bfd-4cbc-965d-058e1dd668ab","Type":"ContainerStarted","Data":"8b3cb0ee7876ea528d83733423ff0d939db701994a37e588fbb195b9c8f08095"}
May 21 18:22:55.616224 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:55.616190    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-k86pz" event={"ID":"675ff6d2-7bfd-4cbc-965d-058e1dd668ab","Type":"ContainerStarted","Data":"65a604ed7daf1a7918c38d86a15d54a90bc34a6393acfa65ad6df4696808b920"}
May 21 18:22:55.616691 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:55.616337    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:22:55.655385 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:22:55.655337    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-k86pz" podStartSLOduration=0.8314246 podStartE2EDuration="2.655322501s" podCreationTimestamp="2026-05-21 18:22:53 +0000 UTC" firstStartedPulling="2026-05-21 18:22:53.682720871 +0000 UTC m=+578.231539457" lastFinishedPulling="2026-05-21 18:22:55.506618759 +0000 UTC m=+580.055437358" observedRunningTime="2026-05-21 18:22:55.653634778 +0000 UTC m=+580.202453403" watchObservedRunningTime="2026-05-21 18:22:55.655322501 +0000 UTC m=+580.204141108"
May 21 18:23:02.606390 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:02.606355    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:23:04.925789 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:04.925754    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"]
May 21 18:23:04.926345 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:04.926033    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" containerName="manager" containerID="cri-o://1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe" gracePeriod=2
May 21 18:23:04.927199 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:04.927176    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"]
May 21 18:23:04.931925 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:04.931826    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:05.091580 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.091540    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"]
May 21 18:23:05.091857 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.091844    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" containerName="manager"
May 21 18:23:05.091915 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.091858    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" containerName="manager"
May 21 18:23:05.091915 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.091905    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" containerName="manager"
May 21 18:23:05.094820 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.094794    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:05.118898 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.118862    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:05.119275 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.119258    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v9x5d\""
May 21 18:23:05.160606 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.160587    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:23:05.190226 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.190151    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"]
May 21 18:23:05.216033 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.216004    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfpsg\" (UniqueName: \"kubernetes.io/projected/434c7f7a-333a-4aa4-9d2e-fe835caee622-kube-api-access-vfpsg\") pod \"limitador-operator-controller-manager-85c4996f8c-6qld4\" (UID: \"434c7f7a-333a-4aa4-9d2e-fe835caee622\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:05.254410 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.254372    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:05.317166 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.317133    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume\") pod \"6d1cc3ba-3532-49c8-a343-83febd4501b4\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") "
May 21 18:23:05.317166 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.317170    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmhfn\" (UniqueName: \"kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn\") pod \"6d1cc3ba-3532-49c8-a343-83febd4501b4\" (UID: \"6d1cc3ba-3532-49c8-a343-83febd4501b4\") "
May 21 18:23:05.317379 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.317355    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfpsg\" (UniqueName: \"kubernetes.io/projected/434c7f7a-333a-4aa4-9d2e-fe835caee622-kube-api-access-vfpsg\") pod \"limitador-operator-controller-manager-85c4996f8c-6qld4\" (UID: \"434c7f7a-333a-4aa4-9d2e-fe835caee622\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:05.317655 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.317629    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d1cc3ba-3532-49c8-a343-83febd4501b4" (UID: "6d1cc3ba-3532-49c8-a343-83febd4501b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:23:05.319234 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.319213    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn" (OuterVolumeSpecName: "kube-api-access-mmhfn") pod "6d1cc3ba-3532-49c8-a343-83febd4501b4" (UID: "6d1cc3ba-3532-49c8-a343-83febd4501b4"). InnerVolumeSpecName "kube-api-access-mmhfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:23:05.333872 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.333846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfpsg\" (UniqueName: \"kubernetes.io/projected/434c7f7a-333a-4aa4-9d2e-fe835caee622-kube-api-access-vfpsg\") pod \"limitador-operator-controller-manager-85c4996f8c-6qld4\" (UID: \"434c7f7a-333a-4aa4-9d2e-fe835caee622\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:05.405387 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.405350    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:05.418374 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.418333    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmhfn\" (UniqueName: \"kubernetes.io/projected/6d1cc3ba-3532-49c8-a343-83febd4501b4-kube-api-access-mmhfn\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:23:05.418374 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.418359    2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d1cc3ba-3532-49c8-a343-83febd4501b4-extensions-socket-volume\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:23:05.636393 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.636365    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"]
May 21 18:23:05.636742 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:23:05.636718    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434c7f7a_333a_4aa4_9d2e_fe835caee622.slice/crio-e7c283606b27d18e95fb65212588fc5218f4ca030584e2274e3fbea7165e7b9f WatchSource:0}: Error finding container e7c283606b27d18e95fb65212588fc5218f4ca030584e2274e3fbea7165e7b9f: Status 404 returned error can't find the container with id e7c283606b27d18e95fb65212588fc5218f4ca030584e2274e3fbea7165e7b9f
May 21 18:23:05.649130 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.649103    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4" event={"ID":"434c7f7a-333a-4aa4-9d2e-fe835caee622","Type":"ContainerStarted","Data":"e7c283606b27d18e95fb65212588fc5218f4ca030584e2274e3fbea7165e7b9f"}
May 21 18:23:05.650267 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.650244    2573 generic.go:358] "Generic (PLEG): container finished" podID="6d1cc3ba-3532-49c8-a343-83febd4501b4" containerID="1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe" exitCode=0
May 21 18:23:05.650344 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.650285    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw"
May 21 18:23:05.650344 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.650292    2573 scope.go:117] "RemoveContainer" containerID="1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe"
May 21 18:23:05.654687 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.654655    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:05.658083 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.658067    2573 scope.go:117] "RemoveContainer" containerID="1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe"
May 21 18:23:05.658332 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:23:05.658316    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe\": container with ID starting with 1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe not found: ID does not exist" containerID="1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe"
May 21 18:23:05.658397 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.658339    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe"} err="failed to get container status \"1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe\": rpc error: code = NotFound desc = could not find container \"1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe\": container with ID starting with 1682d9829a597f2bdc06e43eb236aeed6c0311a7990b4aa9126c47a704969afe not found: ID does not exist"
May 21 18:23:05.679710 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:05.679671    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:06.051204 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:06.051166    2573 status_manager.go:895] "Failed to get status for pod" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7vmnw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7vmnw\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:23:06.051676 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:06.051258    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d1cc3ba-3532-49c8-a343-83febd4501b4" path="/var/lib/kubelet/pods/6d1cc3ba-3532-49c8-a343-83febd4501b4/volumes"
May 21 18:23:06.623139 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:06.623106    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-k86pz"
May 21 18:23:07.659488 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:07.659446    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4" event={"ID":"434c7f7a-333a-4aa4-9d2e-fe835caee622","Type":"ContainerStarted","Data":"41965b908c7ded84939d919a9592013c147abf87c439dedd09173db21e618715"}
May 21 18:23:07.659930 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:07.659560    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:07.685222 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:07.685175    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4" podStartSLOduration=1.375344135 podStartE2EDuration="2.685159082s" podCreationTimestamp="2026-05-21 18:23:05 +0000 UTC" firstStartedPulling="2026-05-21 18:23:05.638509741 +0000 UTC m=+590.187328326" lastFinishedPulling="2026-05-21 18:23:06.948324687 +0000 UTC m=+591.497143273" observedRunningTime="2026-05-21 18:23:07.684401378 +0000 UTC m=+592.233219987" watchObservedRunningTime="2026-05-21 18:23:07.685159082 +0000 UTC m=+592.233977692"
May 21 18:23:15.976666 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:15.976555    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:23:15.977274 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:15.977251    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:23:18.669765 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:18.669740    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6qld4"
May 21 18:23:57.524048 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.524009    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:23:57.528264 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.528244    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:23:57.533921 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.533902    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-62rk2\""
May 21 18:23:57.552484 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.552452    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:23:57.626370 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.626333    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4w8m\" (UniqueName: \"kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m\") pod \"authorino-f99f4b5cd-wz56r\" (UID: \"2f2e7fbb-f75e-4946-96a7-de4d75b285fd\") " pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:23:57.727021 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.726985    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4w8m\" (UniqueName: \"kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m\") pod \"authorino-f99f4b5cd-wz56r\" (UID: \"2f2e7fbb-f75e-4946-96a7-de4d75b285fd\") " pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:23:57.739007 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.738970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4w8m\" (UniqueName: \"kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m\") pod \"authorino-f99f4b5cd-wz56r\" (UID: \"2f2e7fbb-f75e-4946-96a7-de4d75b285fd\") " pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:23:57.836551 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.836481    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:23:57.975448 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:57.975394    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:23:57.977703 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:23:57.977665    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f2e7fbb_f75e_4946_96a7_de4d75b285fd.slice/crio-72447adaf49ec0761e6ffc9ced0ee34415df4c40847ca70a1f6996ebb9cd8f11 WatchSource:0}: Error finding container 72447adaf49ec0761e6ffc9ced0ee34415df4c40847ca70a1f6996ebb9cd8f11: Status 404 returned error can't find the container with id 72447adaf49ec0761e6ffc9ced0ee34415df4c40847ca70a1f6996ebb9cd8f11
May 21 18:23:58.818441 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:23:58.818365    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" event={"ID":"2f2e7fbb-f75e-4946-96a7-de4d75b285fd","Type":"ContainerStarted","Data":"72447adaf49ec0761e6ffc9ced0ee34415df4c40847ca70a1f6996ebb9cd8f11"}
May 21 18:24:01.829263 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:01.829229    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" event={"ID":"2f2e7fbb-f75e-4946-96a7-de4d75b285fd","Type":"ContainerStarted","Data":"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"}
May 21 18:24:01.848434 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:01.848382    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" podStartSLOduration=1.702879464 podStartE2EDuration="4.848367915s" podCreationTimestamp="2026-05-21 18:23:57 +0000 UTC" firstStartedPulling="2026-05-21 18:23:57.978922339 +0000 UTC m=+642.527740924" lastFinishedPulling="2026-05-21 18:24:01.124410788 +0000 UTC m=+645.673229375" observedRunningTime="2026-05-21 18:24:01.846903691 +0000 UTC m=+646.395722300" watchObservedRunningTime="2026-05-21 18:24:01.848367915 +0000 UTC m=+646.397186523"
May 21 18:24:02.071235 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:02.071200    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:24:03.835764 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:03.835708    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" podUID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" containerName="authorino" containerID="cri-o://5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85" gracePeriod=30
May 21 18:24:04.077995 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.077967    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:24:04.184759 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.184728    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4w8m\" (UniqueName: \"kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m\") pod \"2f2e7fbb-f75e-4946-96a7-de4d75b285fd\" (UID: \"2f2e7fbb-f75e-4946-96a7-de4d75b285fd\") "
May 21 18:24:04.186718 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.186686    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m" (OuterVolumeSpecName: "kube-api-access-g4w8m") pod "2f2e7fbb-f75e-4946-96a7-de4d75b285fd" (UID: "2f2e7fbb-f75e-4946-96a7-de4d75b285fd"). InnerVolumeSpecName "kube-api-access-g4w8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:04.286111 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.286068    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4w8m\" (UniqueName: \"kubernetes.io/projected/2f2e7fbb-f75e-4946-96a7-de4d75b285fd-kube-api-access-g4w8m\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:24:04.840772 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.840732    2573 generic.go:358] "Generic (PLEG): container finished" podID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" containerID="5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85" exitCode=0
May 21 18:24:04.841180 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.840781    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-wz56r"
May 21 18:24:04.841180 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.840803    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" event={"ID":"2f2e7fbb-f75e-4946-96a7-de4d75b285fd","Type":"ContainerDied","Data":"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"}
May 21 18:24:04.841180 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.840836    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-wz56r" event={"ID":"2f2e7fbb-f75e-4946-96a7-de4d75b285fd","Type":"ContainerDied","Data":"72447adaf49ec0761e6ffc9ced0ee34415df4c40847ca70a1f6996ebb9cd8f11"}
May 21 18:24:04.841180 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.840856    2573 scope.go:117] "RemoveContainer" containerID="5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"
May 21 18:24:04.848993 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.848965    2573 scope.go:117] "RemoveContainer" containerID="5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"
May 21 18:24:04.849254 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:24:04.849234    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85\": container with ID starting with 5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85 not found: ID does not exist" containerID="5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"
May 21 18:24:04.849308 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.849261    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85"} err="failed to get container status \"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85\": rpc error: code = NotFound desc = could not find container \"5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85\": container with ID starting with 5223f0044c455345055040b352dbac4782cfddc470f1f87f28dec8dbfdeb9c85 not found: ID does not exist"
May 21 18:24:04.862258 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.862233    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:24:04.865990 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:04.865969    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-wz56r"]
May 21 18:24:06.050106 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:06.050070    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" path="/var/lib/kubelet/pods/2f2e7fbb-f75e-4946-96a7-de4d75b285fd/volumes"
May 21 18:24:17.687324 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.687275    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6m59b"]
May 21 18:24:17.687800 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.687738    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" containerName="authorino"
May 21 18:24:17.687800 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.687758    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" containerName="authorino"
May 21 18:24:17.687914 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.687852    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f2e7fbb-f75e-4946-96a7-de4d75b285fd" containerName="authorino"
May 21 18:24:17.692051 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.692024    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.695023 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.695001    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 21 18:24:17.695216 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.695197    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9chv4\""
May 21 18:24:17.704870 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.704847    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6m59b"]
May 21 18:24:17.802230 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.802194    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ec9015-56f3-4b85-90da-4ed754adfd36-data\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.802417 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.802253    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8xsp\" (UniqueName: \"kubernetes.io/projected/82ec9015-56f3-4b85-90da-4ed754adfd36-kube-api-access-k8xsp\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.902793 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.902760    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ec9015-56f3-4b85-90da-4ed754adfd36-data\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.902793 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.902800    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8xsp\" (UniqueName: \"kubernetes.io/projected/82ec9015-56f3-4b85-90da-4ed754adfd36-kube-api-access-k8xsp\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.903208 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.903182    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ec9015-56f3-4b85-90da-4ed754adfd36-data\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:17.912489 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:17.912464    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8xsp\" (UniqueName: \"kubernetes.io/projected/82ec9015-56f3-4b85-90da-4ed754adfd36-kube-api-access-k8xsp\") pod \"postgres-68c4fbbd6f-6m59b\" (UID: \"82ec9015-56f3-4b85-90da-4ed754adfd36\") " pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:18.003297 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:18.003198    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:18.134303 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:18.134264    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6m59b"]
May 21 18:24:18.137140 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:24:18.137114    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ec9015_56f3_4b85_90da_4ed754adfd36.slice/crio-a9c1eb2ccdd5fa7dd357b191729055fc6edea154f9de6aa292cea4e5590d0e22 WatchSource:0}: Error finding container a9c1eb2ccdd5fa7dd357b191729055fc6edea154f9de6aa292cea4e5590d0e22: Status 404 returned error can't find the container with id a9c1eb2ccdd5fa7dd357b191729055fc6edea154f9de6aa292cea4e5590d0e22
May 21 18:24:18.888592 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:18.888556    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6m59b" event={"ID":"82ec9015-56f3-4b85-90da-4ed754adfd36","Type":"ContainerStarted","Data":"a9c1eb2ccdd5fa7dd357b191729055fc6edea154f9de6aa292cea4e5590d0e22"}
May 21 18:24:23.904912 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:23.904876    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6m59b" event={"ID":"82ec9015-56f3-4b85-90da-4ed754adfd36","Type":"ContainerStarted","Data":"267385cab04d0836487323dfba3f7ee6c08455c35b43d10b5888fc20f4a9db7e"}
May 21 18:24:23.905305 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:23.905024    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:23.935445 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:23.935381    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-6m59b" podStartSLOduration=2.188408152 podStartE2EDuration="6.93536807s" podCreationTimestamp="2026-05-21 18:24:17 +0000 UTC" firstStartedPulling="2026-05-21 18:24:18.138333826 +0000 UTC m=+662.687152412" lastFinishedPulling="2026-05-21 18:24:22.885293731 +0000 UTC m=+667.434112330" observedRunningTime="2026-05-21 18:24:23.935167894 +0000 UTC m=+668.483986502" watchObservedRunningTime="2026-05-21 18:24:23.93536807 +0000 UTC m=+668.484186678"
May 21 18:24:29.935942 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:29.935915    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-6m59b"
May 21 18:24:30.808819 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:30.808781    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bb4747f8d-pdsjl"]
May 21 18:24:30.812209 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:30.812190    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:30.818639 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:30.818614    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-62rk2\""
May 21 18:24:30.824892 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:30.824867    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb4747f8d-pdsjl"]
May 21 18:24:31.012240 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.012208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtnr\" (UniqueName: \"kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr\") pod \"authorino-6bb4747f8d-pdsjl\" (UID: \"abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1\") " pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:31.061632 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.061557    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb4747f8d-pdsjl"]
May 21 18:24:31.061781 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:24:31.061762    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cvtnr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6bb4747f8d-pdsjl" podUID="abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1"
May 21 18:24:31.110963 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.110936    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:24:31.112923 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.112894    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtnr\" (UniqueName: \"kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr\") pod \"authorino-6bb4747f8d-pdsjl\" (UID: \"abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1\") " pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:31.113985 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.113966    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.117221 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.117194    2573 status_manager.go:895] "Failed to get status for pod" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" pod="kuadrant-system/authorino-867c886dcb-2zrl6" err="pods \"authorino-867c886dcb-2zrl6\" is forbidden: User \"system:node:ip-10-0-143-212.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-212.ec2.internal' and this object"
May 21 18:24:31.117646 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.117626    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 18:24:31.133215 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.133194    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:24:31.134404 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.134382    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtnr\" (UniqueName: \"kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr\") pod \"authorino-6bb4747f8d-pdsjl\" (UID: \"abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1\") " pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:31.213809 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.213772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.213968 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.213813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5294\" (UniqueName: \"kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.314355 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.314271    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.314355 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.314309    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5294\" (UniqueName: \"kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.316805 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.316782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.326266 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.326244    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5294\" (UniqueName: \"kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294\") pod \"authorino-867c886dcb-2zrl6\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") " pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.422758 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.422723    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:24:31.553124 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.553092    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:24:31.556078 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:24:31.556053    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39cf18f9_d14b_4be2_825c_d866f2388f53.slice/crio-c58f4ba4d91c25472f9a1fec56b6172ddcfaa6cf5ea6ae563cc0c592a5f3359d WatchSource:0}: Error finding container c58f4ba4d91c25472f9a1fec56b6172ddcfaa6cf5ea6ae563cc0c592a5f3359d: Status 404 returned error can't find the container with id c58f4ba4d91c25472f9a1fec56b6172ddcfaa6cf5ea6ae563cc0c592a5f3359d
May 21 18:24:31.929839 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.929799    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c886dcb-2zrl6" event={"ID":"39cf18f9-d14b-4be2-825c-d866f2388f53","Type":"ContainerStarted","Data":"c58f4ba4d91c25472f9a1fec56b6172ddcfaa6cf5ea6ae563cc0c592a5f3359d"}
May 21 18:24:31.929839 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.929808    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:31.934397 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:31.934374    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:32.018062 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.018043    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvtnr\" (UniqueName: \"kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr\") pod \"abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1\" (UID: \"abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1\") "
May 21 18:24:32.020112 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.020087    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr" (OuterVolumeSpecName: "kube-api-access-cvtnr") pod "abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1" (UID: "abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1"). InnerVolumeSpecName "kube-api-access-cvtnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:32.118801 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.118771    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvtnr\" (UniqueName: \"kubernetes.io/projected/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1-kube-api-access-cvtnr\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:24:32.934413 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.934381    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb4747f8d-pdsjl"
May 21 18:24:32.934413 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.934403    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c886dcb-2zrl6" event={"ID":"39cf18f9-d14b-4be2-825c-d866f2388f53","Type":"ContainerStarted","Data":"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"}
May 21 18:24:32.956014 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.955967    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-867c886dcb-2zrl6" podStartSLOduration=1.541325821 podStartE2EDuration="1.955954207s" podCreationTimestamp="2026-05-21 18:24:31 +0000 UTC" firstStartedPulling="2026-05-21 18:24:31.557332188 +0000 UTC m=+676.106150774" lastFinishedPulling="2026-05-21 18:24:31.971960574 +0000 UTC m=+676.520779160" observedRunningTime="2026-05-21 18:24:32.955313415 +0000 UTC m=+677.504132024" watchObservedRunningTime="2026-05-21 18:24:32.955954207 +0000 UTC m=+677.504772814"
May 21 18:24:32.987877 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.987842    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb4747f8d-pdsjl"]
May 21 18:24:32.997928 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:32.997902    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bb4747f8d-pdsjl"]
May 21 18:24:34.051478 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:24:34.051442    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1" path="/var/lib/kubelet/pods/abbef19f-7e0e-4a27-8bfd-ba5ec2ad52b1/volumes"
May 21 18:25:37.857260 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.857223    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"]
May 21 18:25:37.861649 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.861632    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:37.875046 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.875027    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 18:25:37.875716 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.875702    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 18:25:37.876419 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.876405    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z4gdk\""
May 21 18:25:37.876419 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.876414    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 18:25:37.894423 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:37.894393    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"]
May 21 18:25:38.041511 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.041701 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041545    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef944243-8924-4279-bb3d-b4b7ad8158eb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.041701 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.041701 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hsx\" (UniqueName: \"kubernetes.io/projected/ef944243-8924-4279-bb3d-b4b7ad8158eb-kube-api-access-b5hsx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.041852 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.041852 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.041747    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.142614 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142568    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.142798 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142625    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.142798 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142682    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.142798 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142745    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef944243-8924-4279-bb3d-b4b7ad8158eb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.142798 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142771    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.143004 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.142807    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hsx\" (UniqueName: \"kubernetes.io/projected/ef944243-8924-4279-bb3d-b4b7ad8158eb-kube-api-access-b5hsx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.143361 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.143096    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.143361 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.143130    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.143361 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.143323    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.145762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.145736    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef944243-8924-4279-bb3d-b4b7ad8158eb-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.146838 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.146815    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef944243-8924-4279-bb3d-b4b7ad8158eb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.154859 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.154838    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hsx\" (UniqueName: \"kubernetes.io/projected/ef944243-8924-4279-bb3d-b4b7ad8158eb-kube-api-access-b5hsx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp\" (UID: \"ef944243-8924-4279-bb3d-b4b7ad8158eb\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.170711 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.170687    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:38.331158 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:38.331134    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"]
May 21 18:25:38.333715 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:25:38.333681    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef944243_8924_4279_bb3d_b4b7ad8158eb.slice/crio-334d9782259f1c62e658ca37febb5842ee623eb698b6e395ebaaa83243ce895a WatchSource:0}: Error finding container 334d9782259f1c62e658ca37febb5842ee623eb698b6e395ebaaa83243ce895a: Status 404 returned error can't find the container with id 334d9782259f1c62e658ca37febb5842ee623eb698b6e395ebaaa83243ce895a
May 21 18:25:39.133163 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:39.133098    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp" event={"ID":"ef944243-8924-4279-bb3d-b4b7ad8158eb","Type":"ContainerStarted","Data":"334d9782259f1c62e658ca37febb5842ee623eb698b6e395ebaaa83243ce895a"}
May 21 18:25:44.154191 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:44.154155    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp" event={"ID":"ef944243-8924-4279-bb3d-b4b7ad8158eb","Type":"ContainerStarted","Data":"5b4b62268fb0f72a351deeb8064f00e201f209fa3d68c7e680991347ab3b0bc1"}
May 21 18:25:53.185997 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:53.185956    2573 generic.go:358] "Generic (PLEG): container finished" podID="ef944243-8924-4279-bb3d-b4b7ad8158eb" containerID="5b4b62268fb0f72a351deeb8064f00e201f209fa3d68c7e680991347ab3b0bc1" exitCode=0
May 21 18:25:53.186350 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:53.186030    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp" event={"ID":"ef944243-8924-4279-bb3d-b4b7ad8158eb","Type":"ContainerDied","Data":"5b4b62268fb0f72a351deeb8064f00e201f209fa3d68c7e680991347ab3b0bc1"}
May 21 18:25:55.194555 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:55.194521    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp" event={"ID":"ef944243-8924-4279-bb3d-b4b7ad8158eb","Type":"ContainerStarted","Data":"6063db596a4f2184323ab2f2cfebd703e9c86a1f77987580cfdc92b1557ddf24"}
May 21 18:25:55.194977 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:55.194716    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:25:55.215651 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:25:55.215604    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp" podStartSLOduration=2.202217622 podStartE2EDuration="18.215589723s" podCreationTimestamp="2026-05-21 18:25:37 +0000 UTC" firstStartedPulling="2026-05-21 18:25:38.335388247 +0000 UTC m=+742.884206833" lastFinishedPulling="2026-05-21 18:25:54.348760333 +0000 UTC m=+758.897578934" observedRunningTime="2026-05-21 18:25:55.214348637 +0000 UTC m=+759.763167246" watchObservedRunningTime="2026-05-21 18:25:55.215589723 +0000 UTC m=+759.764408330"
May 21 18:26:02.488500 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.488462    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"]
May 21 18:26:02.520105 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.520073    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"]
May 21 18:26:02.520281 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.520200    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.522973 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.522949    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 18:26:02.655384 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlr2b\" (UniqueName: \"kubernetes.io/projected/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kube-api-access-dlr2b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.655563 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.655563 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.655563 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.655563 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.655563 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.655553    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.756916 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.756833    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.756916 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.756882    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlr2b\" (UniqueName: \"kubernetes.io/projected/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kube-api-access-dlr2b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.756916 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.756918    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757192 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.756934    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757192 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.756969    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757192 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.757043    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757344 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.757278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757344 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.757315    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.757466 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.757345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.759286 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.759264    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.759470 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.759454    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.765688 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.765667    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlr2b\" (UniqueName: \"kubernetes.io/projected/7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff-kube-api-access-dlr2b\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf\" (UID: \"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.830335 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.830292    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:02.965825 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.965796    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"]
May 21 18:26:02.968058 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:26:02.968032    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8fd0cf_27bb_48fd_bfc1_2b483d9897ff.slice/crio-9cf10ad18de547d2d16ad938cc6e8419fca13de76fdb7522daa351af862aa89f WatchSource:0}: Error finding container 9cf10ad18de547d2d16ad938cc6e8419fca13de76fdb7522daa351af862aa89f: Status 404 returned error can't find the container with id 9cf10ad18de547d2d16ad938cc6e8419fca13de76fdb7522daa351af862aa89f
May 21 18:26:02.969848 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:02.969828    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:26:03.221766 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:03.221727    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf" event={"ID":"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff","Type":"ContainerStarted","Data":"6257b95196c2b531570269c7df20464da568c723ce1411ddcdfe2d719629da27"}
May 21 18:26:03.221766 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:03.221768    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf" event={"ID":"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff","Type":"ContainerStarted","Data":"9cf10ad18de547d2d16ad938cc6e8419fca13de76fdb7522daa351af862aa89f"}
May 21 18:26:06.211467 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:06.211407    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp"
May 21 18:26:09.245841 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:09.245803    2573 generic.go:358] "Generic (PLEG): container finished" podID="7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff" containerID="6257b95196c2b531570269c7df20464da568c723ce1411ddcdfe2d719629da27" exitCode=0
May 21 18:26:09.246314 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:09.245882    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf" event={"ID":"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff","Type":"ContainerDied","Data":"6257b95196c2b531570269c7df20464da568c723ce1411ddcdfe2d719629da27"}
May 21 18:26:10.251221 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:10.251183    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf" event={"ID":"7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff","Type":"ContainerStarted","Data":"70a0b2976e860973456d425b9933d7d0a51cb50c0a0ef3331391110096310995"}
May 21 18:26:10.251616 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:10.251401    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:26:10.298732 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:10.298674    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf" podStartSLOduration=8.069408376 podStartE2EDuration="8.298657274s" podCreationTimestamp="2026-05-21 18:26:02 +0000 UTC" firstStartedPulling="2026-05-21 18:26:09.246638874 +0000 UTC m=+773.795457461" lastFinishedPulling="2026-05-21 18:26:09.475887768 +0000 UTC m=+774.024706359" observedRunningTime="2026-05-21 18:26:10.29530048 +0000 UTC m=+774.844119090" watchObservedRunningTime="2026-05-21 18:26:10.298657274 +0000 UTC m=+774.847475884"
May 21 18:26:16.532785 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.532741    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:26:16.533262 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.533000    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-867c886dcb-2zrl6" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" containerName="authorino" containerID="cri-o://d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1" gracePeriod=30
May 21 18:26:16.780018 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.779995    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:26:16.884988 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.884956    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5294\" (UniqueName: \"kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294\") pod \"39cf18f9-d14b-4be2-825c-d866f2388f53\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") "
May 21 18:26:16.885155 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.885077    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert\") pod \"39cf18f9-d14b-4be2-825c-d866f2388f53\" (UID: \"39cf18f9-d14b-4be2-825c-d866f2388f53\") "
May 21 18:26:16.887106 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.887076    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294" (OuterVolumeSpecName: "kube-api-access-l5294") pod "39cf18f9-d14b-4be2-825c-d866f2388f53" (UID: "39cf18f9-d14b-4be2-825c-d866f2388f53"). InnerVolumeSpecName "kube-api-access-l5294". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:26:16.894233 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.894209    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "39cf18f9-d14b-4be2-825c-d866f2388f53" (UID: "39cf18f9-d14b-4be2-825c-d866f2388f53"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:26:16.986300 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.986264    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39cf18f9-d14b-4be2-825c-d866f2388f53-tls-cert\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:26:16.986300 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:16.986297    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5294\" (UniqueName: \"kubernetes.io/projected/39cf18f9-d14b-4be2-825c-d866f2388f53-kube-api-access-l5294\") on node \"ip-10-0-143-212.ec2.internal\" DevicePath \"\""
May 21 18:26:17.277462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.277350    2573 generic.go:358] "Generic (PLEG): container finished" podID="39cf18f9-d14b-4be2-825c-d866f2388f53" containerID="d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1" exitCode=0
May 21 18:26:17.277462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.277404    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c886dcb-2zrl6" event={"ID":"39cf18f9-d14b-4be2-825c-d866f2388f53","Type":"ContainerDied","Data":"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"}
May 21 18:26:17.277462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.277410    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867c886dcb-2zrl6"
May 21 18:26:17.277462 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.277452    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867c886dcb-2zrl6" event={"ID":"39cf18f9-d14b-4be2-825c-d866f2388f53","Type":"ContainerDied","Data":"c58f4ba4d91c25472f9a1fec56b6172ddcfaa6cf5ea6ae563cc0c592a5f3359d"}
May 21 18:26:17.277730 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.277463    2573 scope.go:117] "RemoveContainer" containerID="d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"
May 21 18:26:17.285373 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.285349    2573 scope.go:117] "RemoveContainer" containerID="d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"
May 21 18:26:17.285633 ip-10-0-143-212 kubenswrapper[2573]: E0521 18:26:17.285616    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1\": container with ID starting with d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1 not found: ID does not exist" containerID="d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"
May 21 18:26:17.285694 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.285643    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1"} err="failed to get container status \"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1\": rpc error: code = NotFound desc = could not find container \"d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1\": container with ID starting with d2027f1409caa0d4737cf0998909bbde369b43102b3e3da0bc6de6fa71bae4c1 not found: ID does not exist"
May 21 18:26:17.298173 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.298146    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:26:17.307821 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:17.307800    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-867c886dcb-2zrl6"]
May 21 18:26:18.051003 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:18.050970    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" path="/var/lib/kubelet/pods/39cf18f9-d14b-4be2-825c-d866f2388f53/volumes"
May 21 18:26:21.268846 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:26:21.268816    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf"
May 21 18:28:16.001935 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:28:16.001855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:28:16.003130 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:28:16.003112    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:33:16.024525 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:33:16.024500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:33:16.026979 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:33:16.026959    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:38:16.046643 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:38:16.046608    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:38:16.050421 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:38:16.050400    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:43:16.069813 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:43:16.069783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:43:16.073571 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:43:16.073554    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:48:16.095307 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:16.095208    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:48:16.099514 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:16.097985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qm47_7cd38dce-e6cd-4a14-b6d6-6480d1b2c468/ovn-acl-logging/0.log"
May 21 18:48:51.789764 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:51.789733    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-hlx4w_e1120a83-6184-4710-9fe3-d499f0d3d7a6/manager/0.log"
May 21 18:48:52.410127 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:52.410096    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fnsbv_67eed7e4-42df-4f29-b4c0-848347fbd62e/manager/2.log"
May 21 18:48:52.637941 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:52.637911    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-v7lsb_e0638aa4-75b4-4d39-b99e-ca7a65cc17b6/manager/0.log"
May 21 18:48:52.852917 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:52.852835    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6m59b_82ec9015-56f3-4b85-90da-4ed754adfd36/postgres/0.log"
May 21 18:48:54.223101 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:54.223070    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-k86pz_675ff6d2-7bfd-4cbc-965d-058e1dd668ab/manager/0.log"
May 21 18:48:54.905148 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:54.905110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6qld4_434c7f7a-333a-4aa4-9d2e-fe835caee622/manager/0.log"
May 21 18:48:55.361396 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:55.361321    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zs6zs_b620a995-5cda-477b-a792-22371cdabcee/discovery/0.log"
May 21 18:48:55.467525 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:55.467496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78678676dd-5sn6d_f0a269ad-4160-4656-9c47-1860e5c69426/kube-auth-proxy/0.log"
May 21 18:48:56.356795 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:56.356765    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf_7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff/storage-initializer/0.log"
May 21 18:48:56.363330 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:56.363305    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-24jhf_7f8fd0cf-27bb-48fd-bfc1-2b483d9897ff/main/0.log"
May 21 18:48:56.819674 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:56.819645    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp_ef944243-8924-4279-bb3d-b4b7ad8158eb/storage-initializer/0.log"
May 21 18:48:56.826069 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:48:56.826036    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-kkkvp_ef944243-8924-4279-bb3d-b4b7ad8158eb/main/0.log"
May 21 18:49:04.231512 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:04.231479    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8x9pf_15582ef4-2ce2-43fa-a745-9caaa5d52a2f/global-pull-secret-syncer/0.log"
May 21 18:49:04.402458 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:04.402391    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktf6t_9f6bf68a-2523-4d9f-9a5f-33dcaa2fb772/konnectivity-agent/0.log"
May 21 18:49:04.509661 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:04.509586    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-212.ec2.internal_b01b9b61a0c59290285bf57aa48a1d46/haproxy/0.log"
May 21 18:49:08.778107 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:08.778042    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-k86pz_675ff6d2-7bfd-4cbc-965d-058e1dd668ab/manager/0.log"
May 21 18:49:09.069714 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:09.069613    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-6qld4_434c7f7a-333a-4aa4-9d2e-fe835caee622/manager/0.log"
May 21 18:49:11.066611 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.066572    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/node-exporter/0.log"
May 21 18:49:11.098665 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.098639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/kube-rbac-proxy/0.log"
May 21 18:49:11.121949 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.121920    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snpk8_17bf9b7a-e9c1-45e7-a573-e41f46db476d/init-textfile/0.log"
May 21 18:49:11.550393 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.550366    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b6bfd8d5-zz55g_bd57fe10-f869-4303-8781-8b0622054ec9/telemeter-client/0.log"
May 21 18:49:11.572677 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.572655    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b6bfd8d5-zz55g_bd57fe10-f869-4303-8781-8b0622054ec9/reload/0.log"
May 21 18:49:11.594834 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:11.594801    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9b6bfd8d5-zz55g_bd57fe10-f869-4303-8781-8b0622054ec9/kube-rbac-proxy/0.log"
May 21 18:49:12.887246 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.887210    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"]
May 21 18:49:12.887756 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.887535    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" containerName="authorino"
May 21 18:49:12.887756 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.887548    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" containerName="authorino"
May 21 18:49:12.887756 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.887623    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="39cf18f9-d14b-4be2-825c-d866f2388f53" containerName="authorino"
May 21 18:49:12.890637 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.890619    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:12.893452 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.893416    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"kube-root-ca.crt\""
May 21 18:49:12.894494 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.894476    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44fjf\"/\"default-dockercfg-h4s9z\""
May 21 18:49:12.894612 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.894484    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44fjf\"/\"openshift-service-ca.crt\""
May 21 18:49:12.897353 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.897334    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"]
May 21 18:49:12.947248 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.947214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-proc\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:12.947384 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.947275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-sys\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:12.947384 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.947298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-podres\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:12.947384 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.947327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhxwx\" (UniqueName: \"kubernetes.io/projected/54946791-66af-48c2-b103-87050b8f94de-kube-api-access-hhxwx\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:12.947384 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:12.947355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-lib-modules\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048719 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048682    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-sys\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048725    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-podres\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048760    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhxwx\" (UniqueName: \"kubernetes.io/projected/54946791-66af-48c2-b103-87050b8f94de-kube-api-access-hhxwx\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048783    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-lib-modules\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048800    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-sys\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048807    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-proc\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.048893 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048849    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-proc\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.049135 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048932    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-podres\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.049135 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.048955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54946791-66af-48c2-b103-87050b8f94de-lib-modules\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.057629 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.057607    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhxwx\" (UniqueName: \"kubernetes.io/projected/54946791-66af-48c2-b103-87050b8f94de-kube-api-access-hhxwx\") pod \"perf-node-gather-daemonset-lq5qw\" (UID: \"54946791-66af-48c2-b103-87050b8f94de\") " pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.201128 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.201040    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.328599 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.328414    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"]
May 21 18:49:13.331539 ip-10-0-143-212 kubenswrapper[2573]: W0521 18:49:13.331504    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod54946791_66af_48c2_b103_87050b8f94de.slice/crio-5fc24fcedf80445dcc67d7e22209024130fd2925ad40e2a0f3d57caa5f82819b WatchSource:0}: Error finding container 5fc24fcedf80445dcc67d7e22209024130fd2925ad40e2a0f3d57caa5f82819b: Status 404 returned error can't find the container with id 5fc24fcedf80445dcc67d7e22209024130fd2925ad40e2a0f3d57caa5f82819b
May 21 18:49:13.333285 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.333267    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:49:13.651608 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.651577    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw" event={"ID":"54946791-66af-48c2-b103-87050b8f94de","Type":"ContainerStarted","Data":"2304d8f075f7d60dbb1bb291ccdfc97b88e1fb92f04e7321b70c315403c781c7"}
May 21 18:49:13.651608 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.651612    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw" event={"ID":"54946791-66af-48c2-b103-87050b8f94de","Type":"ContainerStarted","Data":"5fc24fcedf80445dcc67d7e22209024130fd2925ad40e2a0f3d57caa5f82819b"}
May 21 18:49:13.651822 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.651670    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:13.668706 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:13.668630    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw" podStartSLOduration=1.668615853 podStartE2EDuration="1.668615853s" podCreationTimestamp="2026-05-21 18:49:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:49:13.667576384 +0000 UTC m=+2158.216394993" watchObservedRunningTime="2026-05-21 18:49:13.668615853 +0000 UTC m=+2158.217434460"
May 21 18:49:15.533295 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:15.533263    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8jd4_5ee131c5-ff5b-413e-b9fb-fcdf532034c7/dns/0.log"
May 21 18:49:15.554406 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:15.554376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8jd4_5ee131c5-ff5b-413e-b9fb-fcdf532034c7/kube-rbac-proxy/0.log"
May 21 18:49:15.646548 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:15.646519    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7ljj_1e567af8-9733-43b7-a179-6f7a46691c1d/dns-node-resolver/0.log"
May 21 18:49:16.137347 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:16.137319    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-667794b779-5jl2b_31a31bdb-6ce0-4e0c-a034-90441a70d832/registry/0.log"
May 21 18:49:16.159653 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:16.159624    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6562x_b43dc239-9ad2-41bf-a1c2-14dd188ed3f1/node-ca/0.log"
May 21 18:49:17.230732 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:17.230700    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zs6zs_b620a995-5cda-477b-a792-22371cdabcee/discovery/0.log"
May 21 18:49:17.257730 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:17.257702    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78678676dd-5sn6d_f0a269ad-4160-4656-9c47-1860e5c69426/kube-auth-proxy/0.log"
May 21 18:49:18.014535 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:18.014507    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jkkwr_7350ad5a-e1a4-4142-bf02-013532600586/serve-healthcheck-canary/0.log"
May 21 18:49:18.675039 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:18.675012    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzlch_40ebec92-b634-4813-8fad-fa6642d7c7d0/kube-rbac-proxy/0.log"
May 21 18:49:18.696625 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:18.696600    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzlch_40ebec92-b634-4813-8fad-fa6642d7c7d0/exporter/0.log"
May 21 18:49:18.718626 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:18.718592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pzlch_40ebec92-b634-4813-8fad-fa6642d7c7d0/extractor/0.log"
May 21 18:49:19.665680 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:19.665657    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44fjf/perf-node-gather-daemonset-lq5qw"
May 21 18:49:20.607241 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:20.607209    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-hlx4w_e1120a83-6184-4710-9fe3-d499f0d3d7a6/manager/0.log"
May 21 18:49:20.837762 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:20.837730    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fnsbv_67eed7e4-42df-4f29-b4c0-848347fbd62e/manager/1.log"
May 21 18:49:20.848379 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:20.848350    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fnsbv_67eed7e4-42df-4f29-b4c0-848347fbd62e/manager/2.log"
May 21 18:49:20.927992 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:20.927967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5948ffb7d5-v7lsb_e0638aa4-75b4-4d39-b99e-ca7a65cc17b6/manager/0.log"
May 21 18:49:20.983468 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:20.983421    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6m59b_82ec9015-56f3-4b85-90da-4ed754adfd36/postgres/0.log"
May 21 18:49:28.111538 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.111508    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2z6pj_9060fbbe-3b62-4347-8b39-7efbae1ced53/kube-multus/0.log"
May 21 18:49:28.479410 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.479383    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/kube-multus-additional-cni-plugins/0.log"
May 21 18:49:28.506019 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.505983    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/egress-router-binary-copy/0.log"
May 21 18:49:28.528214 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.528192    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/cni-plugins/0.log"
May 21 18:49:28.551422 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.551397    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/bond-cni-plugin/0.log"
May 21 18:49:28.575097 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.575072    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/routeoverride-cni/0.log"
May 21 18:49:28.598154 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.598127    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/whereabouts-cni-bincopy/0.log"
May 21 18:49:28.620603 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.620585    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kd7c8_b59fce9a-fff5-4a41-8cef-4f4a83f222cd/whereabouts-cni/0.log"
May 21 18:49:28.772986 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.772906    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cm8sn_e69e9e6a-c6b5-4970-bc1c-c4204c3002f3/network-metrics-daemon/0.log"
May 21 18:49:28.798486 ip-10-0-143-212 kubenswrapper[2573]: I0521 18:49:28.798457    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cm8sn_e69e9e6a-c6b5-4970-bc1c-c4204c3002f3/kube-rbac-proxy/0.log"