May 21 12:34:51.920979 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 12:34:51.920992 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 12:34:51.921002 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 12:34:51.921333 ip-10-0-143-244 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 12:35:01.503033 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 12:35:01.503046 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1bc779081d3b44f3905846defae4db59 --
May 21 12:37:21.240195 ip-10-0-143-244 systemd[1]: Starting Kubernetes Kubelet...
May 21 12:37:21.766321 ip-10-0-143-244 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 12:37:21.766321 ip-10-0-143-244 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 12:37:21.766321 ip-10-0-143-244 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 12:37:21.766321 ip-10-0-143-244 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 12:37:21.766321 ip-10-0-143-244 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 12:37:21.768687 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.768554    2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 12:37:21.778395 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778371    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 12:37:21.778395 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778392    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 12:37:21.778395 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778397    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 12:37:21.778395 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778401    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 12:37:21.778395 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778404    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778407    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778410    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778413    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778416    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778419    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778421    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778424    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778427    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778429    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778432    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778435    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778437    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778440    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778443    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778445    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778448    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778455    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778458    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778461    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 12:37:21.778591 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778464    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778468    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778472    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778475    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778478    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778481    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778484    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778486    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778489    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778492    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778494    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778498    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778501    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778503    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778508    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778511    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778514    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778516    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778519    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 12:37:21.779096 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778522    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778525    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778537    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778540    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778543    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778545    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778548    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778550    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778553    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778556    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778558    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778561    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778563    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778566    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778568    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778571    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778573    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778576    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778579    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778582    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 12:37:21.779604 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778584    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778587    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778589    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778592    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778595    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778597    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778600    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778603    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778606    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778609    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778611    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778614    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778617    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778619    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778622    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778631    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778634    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778637    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778640    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778642    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 12:37:21.780112 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778645    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778647    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.778649    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779091    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779096    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779099    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779102    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779105    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779108    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779111    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779114    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779117    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779119    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779122    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779124    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779127    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779129    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779132    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779135    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779138    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 12:37:21.780586 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779140    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779143    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779146    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779148    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779151    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779153    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779156    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779164    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779167    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779170    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779172    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779175    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779177    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779180    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779183    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779185    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779188    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779190    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779193    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779196    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 12:37:21.781107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779198    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779201    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779205    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779208    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779211    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779215    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779218    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779221    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779224    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779227    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779229    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779232    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779234    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779237    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779239    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779242    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779244    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779247    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779249    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 12:37:21.781602 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779252    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779260    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779263    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779266    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779268    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779271    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779273    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779276    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779278    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779281    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779283    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779286    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779289    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779291    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779294    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779297    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779299    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779302    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779305    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 12:37:21.782098 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779308    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779311    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779314    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779317    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779319    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779323    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779327    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779330    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779333    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779336    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.779339    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780037    2567 flags.go:64] FLAG: --address="0.0.0.0"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780048    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780063    2567 flags.go:64] FLAG: --anonymous-auth="true"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780068    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780080    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780084    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780088    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780093    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780096    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 12:37:21.782564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780099    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780103    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780111    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780114    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780117    2567 flags.go:64] FLAG: --cgroup-root=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780120    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780124    2567 flags.go:64] FLAG: --client-ca-file=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780126    2567 flags.go:64] FLAG: --cloud-config=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780129    2567 flags.go:64] FLAG: --cloud-provider="external"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780132    2567 flags.go:64] FLAG: --cluster-dns="[]"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780139    2567 flags.go:64] FLAG: --cluster-domain=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780141    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780145    2567 flags.go:64] FLAG: --config-dir=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780147    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780151    2567 flags.go:64] FLAG: --container-log-max-files="5"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780155    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780158    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780161    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780164    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780167    2567 flags.go:64] FLAG: --contention-profiling="false"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780170    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780173    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780177    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780180    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780184    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 12:37:21.783081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780187    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780190    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780193    2567 flags.go:64] FLAG: --enable-load-reader="false"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780203    2567 flags.go:64] FLAG: --enable-server="true"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780207    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780214    2567 flags.go:64] FLAG: --event-burst="100"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780217    2567 flags.go:64] FLAG: --event-qps="50"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780220    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780223    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780228    2567 flags.go:64] FLAG: --eviction-hard=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780231    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780234    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780237    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780240    2567 flags.go:64] FLAG: --eviction-soft=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780243    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780246    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780249    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780252    2567 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780255    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780258    2567 flags.go:64] FLAG: --fail-swap-on="true"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780261    2567 flags.go:64] FLAG: --feature-gates=""
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780265    2567 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780268    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780271    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780274    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780277    2567 flags.go:64] FLAG: --healthz-port="10248"
May 21 12:37:21.783675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780280    2567 flags.go:64] FLAG: --help="false"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780283    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-244.ec2.internal"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780286    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780289    2567 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780292    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780295    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780299    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780302    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780304    2567 flags.go:64] FLAG: --image-service-endpoint=""
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780307    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780316    2567 flags.go:64] FLAG: --kube-api-burst="100"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780319    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780322    2567 flags.go:64] FLAG: --kube-api-qps="50"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780325    2567 flags.go:64] FLAG: --kube-reserved=""
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780328    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780332    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780335    2567 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780338    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780341    2567 flags.go:64] FLAG: --lock-file=""
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780344    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780347    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780350    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780355    2567 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 12:37:21.784318 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780358    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780360    2567 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780363    2567 flags.go:64] FLAG: --logging-format="text"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780366    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780370    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780373    2567 flags.go:64] FLAG: --manifest-url=""
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780376    2567 flags.go:64] FLAG: --manifest-url-header=""
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780380    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780383    2567 flags.go:64] FLAG: --max-open-files="1000000"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780387    2567 flags.go:64] FLAG: --max-pods="110"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780390    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780393    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780396    2567 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780399    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780402    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780405    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780408    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780415    2567 flags.go:64] FLAG: --node-status-max-images="50"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780418    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780421    2567 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780430    2567 flags.go:64] FLAG: --pod-cidr=""
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780434    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780439    2567 flags.go:64] FLAG: --pod-manifest-path=""
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780442    2567 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 12:37:21.784925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780445    2567 flags.go:64] FLAG: --pods-per-core="0"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780449    2567 flags.go:64] FLAG: --port="10250"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780452    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780455    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c7e1b9434767ba0"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780458    2567 flags.go:64] FLAG: --qos-reserved=""
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780461    2567 flags.go:64] FLAG: --read-only-port="10255"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780464    2567 flags.go:64] FLAG: --register-node="true"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780467    2567 flags.go:64] FLAG: --register-schedulable="true"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780470    2567 flags.go:64] FLAG: --register-with-taints=""
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780473    2567 flags.go:64] FLAG: --registry-burst="10"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780476    2567 flags.go:64] FLAG: --registry-qps="5"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780479    2567 flags.go:64] FLAG: --reserved-cpus=""
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780482    2567 flags.go:64] FLAG: --reserved-memory=""
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780486    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780489    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780492    2567 flags.go:64] FLAG: --rotate-certificates="false"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780495    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780497    2567 flags.go:64] FLAG: --runonce="false"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780500    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780504    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780507    2567 flags.go:64] FLAG: --seccomp-default="false"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780510    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780512    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780515    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780518    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780521    2567 flags.go:64] FLAG: --storage-driver-password="root"
May 21 12:37:21.785504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780524    2567 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780527    2567 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780530    2567 flags.go:64] FLAG: --storage-driver-user="root"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780538    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780542    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780548    2567 flags.go:64] FLAG: --system-cgroups=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780551    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780558    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780561    2567 flags.go:64] FLAG: --tls-cert-file=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780564    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780570    2567 flags.go:64] FLAG: --tls-min-version=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780573    2567 flags.go:64] FLAG: --tls-private-key-file=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780576    2567 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780579    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780581    2567 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780585    2567 flags.go:64] FLAG: --v="2"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780589    2567 flags.go:64] FLAG: --version="false"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780595    2567 flags.go:64] FLAG: --vmodule=""
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780599    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.780602    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780723    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780727    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780730    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780733    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 12:37:21.786196 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780736    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780739    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780743    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780746    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780749    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780751    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780754    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780757    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780760    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780762    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780765    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780781    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780789    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780792    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780795    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780798    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780801    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780803    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780806    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780809    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 12:37:21.786800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780811    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780814    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780816    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780819    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780821    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780824    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780827    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780829    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780832    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780834    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780837    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780839    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780842    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780844    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780846    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780849    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780851    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780854    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780856    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780859    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 12:37:21.787307 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780861    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780864    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780866    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780869    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780872    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780880    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780883    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780885    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780888    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780891    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780894    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780897    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780899    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780903    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780906    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780909    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780912    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780915    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780917    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780920    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 12:37:21.787810 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780922    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780925    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780927    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780930    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780949    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780953    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780956    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780959    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780961    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780964    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780966    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780969    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780971    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780974    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780979    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780982    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780985    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780988    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.780996    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.781000    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 12:37:21.788333 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.781003    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.781005    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.781010    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.787965    2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.787982    2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788032    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788037    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788041    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788044    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788047    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788050    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788053    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788056    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788059    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788061    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 12:37:21.788839 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788064    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788067    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788070    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788073    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788075    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788078    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788080    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788083    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788086    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788088    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788091    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788093    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788096    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788098    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788101    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788105    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788108    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788110    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788113    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788115    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 12:37:21.789287 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788118    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788122    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788124    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788127    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788129    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788132    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788135    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788137    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788140    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788143    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788145    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788147    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788150    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788154    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788157    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788160    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788163    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788166    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788168    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 12:37:21.789834 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788171    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788174    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788176    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788179    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788181    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788184    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788186    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788189    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788191    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788194    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788197    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788200    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788202    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788205    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788208    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788211    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788214    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788216    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788219    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788221    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 12:37:21.790301 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788224    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788226    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788229    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788232    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788234    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788237    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788240    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788242    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788245    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788248    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788250    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788254    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788258    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788261    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788264    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788267    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 12:37:21.790796 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788269    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.788275    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788376    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788381    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788384    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788387    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788391    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788393    2567 feature_gate.go:328] unrecognized feature gate: Example
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788396    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788398    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788401    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788405    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788407    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788410    2567 feature_gate.go:328] unrecognized feature gate: Example2
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788412    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 12:37:21.791191 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788415    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788417    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788420    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788422    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788425    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788427    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788430    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788432    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788435    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788438    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788440    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788443    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788447    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788450    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788453    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788456    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788459    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788462    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788465    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788468    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 12:37:21.791597 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788470    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788473    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788476    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788478    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788481    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788484    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788486    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788489    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788492    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788495    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788497    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788500    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788502    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788505    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788508    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788510    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788513    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788515    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788518    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788520    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 12:37:21.792101 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788523    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788525    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788528    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788530    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788533    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788535    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788538    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788540    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788543    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788545    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788548    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788550    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788553    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788555    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788558    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788560    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788563    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788566    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788568    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788571    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 12:37:21.792578 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788574    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788576    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788579    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788581    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788584    2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788586    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788588    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788591    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788594    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788596    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788599    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788602    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:21.788605    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.788611    2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 12:37:21.793086 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.788720    2567 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 12:37:21.793695 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.793681    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 12:37:21.794839 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.794827    2567 server.go:1019] "Starting client certificate rotation"
May 21 12:37:21.794950 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.794932    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 12:37:21.794978 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.794973    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 12:37:21.824600 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.824580    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 12:37:21.826490 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.826468    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 12:37:21.847663 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.847636    2567 log.go:25] "Validated CRI v1 runtime API"
May 21 12:37:21.853105 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.853084    2567 log.go:25] "Validated CRI v1 image API"
May 21 12:37:21.854536 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.854522    2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 12:37:21.859024 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.859002    2567 fs.go:135] Filesystem UUIDs: map[2e15407b-531a-41bd-a0cf-95afb8074635:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 97121e1b-9efb-45d8-b441-0d88d5cf6706:/dev/nvme0n1p3]
May 21 12:37:21.859094 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.859023    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 12:37:21.863267 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.863165    2567 manager.go:217] Machine: {Timestamp:2026-05-21 12:37:21.862650305 +0000 UTC m=+0.479355108 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499996 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262f6ad822496ac4f447ba9a0576ab SystemUUID:ec262f6a-d822-496a-c4f4-47ba9a0576ab BootID:1bc77908-1d3b-44f3-9058-46defae4db59 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:0a:6a:b9:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:0a:6a:b9:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:ca:e6:e6:02:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 12:37:21.863681 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.863666    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 12:37:21.864070 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.864060    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 12:37:21.864160 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.864148    2567 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 12:37:21.866180 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.866155    2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 12:37:21.866321 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.866182    2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 12:37:21.866372 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.866330    2567 topology_manager.go:138] "Creating topology manager with none policy"
May 21 12:37:21.866372 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.866339    2567 container_manager_linux.go:306] "Creating device plugin manager"
May 21 12:37:21.866372 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.866347    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 12:37:21.867259 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.867249    2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 12:37:21.868960 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.868950    2567 state_mem.go:36] "Initialized new in-memory state store"
May 21 12:37:21.869074 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.869064    2567 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 12:37:21.871920 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.871910    2567 kubelet.go:491] "Attempting to sync node with API server"
May 21 12:37:21.871951 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.871925    2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 12:37:21.871951 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.871938    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 12:37:21.871951 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.871947    2567 kubelet.go:397] "Adding apiserver pod source"
May 21 12:37:21.872077 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.871955    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 12:37:21.873307 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.873295    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 12:37:21.873346 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.873325    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 12:37:21.876792 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.876761    2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 12:37:21.879183 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.879169    2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 12:37:21.881404 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881390    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881408    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881415    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881420    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881433    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881442    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881448    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881454    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881460    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881466    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881475    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 12:37:21.881479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.881481    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 12:37:21.882543 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.882532    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 12:37:21.882579 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.882545    2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 12:37:21.884627 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.884603    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 12:37:21.884763 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.884729    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 12:37:21.886073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.886059    2567 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 12:37:21.886148 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.886099    2567 server.go:1295] "Started kubelet"
May 21 12:37:21.886242 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.886196    2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 12:37:21.886306 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.886249    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 12:37:21.886356 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.886308    2567 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 12:37:21.887782 ip-10-0-143-244 systemd[1]: Started Kubernetes Kubelet.
May 21 12:37:21.888146 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.888074    2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 12:37:21.891572 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.891553    2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 12:37:21.895063 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.895046    2567 server.go:317] "Adding debug handlers to kubelet server"
May 21 12:37:21.898419 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898399    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 12:37:21.898419 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898410    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 12:37:21.898608 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898589    2567 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 12:37:21.898608 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898607    2567 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 12:37:21.898761 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.897504    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18b194e5a8a82f37  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-05-21 12:37:21.886072631 +0000 UTC m=+0.502777434,LastTimestamp:2026-05-21 12:37:21.886072631 +0000 UTC m=+0.502777434,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
May 21 12:37:21.898761 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898748    2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 12:37:21.898879 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898791    2567 reconstruct.go:97] "Volume reconstruction finished"
May 21 12:37:21.898879 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.898802    2567 reconciler.go:26] "Reconciler: start to sync state"
May 21 12:37:21.899326 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.899287    2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 12:37:21.899469 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.899444    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:21.899591 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899577    2567 factory.go:153] Registering CRI-O factory
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899594    2567 factory.go:223] Registration of the crio container factory successfully
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899643    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899652    2567 factory.go:55] Registering systemd factory
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899663    2567 factory.go:223] Registration of the systemd container factory successfully
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899678    2567 factory.go:103] Registering Raw factory
May 21 12:37:21.899689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.899691    2567 manager.go:1196] Started watching for new ooms in manager
May 21 12:37:21.900395 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.900380    2567 manager.go:319] Starting recovery of all containers
May 21 12:37:21.905492 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.905464    2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 12:37:21.905596 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.905518    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 12:37:21.911610 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.911494    2567 manager.go:324] Recovery completed
May 21 12:37:21.913504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.913484    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrtc2"
May 21 12:37:21.915946 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.915930    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:21.917662 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.917647    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:21.917716 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.917674    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:21.917716 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.917684    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:21.918192 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.918179    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 12:37:21.918192 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.918191    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 12:37:21.918276 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.918207    2567 state_mem.go:36] "Initialized new in-memory state store"
May 21 12:37:21.919845 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.919782    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18b194e5aa8a3081  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-244.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-05-21 12:37:21.917661313 +0000 UTC m=+0.534366116,LastTimestamp:2026-05-21 12:37:21.917661313 +0000 UTC m=+0.534366116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
May 21 12:37:21.922136 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.922123    2567 policy_none.go:49] "None policy: Start"
May 21 12:37:21.922172 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.922144    2567 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 12:37:21.922172 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.922159    2567 state_mem.go:35] "Initializing new in-memory state store"
May 21 12:37:21.922234 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.922171    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nrtc2"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964340    2567 manager.go:341] "Starting Device Plugin manager"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.964378    2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964389    2567 server.go:85] "Starting device plugin registration server"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964631    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964642    2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964734    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964907    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:21.964916    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.965410    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 12:37:21.984201 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:21.965446    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.006537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.006491    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 12:37:22.007726 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.007703    2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 12:37:22.007726 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.007724    2567 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 12:37:22.007882 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.007746    2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 12:37:22.007882 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.007754    2567 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 12:37:22.007882 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.007812    2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 12:37:22.011580 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.011560    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 12:37:22.065738 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.065663    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:22.066944 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.066928    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:22.067037 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.066958    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:22.067037 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.066968    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:22.067037 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.066992    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-244.ec2.internal"
May 21 12:37:22.075964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.075941    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-244.ec2.internal"
May 21 12:37:22.076082 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.075970    2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-244.ec2.internal\": node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.093859 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.093833    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.108795 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.108756    2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"]
May 21 12:37:22.108884 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.108837    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:22.110440 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.110425    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:22.110527 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.110458    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:22.110527 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.110472    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:22.112929 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.112913    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:22.113238 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113050    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.113238 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113081    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:22.113594 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113579    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:22.113672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113593    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:22.113672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113606    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:22.113672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113614    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:22.113672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113621    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:22.113672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.113624    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:22.115862 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.115847    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.115926 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.115872    2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 12:37:22.116613 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.116596    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
May 21 12:37:22.116696 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.116624    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
May 21 12:37:22.116696 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.116634    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
May 21 12:37:22.138327 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.138308    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
May 21 12:37:22.142669 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.142651    2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
May 21 12:37:22.194241 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.194212    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.200085 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.200063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.294692 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.294651    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.300995 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.300976    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.301066 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.301006    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.301066 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.301033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/567053fa0164152f4a9f0b75552251c3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"567053fa0164152f4a9f0b75552251c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.301133 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.301110    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.395456 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.395367    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.401667 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.401646    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.401722 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.401673    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/567053fa0164152f4a9f0b75552251c3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"567053fa0164152f4a9f0b75552251c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.401756 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.401723    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/567053fa0164152f4a9f0b75552251c3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"567053fa0164152f4a9f0b75552251c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.401756 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.401748    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ce3b1c70152c6ca64cf004056b74674-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"2ce3b1c70152c6ca64cf004056b74674\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.440852 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.440810    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.445542 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.445515    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:22.496001 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.495965    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.596497 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.596469    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.696974 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.696941    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.794504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.794469    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 12:37:22.795031 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.794613    2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 12:37:22.797613 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.797593    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.898061 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.898037    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:22.898725 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.898708    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 12:37:22.909912 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.909886    2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 12:37:22.924691 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.924634    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 12:32:21 +0000 UTC" deadline="2027-11-10 15:31:54.55752853 +0000 UTC"
May 21 12:37:22.924691 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.924662    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12914h54m31.6328689s"
May 21 12:37:22.937275 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.937241    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k4lp"
May 21 12:37:22.946251 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.946233    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k4lp"
May 21 12:37:22.985272 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:22.985229    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567053fa0164152f4a9f0b75552251c3.slice/crio-255b7a8030b7efa489aabf3a2b63d4fccbcf65e91ecfbbc04599ed87f241c378 WatchSource:0}: Error finding container 255b7a8030b7efa489aabf3a2b63d4fccbcf65e91ecfbbc04599ed87f241c378: Status 404 returned error can't find the container with id 255b7a8030b7efa489aabf3a2b63d4fccbcf65e91ecfbbc04599ed87f241c378
May 21 12:37:22.985499 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:22.985485    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce3b1c70152c6ca64cf004056b74674.slice/crio-12f0a58f7538fdde4fa4478621bb2989241df84e213befc0ccf285163d46d17a WatchSource:0}: Error finding container 12f0a58f7538fdde4fa4478621bb2989241df84e213befc0ccf285163d46d17a: Status 404 returned error can't find the container with id 12f0a58f7538fdde4fa4478621bb2989241df84e213befc0ccf285163d46d17a
May 21 12:37:22.988543 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:22.988528    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 12:37:22.998608 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:22.998587    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:23.011885 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.011844    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"567053fa0164152f4a9f0b75552251c3","Type":"ContainerStarted","Data":"255b7a8030b7efa489aabf3a2b63d4fccbcf65e91ecfbbc04599ed87f241c378"}
May 21 12:37:23.012738 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.012716    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"2ce3b1c70152c6ca64cf004056b74674","Type":"ContainerStarted","Data":"12f0a58f7538fdde4fa4478621bb2989241df84e213befc0ccf285163d46d17a"}
May 21 12:37:23.098958 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:23.098923    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:23.117627 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.117603    2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 12:37:23.199630 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:23.199555    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:23.300007 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:23.299975    2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
May 21 12:37:23.334849 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.334823    2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 12:37:23.398864 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.398835    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
May 21 12:37:23.401101 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.401069    2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 12:37:23.417387 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.417359    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 12:37:23.418820 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.418797    2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
May 21 12:37:23.430141 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.430113    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 12:37:23.872664 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.872633    2567 apiserver.go:52] "Watching apiserver"
May 21 12:37:23.882439 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.882409    2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 12:37:23.884522 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.884433    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-j97sv","openshift-network-diagnostics/network-check-target-5prsm","openshift-network-operator/iptables-alerter-hcpbd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7","openshift-cluster-node-tuning-operator/tuned-2ft4l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal","openshift-multus/multus-69jb2","openshift-multus/network-metrics-daemon-lsggw","openshift-ovn-kubernetes/ovnkube-node-gn2dt","kube-system/konnectivity-agent-tqrm5","kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal","openshift-image-registry/node-ca-m7vck"]
May 21 12:37:23.889210 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.889164    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.891493 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.891237    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:23.891493 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:23.891310    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:23.891493 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.891380    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:23.893635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.893434    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 12:37:23.893635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.893443    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 12:37:23.893635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.893610    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.894174 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894143    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 12:37:23.894331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894284    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5q27d\""
May 21 12:37:23.894572 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894556    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 12:37:23.894722 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894704    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 12:37:23.894809 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894751    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 12:37:23.894809 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.894754    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 12:37:23.895656 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.895638    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 12:37:23.895801 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.895784    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qv44q\""
May 21 12:37:23.896066 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.896047    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.898719 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.898284    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jb2"
May 21 12:37:23.900598 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.900578    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:23.900689 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:23.900648    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:23.901137 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901114    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 12:37:23.901225 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901188    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 12:37:23.901342 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901324    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q9k4l\""
May 21 12:37:23.901504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901488    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-scnj4\""
May 21 12:37:23.901575 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901547    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 12:37:23.901657 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.901640    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 12:37:23.902027 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.902006    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 12:37:23.902202 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.902185    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2pjnq\""
May 21 12:37:23.902277 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.902199    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 12:37:23.903789 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.903502    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:23.905763 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.905737    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:23.907181 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.907072    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 12:37:23.907181 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.907090    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 12:37:23.908609 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908585    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:23.908883 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h9rq\" (UniqueName: \"kubernetes.io/projected/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-kube-api-access-5h9rq\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8dn\" (UniqueName: \"kubernetes.io/projected/3136323f-36e4-4d2a-b154-7d53d33e35d8-kube-api-access-xr8dn\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysconfig\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-lib-modules\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-socket-dir-parent\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:23.908988 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.908988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-registration-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909026    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-sys-fs\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-cnibin\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909190    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-sys\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-tuned\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-cnibin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-multus-certs\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-device-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-kubernetes\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-var-lib-kubelet\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-cni-binary-copy\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-netns\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-conf-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rmpc\" (UniqueName: \"kubernetes.io/projected/9bcd021b-eab5-461b-9c49-331cca103fbf-kube-api-access-8rmpc\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gggc8\" (UniqueName: \"kubernetes.io/projected/509c9646-37ad-4665-a500-a9a454afe3a7-kube-api-access-gggc8\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.909854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-iptables-alerter-script\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdk8\" (UniqueName: \"kubernetes.io/projected/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-kube-api-access-hhdk8\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-socket-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.909984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-systemd\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-run\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-tmp\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-multus\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-daemon-config\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-etc-kubernetes\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-os-release\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-os-release\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910324 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-k8s-cni-cncf-io\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910344    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-kubelet\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-modprobe-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-host\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jchb\" (UniqueName: \"kubernetes.io/projected/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-kube-api-access-2jchb\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-host-slash\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-conf\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-system-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-bin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-hostroot\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:23.910981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.910823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-system-cni-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:23.911445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.911059    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 12:37:23.911911 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.911724    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 12:37:23.912242 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912214    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 12:37:23.912345 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912306    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 12:37:23.912460 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912431    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m8t68\""
May 21 12:37:23.912562 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912535    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 12:37:23.912790 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912737    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tnvjz\""
May 21 12:37:23.912790 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912785    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 12:37:23.913702 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912861    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 12:37:23.913702 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.912970    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 12:37:23.913702 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.913029    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 12:37:23.918200 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.918182    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-92jr5\""
May 21 12:37:23.947413 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.947382    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:32:22 +0000 UTC" deadline="2028-02-02 04:34:34.64111015 +0000 UTC"
May 21 12:37:23.947413 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.947412    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14919h57m10.693700914s"
May 21 12:37:23.999689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:23.999660    2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 12:37:24.011155 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011058    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-cnibin\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.011155 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011104    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011169    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-cnibin\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.011220    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9005567f-bcd0-42a3-b56d-dfb84b800d09-serviceca\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011269    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-sys\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.011289    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:24.511267023 +0000 UTC m=+3.127971839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011317    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-cnibin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011333    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-sys\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.011358 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011344    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-multus-certs\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011389    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-cnibin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011411    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-multus-certs\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011426    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-cni-binary-copy\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011463    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rmpc\" (UniqueName: \"kubernetes.io/projected/9bcd021b-eab5-461b-9c49-331cca103fbf-kube-api-access-8rmpc\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011563    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gggc8\" (UniqueName: \"kubernetes.io/projected/509c9646-37ad-4665-a500-a9a454afe3a7-kube-api-access-gggc8\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.011736 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011731    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-iptables-alerter-script\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011886    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-socket-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011910    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-netns\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-env-overrides\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbn2h\" (UniqueName: \"kubernetes.io/projected/da09bd2b-4e1d-4ddf-ba4b-de274982d511-kube-api-access-xbn2h\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011968    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdk8\" (UniqueName: \"kubernetes.io/projected/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-kube-api-access-hhdk8\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.011985    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-systemd\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012001    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-multus\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012034    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012051    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-cni-binary-copy\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npbtg\" (UniqueName: \"kubernetes.io/projected/9005567f-bcd0-42a3-b56d-dfb84b800d09-kube-api-access-npbtg\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-systemd-units\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-log-socket\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012140    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-os-release\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012155    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-kubelet\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012150    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-socket-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012189    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-modprobe-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012214    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012221    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-iptables-alerter-script\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012222    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-host\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012259    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jchb\" (UniqueName: \"kubernetes.io/projected/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-kube-api-access-2jchb\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012263    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-host\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-systemd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012292    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-os-release\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012344    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-multus\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012384    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-modprobe-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012426    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-system-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-kubelet\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012454    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-bin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012498    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-systemd\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.012748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012499    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-system-cni-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-system-cni-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-system-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012545    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-etc-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012569    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-var-lib-cni-bin\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-node-log\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-config\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012608    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysconfig\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012623    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-lib-modules\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-slash\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012737    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysconfig\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012763    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-lib-modules\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-ovn\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012835    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012896    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-sys-fs\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012927    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012949    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-tuned\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.013328 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.012984    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013007    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-sys-fs\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013028    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-device-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-script-lib\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013084    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-kubernetes\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013110    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-var-lib-kubelet\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013135    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-netns\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013160    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-conf-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-var-lib-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-bin\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-netd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013263    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-kubelet\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013293    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovn-node-metrics-cert\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013343    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-run\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013350    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.014149 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013359    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-d\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013367    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-tmp\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013406    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-conf-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013415    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-daemon-config\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013437    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-etc-kubernetes\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013457    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-os-release\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013479    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013482    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-device-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013480    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-run\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013495    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-host-slash\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013527    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013537    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-cni-dir\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013577    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-netns\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013581    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-os-release\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013638    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-host-slash\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013680    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013681    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-var-lib-kubelet\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013899    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-etc-kubernetes\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.014964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.013912    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-kubernetes\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014014    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014080    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-k8s-cni-cncf-io\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014112    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014139    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9rq\" (UniqueName: \"kubernetes.io/projected/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-kube-api-access-5h9rq\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d177b48-deca-4753-8144-87f9b007f729-agent-certs\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014189    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-daemon-config\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014195    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-conf\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014220    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-hostroot\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014244    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8dn\" (UniqueName: \"kubernetes.io/projected/3136323f-36e4-4d2a-b154-7d53d33e35d8-kube-api-access-xr8dn\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d177b48-deca-4753-8144-87f9b007f729-konnectivity-ca\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014282    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509c9646-37ad-4665-a500-a9a454afe3a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9005567f-bcd0-42a3-b56d-dfb84b800d09-host\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014326    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-socket-dir-parent\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014353    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-registration-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3136323f-36e4-4d2a-b154-7d53d33e35d8-registration-dir\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/509c9646-37ad-4665-a500-a9a454afe3a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.015708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014245    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-host-run-k8s-cni-cncf-io\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.016464 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014495    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-multus-socket-dir-parent\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.016464 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014499    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-sysctl-conf\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.016464 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.014521    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bcd021b-eab5-461b-9c49-331cca103fbf-hostroot\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.018161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.018137    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-tmp\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.018283 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.018261    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-etc-tuned\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.024080 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.024051    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:24.024192 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.024097    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:24.024192 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.024111    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:24.024192 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.024175    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:24.524156388 +0000 UTC m=+3.140861198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:24.026871 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.026753    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8dn\" (UniqueName: \"kubernetes.io/projected/3136323f-36e4-4d2a-b154-7d53d33e35d8-kube-api-access-xr8dn\") pod \"aws-ebs-csi-driver-node-2nvt7\" (UID: \"3136323f-36e4-4d2a-b154-7d53d33e35d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.028001 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.027977    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gggc8\" (UniqueName: \"kubernetes.io/projected/509c9646-37ad-4665-a500-a9a454afe3a7-kube-api-access-gggc8\") pod \"multus-additional-cni-plugins-j97sv\" (UID: \"509c9646-37ad-4665-a500-a9a454afe3a7\") " pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.028114 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.028093    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdk8\" (UniqueName: \"kubernetes.io/projected/e6bfe9bc-e83f-4988-939b-e63c7dd0538a-kube-api-access-hhdk8\") pod \"iptables-alerter-hcpbd\" (UID: \"e6bfe9bc-e83f-4988-939b-e63c7dd0538a\") " pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.029139 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.029094    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9rq\" (UniqueName: \"kubernetes.io/projected/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-kube-api-access-5h9rq\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:24.029444 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.029423    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jchb\" (UniqueName: \"kubernetes.io/projected/e7b12ab6-1962-4e09-9f4e-2d0b20faa729-kube-api-access-2jchb\") pod \"tuned-2ft4l\" (UID: \"e7b12ab6-1962-4e09-9f4e-2d0b20faa729\") " pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.029992 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.029949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rmpc\" (UniqueName: \"kubernetes.io/projected/9bcd021b-eab5-461b-9c49-331cca103fbf-kube-api-access-8rmpc\") pod \"multus-69jb2\" (UID: \"9bcd021b-eab5-461b-9c49-331cca103fbf\") " pod="openshift-multus/multus-69jb2"
May 21 12:37:24.115129 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115096    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-script-lib\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115129 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115141    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-var-lib-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115165    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-bin\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115185    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-netd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115208    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-kubelet\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115229    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovn-node-metrics-cert\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115258    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d177b48-deca-4753-8144-87f9b007f729-agent-certs\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115283    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d177b48-deca-4753-8144-87f9b007f729-konnectivity-ca\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115304    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9005567f-bcd0-42a3-b56d-dfb84b800d09-host\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.115367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115344    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9005567f-bcd0-42a3-b56d-dfb84b800d09-serviceca\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115369    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115395    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115426    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-netns\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115450    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-env-overrides\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115474    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbn2h\" (UniqueName: \"kubernetes.io/projected/da09bd2b-4e1d-4ddf-ba4b-de274982d511-kube-api-access-xbn2h\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115514    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npbtg\" (UniqueName: \"kubernetes.io/projected/9005567f-bcd0-42a3-b56d-dfb84b800d09-kube-api-access-npbtg\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115539    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-systemd-units\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115565    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-log-socket\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115591    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115623    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-systemd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115653    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-etc-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115687    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-node-log\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.115733 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115711    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-config\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115743    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-slash\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115784    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-ovn\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115791    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-script-lib\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115855    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-netns\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115867    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-ovn\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115900    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-var-lib-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115943    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-bin\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.115983    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-cni-netd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116016    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-kubelet\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116363    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-env-overrides\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116364    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116422    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-systemd\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116469    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-node-log\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9005567f-bcd0-42a3-b56d-dfb84b800d09-host\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116713    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-log-socket\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.116751 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116730    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-systemd-units\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117051 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116791    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-etc-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117051 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116792    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-slash\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117051 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116723    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-run-openvswitch\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117051 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116839    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da09bd2b-4e1d-4ddf-ba4b-de274982d511-host-run-ovn-kubernetes\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117051 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.116936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovnkube-config\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.117247 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.117128    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9005567f-bcd0-42a3-b56d-dfb84b800d09-serviceca\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.117247 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.117187    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d177b48-deca-4753-8144-87f9b007f729-konnectivity-ca\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.119117 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.119017    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da09bd2b-4e1d-4ddf-ba4b-de274982d511-ovn-node-metrics-cert\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.119250 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.119139    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d177b48-deca-4753-8144-87f9b007f729-agent-certs\") pod \"konnectivity-agent-tqrm5\" (UID: \"2d177b48-deca-4753-8144-87f9b007f729\") " pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.125557 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.125482    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbn2h\" (UniqueName: \"kubernetes.io/projected/da09bd2b-4e1d-4ddf-ba4b-de274982d511-kube-api-access-xbn2h\") pod \"ovnkube-node-gn2dt\" (UID: \"da09bd2b-4e1d-4ddf-ba4b-de274982d511\") " pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.126200 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.126179    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npbtg\" (UniqueName: \"kubernetes.io/projected/9005567f-bcd0-42a3-b56d-dfb84b800d09-kube-api-access-npbtg\") pod \"node-ca-m7vck\" (UID: \"9005567f-bcd0-42a3-b56d-dfb84b800d09\") " pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.184886 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.184855    2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 12:37:24.201965 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.201936    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j97sv"
May 21 12:37:24.210652 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.210628    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hcpbd"
May 21 12:37:24.221323 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.221298    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7"
May 21 12:37:24.227875 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.227857    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ft4l"
May 21 12:37:24.234447 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.234429    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-69jb2"
May 21 12:37:24.241097 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.241078    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:24.248680 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.248664    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:24.253177 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.253159    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7vck"
May 21 12:37:24.518043 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.517961    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:24.518191 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.518071    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:24.518191 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.518127    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:25.518112082 +0000 UTC m=+4.134816873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:24.619035 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.619000    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:24.619228 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.619140    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:24.619228 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.619162    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:24.619228 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.619172    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:24.619385 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:24.619235    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:25.619217341 +0000 UTC m=+4.235922153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:24.674592 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.674561    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda09bd2b_4e1d_4ddf_ba4b_de274982d511.slice/crio-9923b3715b7ab29ed1f2d50b176b3d57c18294aac08265132dd1ed66f8010e3c WatchSource:0}: Error finding container 9923b3715b7ab29ed1f2d50b176b3d57c18294aac08265132dd1ed66f8010e3c: Status 404 returned error can't find the container with id 9923b3715b7ab29ed1f2d50b176b3d57c18294aac08265132dd1ed66f8010e3c
May 21 12:37:24.677455 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.677417    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcd021b_eab5_461b_9c49_331cca103fbf.slice/crio-d39dfbd9e7aef64142a5d5bf61334b204950c0bdef35f9dee1a8469bb22acd97 WatchSource:0}: Error finding container d39dfbd9e7aef64142a5d5bf61334b204950c0bdef35f9dee1a8469bb22acd97: Status 404 returned error can't find the container with id d39dfbd9e7aef64142a5d5bf61334b204950c0bdef35f9dee1a8469bb22acd97
May 21 12:37:24.679457 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.679430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3136323f_36e4_4d2a_b154_7d53d33e35d8.slice/crio-0d55df2d77c6a50fd358bc1cf8ab0f9fd4ac836e4b091a1dcaa228455bea663b WatchSource:0}: Error finding container 0d55df2d77c6a50fd358bc1cf8ab0f9fd4ac836e4b091a1dcaa228455bea663b: Status 404 returned error can't find the container with id 0d55df2d77c6a50fd358bc1cf8ab0f9fd4ac836e4b091a1dcaa228455bea663b
May 21 12:37:24.680939 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.680915    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d177b48_deca_4753_8144_87f9b007f729.slice/crio-a38eff1607659266d7df9ba511b7deeea649260017f911bdc3b1f173724d4235 WatchSource:0}: Error finding container a38eff1607659266d7df9ba511b7deeea649260017f911bdc3b1f173724d4235: Status 404 returned error can't find the container with id a38eff1607659266d7df9ba511b7deeea649260017f911bdc3b1f173724d4235
May 21 12:37:24.681225 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.681200    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9005567f_bcd0_42a3_b56d_dfb84b800d09.slice/crio-ddba413be8bb2b28646ed4d7cca1ff9d8a61f58945c3e56b7f2912ff223f2e05 WatchSource:0}: Error finding container ddba413be8bb2b28646ed4d7cca1ff9d8a61f58945c3e56b7f2912ff223f2e05: Status 404 returned error can't find the container with id ddba413be8bb2b28646ed4d7cca1ff9d8a61f58945c3e56b7f2912ff223f2e05
May 21 12:37:24.702929 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.702899    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6bfe9bc_e83f_4988_939b_e63c7dd0538a.slice/crio-cb8b7d344d46f67b87b17ef95fc0cfdbf06f90959038b98630cc42ef0292e424 WatchSource:0}: Error finding container cb8b7d344d46f67b87b17ef95fc0cfdbf06f90959038b98630cc42ef0292e424: Status 404 returned error can't find the container with id cb8b7d344d46f67b87b17ef95fc0cfdbf06f90959038b98630cc42ef0292e424
May 21 12:37:24.703800 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.703757    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509c9646_37ad_4665_a500_a9a454afe3a7.slice/crio-c4bc3c326e0488386eb5136a45ff742a68d081ae08e9ca4473c32d2ee76ff4a8 WatchSource:0}: Error finding container c4bc3c326e0488386eb5136a45ff742a68d081ae08e9ca4473c32d2ee76ff4a8: Status 404 returned error can't find the container with id c4bc3c326e0488386eb5136a45ff742a68d081ae08e9ca4473c32d2ee76ff4a8
May 21 12:37:24.705107 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:24.705077    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b12ab6_1962_4e09_9f4e_2d0b20faa729.slice/crio-770183cfc83f103532b09c96659c228946ade2c007270f2b998a66099f63ac9e WatchSource:0}: Error finding container 770183cfc83f103532b09c96659c228946ade2c007270f2b998a66099f63ac9e: Status 404 returned error can't find the container with id 770183cfc83f103532b09c96659c228946ade2c007270f2b998a66099f63ac9e
May 21 12:37:24.948740 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.948570    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:32:22 +0000 UTC" deadline="2027-10-29 00:14:20.019269046 +0000 UTC"
May 21 12:37:24.948740 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:24.948736    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h36m55.07053745s"
May 21 12:37:25.016219 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.016194    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqrm5" event={"ID":"2d177b48-deca-4753-8144-87f9b007f729","Type":"ContainerStarted","Data":"a38eff1607659266d7df9ba511b7deeea649260017f911bdc3b1f173724d4235"}
May 21 12:37:25.017067 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.017041    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jb2" event={"ID":"9bcd021b-eab5-461b-9c49-331cca103fbf","Type":"ContainerStarted","Data":"d39dfbd9e7aef64142a5d5bf61334b204950c0bdef35f9dee1a8469bb22acd97"}
May 21 12:37:25.018343 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.018322    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"567053fa0164152f4a9f0b75552251c3","Type":"ContainerStarted","Data":"75b655c939c277246e3d5f511537b8a08ce3390dad1e5bcd2419b989b347843b"}
May 21 12:37:25.019161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.019142    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerStarted","Data":"c4bc3c326e0488386eb5136a45ff742a68d081ae08e9ca4473c32d2ee76ff4a8"}
May 21 12:37:25.019901 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.019885    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcpbd" event={"ID":"e6bfe9bc-e83f-4988-939b-e63c7dd0538a","Type":"ContainerStarted","Data":"cb8b7d344d46f67b87b17ef95fc0cfdbf06f90959038b98630cc42ef0292e424"}
May 21 12:37:25.020744 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.020668    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7vck" event={"ID":"9005567f-bcd0-42a3-b56d-dfb84b800d09","Type":"ContainerStarted","Data":"ddba413be8bb2b28646ed4d7cca1ff9d8a61f58945c3e56b7f2912ff223f2e05"}
May 21 12:37:25.021443 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.021425    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7" event={"ID":"3136323f-36e4-4d2a-b154-7d53d33e35d8","Type":"ContainerStarted","Data":"0d55df2d77c6a50fd358bc1cf8ab0f9fd4ac836e4b091a1dcaa228455bea663b"}
May 21 12:37:25.022316 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.022295    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"9923b3715b7ab29ed1f2d50b176b3d57c18294aac08265132dd1ed66f8010e3c"}
May 21 12:37:25.023463 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.023445    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"2ce3b1c70152c6ca64cf004056b74674","Type":"ContainerStarted","Data":"f3e078fb6eb0348446ca521ae29f30b34b608601d9903de0e716137f0dc92aac"}
May 21 12:37:25.027277 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.027254    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ft4l" event={"ID":"e7b12ab6-1962-4e09-9f4e-2d0b20faa729","Type":"ContainerStarted","Data":"770183cfc83f103532b09c96659c228946ade2c007270f2b998a66099f63ac9e"}
May 21 12:37:25.051258 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.051195    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" podStartSLOduration=2.051177328 podStartE2EDuration="2.051177328s" podCreationTimestamp="2026-05-21 12:37:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:37:25.037551203 +0000 UTC m=+3.654256013" watchObservedRunningTime="2026-05-21 12:37:25.051177328 +0000 UTC m=+3.667882142"
May 21 12:37:25.526804 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.526755    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:25.526996 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.526908    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:25.526996 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.526979    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:27.526961777 +0000 UTC m=+6.143666568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:25.627576 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:25.627538    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:25.627753 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.627696    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:25.627753 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.627716    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:25.627753 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.627727    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:25.628074 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:25.627804    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:27.627786149 +0000 UTC m=+6.244490954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:26.008643 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:26.008568    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:26.009160 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:26.008716    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:26.009329 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:26.009307    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:26.009459 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:26.009410    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:26.035994 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:26.034808    2567 generic.go:358] "Generic (PLEG): container finished" podID="2ce3b1c70152c6ca64cf004056b74674" containerID="f3e078fb6eb0348446ca521ae29f30b34b608601d9903de0e716137f0dc92aac" exitCode=0
May 21 12:37:26.035994 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:26.035806    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"2ce3b1c70152c6ca64cf004056b74674","Type":"ContainerDied","Data":"f3e078fb6eb0348446ca521ae29f30b34b608601d9903de0e716137f0dc92aac"}
May 21 12:37:27.045556 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:27.044861    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"2ce3b1c70152c6ca64cf004056b74674","Type":"ContainerStarted","Data":"08eb318b7bdff0bf6b73f61ff2bdee7388b4bbcd1e3dbed137483566010090cf"}
May 21 12:37:27.543252 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:27.543169    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:27.543417 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.543317    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:27.543417 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.543385    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:31.543366166 +0000 UTC m=+10.160070963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:27.643612 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:27.643559    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:27.643798 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.643708    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:27.643798 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.643729    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:27.643798 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.643741    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:27.643957 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:27.643813    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:31.643794252 +0000 UTC m=+10.260499048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:28.008561 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.008001    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:28.008561 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.008035    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:28.008561 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:28.008154    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:28.008561 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:28.008342    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:28.689865 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.688339    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" podStartSLOduration=5.688320807 podStartE2EDuration="5.688320807s" podCreationTimestamp="2026-05-21 12:37:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:37:27.060326937 +0000 UTC m=+5.677031751" watchObservedRunningTime="2026-05-21 12:37:28.688320807 +0000 UTC m=+7.305025621"
May 21 12:37:28.689865 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.689151    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dv2tz"]
May 21 12:37:28.694411 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.693989    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.698199 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.697582    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 12:37:28.698199 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.697835    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 12:37:28.698199 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.698046    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7jfb\""
May 21 12:37:28.753148 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.753108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29780791-9947-4453-b78b-263e5fef63cf-hosts-file\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.753338 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.753155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxmm\" (UniqueName: \"kubernetes.io/projected/29780791-9947-4453-b78b-263e5fef63cf-kube-api-access-jpxmm\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.753338 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.753222    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29780791-9947-4453-b78b-263e5fef63cf-tmp-dir\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.854000 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.853964    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29780791-9947-4453-b78b-263e5fef63cf-tmp-dir\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.854172 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.854053    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29780791-9947-4453-b78b-263e5fef63cf-hosts-file\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.854172 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.854076    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxmm\" (UniqueName: \"kubernetes.io/projected/29780791-9947-4453-b78b-263e5fef63cf-kube-api-access-jpxmm\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.854337 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.854162    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/29780791-9947-4453-b78b-263e5fef63cf-hosts-file\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.855052 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.855005    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29780791-9947-4453-b78b-263e5fef63cf-tmp-dir\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:28.870351 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:28.870293    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxmm\" (UniqueName: \"kubernetes.io/projected/29780791-9947-4453-b78b-263e5fef63cf-kube-api-access-jpxmm\") pod \"node-resolver-dv2tz\" (UID: \"29780791-9947-4453-b78b-263e5fef63cf\") " pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:29.006904 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:29.006808    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dv2tz"
May 21 12:37:30.008975 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:30.008906    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:30.008975 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:30.008923    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:30.009464 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:30.009041    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:30.009464 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:30.009187    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:31.137095 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.137061    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6gvv8"]
May 21 12:37:31.140046 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.140007    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.140183 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.140094    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:31.173211 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.173180    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-kubelet-config\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.173211 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.173224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.173462 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.173267    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-dbus\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.273913 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.273876    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-kubelet-config\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.273913 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.273921    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.274132 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.273968    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-dbus\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.274132 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.274024    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-kubelet-config\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.274227 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.274157    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:31.274227 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.274186    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/de488ca8-1c90-428e-ad26-51f30dcf82a7-dbus\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.274318 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.274237    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:31.774215115 +0000 UTC m=+10.390919910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:31.576476 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.576382    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:31.576629 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.576581    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:31.576704 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.576661    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:39.576641458 +0000 UTC m=+18.193346269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:31.676959 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.676919    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:31.677136 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.677120    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:31.677178 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.677165    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:31.677208 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.677179    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:31.677250 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.677238    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:39.677221059 +0000 UTC m=+18.293925863 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:31.778244 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:31.778186    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:31.778406 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.778344    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:31.778484 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:31.778416    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:32.77839586 +0000 UTC m=+11.395100662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:32.010198 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:32.010159    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:32.010359 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:32.010299    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:32.010433 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:32.010350    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:32.010504 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:32.010479    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:32.785899 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:32.785853    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:32.786376 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:32.786028    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:32.786376 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:32.786111    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:34.786090036 +0000 UTC m=+13.402794834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:33.008439 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:33.008408    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:33.008788 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:33.008575    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:34.008444 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:34.008192    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:34.008444 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:34.008347    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:34.008955 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:34.008459    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:34.008955 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:34.008561    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:34.804185 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:34.804142    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:34.804393 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:34.804314    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:34.804393 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:34.804386    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:38.80436582 +0000 UTC m=+17.421070617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:35.008841 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:35.008805    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:35.009306 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:35.008942    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:36.008716 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:36.008679    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:36.008930 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:36.008679    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:36.008930 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:36.008825    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:36.009377 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:36.008931    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:37.008888 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:37.008855    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:37.009056 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:37.008967    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:38.008148 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:38.008049    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:38.008339 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:38.008195    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:38.008339 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:38.008235    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:38.008339 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:38.008299    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:38.837533 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:38.837500    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:38.837992 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:38.837623    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:38.837992 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:38.837711    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:46.837692446 +0000 UTC m=+25.454397242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:39.008347 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:39.008301    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:39.008508 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.008446    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:39.643240 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:39.643207    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:39.643404 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.643349    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:39.643451 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.643406    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.643391568 +0000 UTC m=+34.260096363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:39.743651 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:39.743616    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:39.743863 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.743746    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:39.743863 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.743789    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:39.743863 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.743802    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:39.744016 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:39.743868    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.743848519 +0000 UTC m=+34.360553310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:40.008635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:40.008558    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:40.009065 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:40.008665    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:40.009065 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:40.008728    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:40.009065 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:40.008867    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:41.008704 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:41.008668    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:41.009139 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:41.008814    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:42.009508 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:42.009472    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:42.010047 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:42.009576    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:42.010047 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:42.009662    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:42.010047 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:42.009790    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:42.504499 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:42.504474    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29780791_9947_4453_b78b_263e5fef63cf.slice/crio-69b5b8a2a479e7237e86af7d34cff7c88e834d9da136ec623f7c26598e6e7e9e WatchSource:0}: Error finding container 69b5b8a2a479e7237e86af7d34cff7c88e834d9da136ec623f7c26598e6e7e9e: Status 404 returned error can't find the container with id 69b5b8a2a479e7237e86af7d34cff7c88e834d9da136ec623f7c26598e6e7e9e
May 21 12:37:43.008092 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.007922    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:43.008188 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:43.008161    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:43.072845 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.072817    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7vck" event={"ID":"9005567f-bcd0-42a3-b56d-dfb84b800d09","Type":"ContainerStarted","Data":"855fcfc0d44159d59fbb0a5cdf9b22208ff8744619e5b2bd14528fbc73df07e5"}
May 21 12:37:43.074111 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.074082    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7" event={"ID":"3136323f-36e4-4d2a-b154-7d53d33e35d8","Type":"ContainerStarted","Data":"cfc4738b81a17794c3e7830798850d4e42026fac2dad346b33c8ccb9983b6fcf"}
May 21 12:37:43.075635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.075610    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"81adee5ef60c060228233a5bf760d8edce9edfe1058cbbd0d9fa80efa0db2e4d"}
May 21 12:37:43.075635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.075635    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"77077f6b02233f9c599949073a17e692b3702568f4e8dbb5cc53912ac4ded2cd"}
May 21 12:37:43.075750 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.075644    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"fe73cf562628ca6eaa236c4c6e6d243a2a6f22ddb20be0eb7ba00d351d53b757"}
May 21 12:37:43.076872 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.076853    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dv2tz" event={"ID":"29780791-9947-4453-b78b-263e5fef63cf","Type":"ContainerStarted","Data":"e6608f132fa3fc0f5c14036a5de12a956af6cefa7e1e7715c1531941fbf7ed46"}
May 21 12:37:43.076872 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.076877    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dv2tz" event={"ID":"29780791-9947-4453-b78b-263e5fef63cf","Type":"ContainerStarted","Data":"69b5b8a2a479e7237e86af7d34cff7c88e834d9da136ec623f7c26598e6e7e9e"}
May 21 12:37:43.079256 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.078291    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ft4l" event={"ID":"e7b12ab6-1962-4e09-9f4e-2d0b20faa729","Type":"ContainerStarted","Data":"3aa1bd7631e7bfabd0c736e850f3b47416a4a186a1e05d8cc8a76ded2ffe1c98"}
May 21 12:37:43.080696 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.080678    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tqrm5" event={"ID":"2d177b48-deca-4753-8144-87f9b007f729","Type":"ContainerStarted","Data":"a99bd54dcadf40605c702dfe379c69935435494a5b835fb23731fd6157b60fa8"}
May 21 12:37:43.081800 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.081761    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-69jb2" event={"ID":"9bcd021b-eab5-461b-9c49-331cca103fbf","Type":"ContainerStarted","Data":"7ff76e55fe28c33476d6533d9ba3df9e78f16563fc72e8239d95d17b5bbcacb2"}
May 21 12:37:43.082964 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.082942    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="6e08cbb46d3b5c841a6d04d4510646506b1e003de069738b3a4cbac518b73879" exitCode=0
May 21 12:37:43.083032 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.082972    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"6e08cbb46d3b5c841a6d04d4510646506b1e003de069738b3a4cbac518b73879"}
May 21 12:37:43.086152 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.086115    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7vck" podStartSLOduration=8.055700503 podStartE2EDuration="21.08610507s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.701545699 +0000 UTC m=+3.318250493" lastFinishedPulling="2026-05-21 12:37:37.731950256 +0000 UTC m=+16.348655060" observedRunningTime="2026-05-21 12:37:43.085753834 +0000 UTC m=+21.702458647" watchObservedRunningTime="2026-05-21 12:37:43.08610507 +0000 UTC m=+21.702809929"
May 21 12:37:43.100432 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.100391    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2ft4l" podStartSLOduration=3.262005161 podStartE2EDuration="21.100376204s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.709068233 +0000 UTC m=+3.325773024" lastFinishedPulling="2026-05-21 12:37:42.547439267 +0000 UTC m=+21.164144067" observedRunningTime="2026-05-21 12:37:43.100233398 +0000 UTC m=+21.716938211" watchObservedRunningTime="2026-05-21 12:37:43.100376204 +0000 UTC m=+21.717081017"
May 21 12:37:43.112999 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.112963    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dv2tz" podStartSLOduration=15.11295186 podStartE2EDuration="15.11295186s" podCreationTimestamp="2026-05-21 12:37:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:37:43.112735131 +0000 UTC m=+21.729439945" watchObservedRunningTime="2026-05-21 12:37:43.11295186 +0000 UTC m=+21.729656672"
May 21 12:37:43.129430 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.129386    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-69jb2" podStartSLOduration=3.24563027 podStartE2EDuration="21.129369136s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.679267422 +0000 UTC m=+3.295972218" lastFinishedPulling="2026-05-21 12:37:42.56300629 +0000 UTC m=+21.179711084" observedRunningTime="2026-05-21 12:37:43.128919174 +0000 UTC m=+21.745623986" watchObservedRunningTime="2026-05-21 12:37:43.129369136 +0000 UTC m=+21.746073950"
May 21 12:37:43.149434 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:43.149395    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tqrm5" podStartSLOduration=8.119001596 podStartE2EDuration="21.149383293s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.701558553 +0000 UTC m=+3.318263344" lastFinishedPulling="2026-05-21 12:37:37.731940233 +0000 UTC m=+16.348645041" observedRunningTime="2026-05-21 12:37:43.149051475 +0000 UTC m=+21.765756289" watchObservedRunningTime="2026-05-21 12:37:43.149383293 +0000 UTC m=+21.766088106"
May 21 12:37:44.008539 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.008510    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:44.008713 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.008510    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:44.008713 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:44.008608    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:44.008713 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:44.008678    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:44.086719 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.086553    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hcpbd" event={"ID":"e6bfe9bc-e83f-4988-939b-e63c7dd0538a","Type":"ContainerStarted","Data":"932bee757cc62b06bd716ddd7cfbd8096d26bbc0a4831212bbbb701f2d9a8ed5"}
May 21 12:37:44.089668 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.089639    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"58ee6f619af07a16647c08cfaaddd5ecf141f3be63c334659ebd4a658ef5290d"}
May 21 12:37:44.089854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.089677    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"6202bdf72db27b68fe347fd92dc5edcca8b44e6e5c9cbc6964b75779f2275f65"}
May 21 12:37:44.089854 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.089691    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"fc36409bf31d88a32a69f24c739e14ef69c1741b4764e16d5590e692a1ff94d9"}
May 21 12:37:44.114369 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.114333    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hcpbd" podStartSLOduration=4.317224786 podStartE2EDuration="22.114319348s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.704666566 +0000 UTC m=+3.321371365" lastFinishedPulling="2026-05-21 12:37:42.501761129 +0000 UTC m=+21.118465927" observedRunningTime="2026-05-21 12:37:44.114004288 +0000 UTC m=+22.730709097" watchObservedRunningTime="2026-05-21 12:37:44.114319348 +0000 UTC m=+22.731024163"
May 21 12:37:44.238516 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.238487    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 12:37:44.977887 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.977764    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T12:37:44.238511456Z","UUID":"a0b0fbaa-24a0-4fe8-8be5-2ac6f6501e84","Handler":null,"Name":"","Endpoint":""}
May 21 12:37:44.979549 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.979514    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 12:37:44.979549 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:44.979541    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 12:37:45.008125 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:45.008089    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:45.008295 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:45.008216    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:45.093511 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:45.093472    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7" event={"ID":"3136323f-36e4-4d2a-b154-7d53d33e35d8","Type":"ContainerStarted","Data":"1e47843a6b16fa86d3b76dd4de2d76e057b3da0c6d2e8da1d29530313ef26c96"}
May 21 12:37:46.008552 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.008326    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:46.008822 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.008356    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:46.008822 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:46.008654    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:46.008822 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:46.008725    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:46.097952 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.097899    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7" event={"ID":"3136323f-36e4-4d2a-b154-7d53d33e35d8","Type":"ContainerStarted","Data":"94fc0a187775470a4386c1f39645605551ab1e9720067347d7375bf98a8ff22d"}
May 21 12:37:46.103784 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.103737    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"92ed3289b99e1fbae4efd7d9f405c12b56d52a7d5b9ae3acf4b293c2e78a4f75"}
May 21 12:37:46.119054 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.118996    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nvt7" podStartSLOduration=3.655666863 podStartE2EDuration="24.11898107s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.701626628 +0000 UTC m=+3.318331419" lastFinishedPulling="2026-05-21 12:37:45.164940832 +0000 UTC m=+23.781645626" observedRunningTime="2026-05-21 12:37:46.118407376 +0000 UTC m=+24.735112187" watchObservedRunningTime="2026-05-21 12:37:46.11898107 +0000 UTC m=+24.735685924"
May 21 12:37:46.899501 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:46.899462    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:46.899641 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:46.899576    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 12:37:46.899641 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:46.899635    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret podName:de488ca8-1c90-428e-ad26-51f30dcf82a7 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:02.899619327 +0000 UTC m=+41.516324118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret") pod "global-pull-secret-syncer-6gvv8" (UID: "de488ca8-1c90-428e-ad26-51f30dcf82a7") : object "kube-system"/"original-pull-secret" not registered
May 21 12:37:47.008903 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:47.008870    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:47.009079 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:47.009005    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:47.324955 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:47.324870    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:47.325626 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:47.325601    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:48.008175 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:48.008142    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:48.008355 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:48.008291    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:48.008355 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:48.008348    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:48.008479 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:48.008458    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:48.107636 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:48.107601    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:48.108187 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:48.108165    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tqrm5"
May 21 12:37:49.008459 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:49.008426    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:49.009146 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:49.008521    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:49.116516 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:49.115916    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" event={"ID":"da09bd2b-4e1d-4ddf-ba4b-de274982d511","Type":"ContainerStarted","Data":"4c5c8d0409d3a2e438150bfd876a7bec88cd9ebe3119e9a00c5930bcae2c1bac"}
May 21 12:37:49.144300 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:49.144260    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt" podStartSLOduration=9.068671625 podStartE2EDuration="27.144243255s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.676324499 +0000 UTC m=+3.293029289" lastFinishedPulling="2026-05-21 12:37:42.75189612 +0000 UTC m=+21.368600919" observedRunningTime="2026-05-21 12:37:49.143133719 +0000 UTC m=+27.759838532" watchObservedRunningTime="2026-05-21 12:37:49.144243255 +0000 UTC m=+27.760948067"
May 21 12:37:50.008287 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.008109    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:50.008463 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.008179    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:50.008463 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:50.008353    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:50.008463 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:50.008437    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:50.119104 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.119069    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="8de8d1d855c0312ccd1a1a6521078567f8e5c9ebe7fdf2f8925b87927693f68f" exitCode=0
May 21 12:37:50.119239 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.119159    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"8de8d1d855c0312ccd1a1a6521078567f8e5c9ebe7fdf2f8925b87927693f68f"}
May 21 12:37:50.120517 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.119727    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:50.120517 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.119756    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:50.120517 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.119786    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:50.134787 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.134747    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:50.134899 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:50.134834    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:37:51.008271 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.008243    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:51.008442 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:51.008351    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:51.010113 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.010073    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5prsm"]
May 21 12:37:51.010460 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.010161    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:51.010460 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:51.010245    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:51.015895 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.015867    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lsggw"]
May 21 12:37:51.016005 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.015989    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:51.016086 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:51.016069    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:51.016577 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.016558    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvv8"]
May 21 12:37:51.121415 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:51.121384    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:51.121574 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:51.121506    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:52.125663 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:52.125463    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="1b83ddf45297d9155a39e64fb8390e69764122891124b0b53e92862e1f9d7083" exitCode=0
May 21 12:37:52.126082 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:52.125519    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"1b83ddf45297d9155a39e64fb8390e69764122891124b0b53e92862e1f9d7083"}
May 21 12:37:53.008889 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:53.008856    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:53.008889 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:53.008874    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:53.009127 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:53.008858    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:53.009127 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:53.008977    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:53.009127 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:53.009038    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:53.009127 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:53.009097    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:53.129798 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:53.129748    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="bb6b47c7c056f5c26409ed84ce5f8ddc539d4673de49cc6fec48803a52f01826" exitCode=0
May 21 12:37:53.130367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:53.129804    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"bb6b47c7c056f5c26409ed84ce5f8ddc539d4673de49cc6fec48803a52f01826"}
May 21 12:37:55.008610 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.008576    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:55.009138 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.008579    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:55.009138 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.008684    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5prsm" podUID="7370cd2a-4dc8-43e9-8839-adafdd54c437"
May 21 12:37:55.009138 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.008593    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:55.009138 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.008756    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:37:55.009138 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.008842    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gvv8" podUID="de488ca8-1c90-428e-ad26-51f30dcf82a7"
May 21 12:37:55.181604 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.181578    2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeReady"
May 21 12:37:55.181730 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.181701    2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 12:37:55.218387 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.218360    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"]
May 21 12:37:55.222420 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.222399    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"]
May 21 12:37:55.222556 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.222539    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.226239 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.226214    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-644969c5d9-7wgjh"]
May 21 12:37:55.226354 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.226306    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.229073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.228403    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 12:37:55.229073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.228022    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 12:37:55.229073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.228499    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 12:37:55.230959 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.229855    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"]
May 21 12:37:55.231987 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.231965    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 12:37:55.232611 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.232280    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 12:37:55.232611 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.232531    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ztrnv\""
May 21 12:37:55.232802 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.232785    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 12:37:55.233786 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.233748    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"]
May 21 12:37:55.233904 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.233872    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.233979 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.233962    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.238339 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.237609    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 12:37:55.238339 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.238038    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sn8hf\""
May 21 12:37:55.238339 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.238309    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 12:37:55.238549 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.238482    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 12:37:55.239250 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.239229    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 12:37:55.239415 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.239389    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lj2jp\""
May 21 12:37:55.239831 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.239812    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qdgl9"]
May 21 12:37:55.239974 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.239954    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.243363 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243341    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"]
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243370    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"]
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243379    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"]
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243388    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"]
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243398    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644969c5d9-7wgjh"]
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243347    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 12:37:55.243457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.243439    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.245098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245079    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 12:37:55.245498 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245480    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 12:37:55.245563 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245509    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 12:37:55.245563 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245544    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 12:37:55.245965 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245941    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbjhg\""
May 21 12:37:55.246076 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245982    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 12:37:55.246076 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.245995    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 12:37:55.253909 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.253877    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6sp9h"]
May 21 12:37:55.257426 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.257404    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.257583 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.257438    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qdgl9"]
May 21 12:37:55.260086 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.260043    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 12:37:55.260568 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.260547    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m7gww\""
May 21 12:37:55.260568 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.260559    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 12:37:55.260717 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.260653    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 12:37:55.267103 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.267083    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6sp9h"]
May 21 12:37:55.360634 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fc7d90-3149-4af5-9efe-66728918af24-tmp-dir\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.360812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.360812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.360812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.360812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.360812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360760    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcqkx\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t57s\" (UniqueName: \"kubernetes.io/projected/11f41710-4aac-456c-81f8-021fed7b6509-kube-api-access-9t57s\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360919    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fc7d90-3149-4af5-9efe-66728918af24-config-volume\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.360976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-tmp\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njm54\" (UniqueName: \"kubernetes.io/projected/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-kube-api-access-njm54\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.361110 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361179    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqwm\" (UniqueName: \"kubernetes.io/projected/89fc7d90-3149-4af5-9efe-66728918af24-kube-api-access-8mqwm\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361317    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk4fv\" (UniqueName: \"kubernetes.io/projected/5a4c48b9-105a-47d3-a69f-8c182df75d6d-kube-api-access-nk4fv\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a4c48b9-105a-47d3-a69f-8c182df75d6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.361445 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361440    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.361910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9d49aa7-773a-4699-a8fb-0d60353476fb-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.361910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4cx\" (UniqueName: \"kubernetes.io/projected/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-kube-api-access-2r4cx\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.361910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.361910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.361540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.462487 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462451    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.462487 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462492    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9d49aa7-773a-4699-a8fb-0d60353476fb-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462533    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4cx\" (UniqueName: \"kubernetes.io/projected/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-kube-api-access-2r4cx\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462562    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462622    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.462652    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462660    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fc7d90-3149-4af5-9efe-66728918af24-tmp-dir\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462694    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.462737 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462729    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462759    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462803    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462824    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcqkx\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462851    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9t57s\" (UniqueName: \"kubernetes.io/projected/11f41710-4aac-456c-81f8-021fed7b6509-kube-api-access-9t57s\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462879    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fc7d90-3149-4af5-9efe-66728918af24-config-volume\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462906    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.462666    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462940    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462965    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-tmp\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.462996    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njm54\" (UniqueName: \"kubernetes.io/projected/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-kube-api-access-njm54\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.463014    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.962992065 +0000 UTC m=+34.579696859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463052    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.463098 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463083    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463113    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463169    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463200    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqwm\" (UniqueName: \"kubernetes.io/projected/89fc7d90-3149-4af5-9efe-66728918af24-kube-api-access-8mqwm\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463231    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463268    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk4fv\" (UniqueName: \"kubernetes.io/projected/5a4c48b9-105a-47d3-a69f-8c182df75d6d-kube-api-access-nk4fv\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463312    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.463329    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463334    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f9d49aa7-773a-4699-a8fb-0d60353476fb-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463357    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.463393    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.963372285 +0000 UTC m=+34.580077077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463412    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a4c48b9-105a-47d3-a69f-8c182df75d6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.463521    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:37:55.463762 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.463550    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.963540524 +0000 UTC m=+34.580245315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-tmp\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.463952    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.464016    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.464216    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.464230    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.464260    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fc7d90-3149-4af5-9efe-66728918af24-tmp-dir\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.464277    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:37:55.964261098 +0000 UTC m=+34.580965906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:37:55.464718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.464671    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/89fc7d90-3149-4af5-9efe-66728918af24-config-volume\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.468367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468300    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.468367 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468349    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-ca\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.468532 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468387    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.468532 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.468532 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468426    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.468694 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468614    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a4c48b9-105a-47d3-a69f-8c182df75d6d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.468747 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468722    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.468869 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.468837    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.471302 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.471273    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4cx\" (UniqueName: \"kubernetes.io/projected/7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b-kube-api-access-2r4cx\") pod \"cluster-proxy-proxy-agent-79c7b4974-s8q4l\" (UID: \"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.471925 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.471900    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njm54\" (UniqueName: \"kubernetes.io/projected/a1b0bfa3-1eeb-4ba5-806d-84437c753bc1-kube-api-access-njm54\") pod \"klusterlet-addon-workmgr-7c7f84ddc4-zs77q\" (UID: \"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.476163 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.476140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.476303 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.476260    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t57s\" (UniqueName: \"kubernetes.io/projected/11f41710-4aac-456c-81f8-021fed7b6509-kube-api-access-9t57s\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.476303 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.476268    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk4fv\" (UniqueName: \"kubernetes.io/projected/5a4c48b9-105a-47d3-a69f-8c182df75d6d-kube-api-access-nk4fv\") pod \"managed-serviceaccount-addon-agent-8546fdc766-lr8rb\" (UID: \"5a4c48b9-105a-47d3-a69f-8c182df75d6d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.479835 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.479816    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqwm\" (UniqueName: \"kubernetes.io/projected/89fc7d90-3149-4af5-9efe-66728918af24-kube-api-access-8mqwm\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.481096 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.481078    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcqkx\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.536265 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.536174    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:37:55.582559 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.582522    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"
May 21 12:37:55.589469 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.589262    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:37:55.666208 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.665826    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:55.666208 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.666123    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:55.666208 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.666204    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.666184736 +0000 UTC m=+66.282889549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 12:37:55.696415 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.696382    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"]
May 21 12:37:55.702151 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:55.702112    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b0bfa3_1eeb_4ba5_806d_84437c753bc1.slice/crio-1d1389405d926a31b1144c831c54a03564455a6cee6d397a4d4da250ee8073f6 WatchSource:0}: Error finding container 1d1389405d926a31b1144c831c54a03564455a6cee6d397a4d4da250ee8073f6: Status 404 returned error can't find the container with id 1d1389405d926a31b1144c831c54a03564455a6cee6d397a4d4da250ee8073f6
May 21 12:37:55.737547 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.737512    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb"]
May 21 12:37:55.741343 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:55.741310    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a4c48b9_105a_47d3_a69f_8c182df75d6d.slice/crio-adb54e5798ee90471ff161f59da6ca8b9a89008287796b9dbbfeae2423a35816 WatchSource:0}: Error finding container adb54e5798ee90471ff161f59da6ca8b9a89008287796b9dbbfeae2423a35816: Status 404 returned error can't find the container with id adb54e5798ee90471ff161f59da6ca8b9a89008287796b9dbbfeae2423a35816
May 21 12:37:55.745259 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.745235    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"]
May 21 12:37:55.748504 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:37:55.748474    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aeb4f76_e5c5_42c5_bd5c_0bcf2ff24f1b.slice/crio-c470c53e66c53946ac16046b0c07b5827e1a8645d13c61fd3439e91436aa9639 WatchSource:0}: Error finding container c470c53e66c53946ac16046b0c07b5827e1a8645d13c61fd3439e91436aa9639: Status 404 returned error can't find the container with id c470c53e66c53946ac16046b0c07b5827e1a8645d13c61fd3439e91436aa9639
May 21 12:37:55.767396 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.767365    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:55.767543 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.767524    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 12:37:55.767590 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.767554    2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 12:37:55.767590 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.767564    2567 projected.go:194] Error preparing data for projected volume kube-api-access-bllws for pod openshift-network-diagnostics/network-check-target-5prsm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:55.767664 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.767614    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws podName:7370cd2a-4dc8-43e9-8839-adafdd54c437 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.767599838 +0000 UTC m=+66.384304652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bllws" (UniqueName: "kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws") pod "network-check-target-5prsm" (UID: "7370cd2a-4dc8-43e9-8839-adafdd54c437") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 12:37:55.969497 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.969451    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.969517    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.969568    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:55.969598    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969602    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969666    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:37:56.969648125 +0000 UTC m=+35.586352932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969675    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969685    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:37:55.969697 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969694    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:37:55.970185 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969727    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:56.969717037 +0000 UTC m=+35.586421828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:37:55.970185 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969673    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:37:55.970185 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969742    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:56.969734049 +0000 UTC m=+35.586438840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:37:55.970185 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:55.969756    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:56.969749255 +0000 UTC m=+35.586454047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:37:56.136921 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.136886    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q" event={"ID":"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1","Type":"ContainerStarted","Data":"1d1389405d926a31b1144c831c54a03564455a6cee6d397a4d4da250ee8073f6"}
May 21 12:37:56.137880 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.137861    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerStarted","Data":"c470c53e66c53946ac16046b0c07b5827e1a8645d13c61fd3439e91436aa9639"}
May 21 12:37:56.138805 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.138763    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb" event={"ID":"5a4c48b9-105a-47d3-a69f-8c182df75d6d","Type":"ContainerStarted","Data":"adb54e5798ee90471ff161f59da6ca8b9a89008287796b9dbbfeae2423a35816"}
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.977460    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.977541    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.977614    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:56.977674    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978061    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978141    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:37:58.978121535 +0000 UTC m=+37.594826332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978520    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978567    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:58.978550436 +0000 UTC m=+37.595255231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978640    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978650    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:37:56.978707 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.978680    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:58.9786704 +0000 UTC m=+37.595375196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:37:56.979623 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.979526    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:37:56.979623 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:56.979594    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:58.979578829 +0000 UTC m=+37.596283638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:37:57.009675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.008004    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:37:57.009675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.008452    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:37:57.009675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.008870    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:37:57.011661 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.011078    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 12:37:57.011661 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.011288    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 12:37:57.011661 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.011521    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 12:37:57.013368 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.012312    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsngm\""
May 21 12:37:57.013368 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.012508    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mr26\""
May 21 12:37:57.013368 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:57.012764    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 12:37:58.998279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:58.998193    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:37:58.998279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:58.998250    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:58.998319    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998370    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:37:58.998382    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998446    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:02.998425864 +0000 UTC m=+41.615130663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998491    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998505    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998552    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:02.998536651 +0000 UTC m=+41.615241445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998608    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998647    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:38:02.998635797 +0000 UTC m=+41.615340593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998651    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:37:58.998856 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:37:58.998696    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:02.998682313 +0000 UTC m=+41.615387113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:38:02.939395 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:02.939356    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:38:02.943062 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:02.943036    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/de488ca8-1c90-428e-ad26-51f30dcf82a7-original-pull-secret\") pod \"global-pull-secret-syncer-6gvv8\" (UID: \"de488ca8-1c90-428e-ad26-51f30dcf82a7\") " pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:38:03.039829 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:03.039795    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:38:03.039829 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:03.039836    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:38:03.040040 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.039951    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:38:03.040040 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.039958    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:38:03.040040 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:03.039993    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:38:03.040040 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040010    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:11.039995981 +0000 UTC m=+49.656700773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:38:03.040205 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040058    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:11.040036398 +0000 UTC m=+49.656741192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:38:03.040205 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040089    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:38:03.040205 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040140    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:38:11.040126118 +0000 UTC m=+49.656830915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:38:03.040205 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:03.040171    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:38:03.040379 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040283    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:38:03.040379 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040294    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:38:03.040379 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:03.040334    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:11.040321921 +0000 UTC m=+49.657026715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:38:03.044862 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:03.044833    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gvv8"
May 21 12:38:06.068702 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.066984    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gvv8"]
May 21 12:38:06.071610 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:38:06.071577    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde488ca8_1c90_428e_ad26_51f30dcf82a7.slice/crio-e32cbdba5a651bc1ff9222667533a13585ee76cf4b1c35b5faa86ffa1dc61f9a WatchSource:0}: Error finding container e32cbdba5a651bc1ff9222667533a13585ee76cf4b1c35b5faa86ffa1dc61f9a: Status 404 returned error can't find the container with id e32cbdba5a651bc1ff9222667533a13585ee76cf4b1c35b5faa86ffa1dc61f9a
May 21 12:38:06.160848 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.160813    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerStarted","Data":"639104bbe581391ea8a0013e8c345d613cf1034d46b80cba9fd9741312067db2"}
May 21 12:38:06.162173 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.162131    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q" event={"ID":"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1","Type":"ContainerStarted","Data":"0016722e6b68d7a4ec71fcb9468ac1ac26e9313dda50f148b68f9b4d74c2f101"}
May 21 12:38:06.162352 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.162332    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:38:06.163308 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.163277    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvv8" event={"ID":"de488ca8-1c90-428e-ad26-51f30dcf82a7","Type":"ContainerStarted","Data":"e32cbdba5a651bc1ff9222667533a13585ee76cf4b1c35b5faa86ffa1dc61f9a"}
May 21 12:38:06.164223 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.164204    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:38:06.164633 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.164609    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerStarted","Data":"cd5c1f5f80ca14c2e5e4947341052a8b879c92443746ecf3e19ce13a12d03811"}
May 21 12:38:06.204079 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:06.204036    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q" podStartSLOduration=29.960427052 podStartE2EDuration="40.204021991s" podCreationTimestamp="2026-05-21 12:37:26 +0000 UTC" firstStartedPulling="2026-05-21 12:37:55.704591948 +0000 UTC m=+34.321296744" lastFinishedPulling="2026-05-21 12:38:05.948186889 +0000 UTC m=+44.564891683" observedRunningTime="2026-05-21 12:38:06.202870306 +0000 UTC m=+44.819575128" watchObservedRunningTime="2026-05-21 12:38:06.204021991 +0000 UTC m=+44.820726804"
May 21 12:38:07.169299 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:07.169260    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="639104bbe581391ea8a0013e8c345d613cf1034d46b80cba9fd9741312067db2" exitCode=0
May 21 12:38:07.169724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:07.169339    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"639104bbe581391ea8a0013e8c345d613cf1034d46b80cba9fd9741312067db2"}
May 21 12:38:07.170847 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:07.170820    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb" event={"ID":"5a4c48b9-105a-47d3-a69f-8c182df75d6d","Type":"ContainerStarted","Data":"b16fe1bab6aade867fd54a655b4cdbb7dac10adc929ad070c55cd019c9081252"}
May 21 12:38:08.177048 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:08.177005    2567 generic.go:358] "Generic (PLEG): container finished" podID="509c9646-37ad-4665-a500-a9a454afe3a7" containerID="42b53a4ed210b6301e306f5d091193823ac71d89d0340071ae64c9bf01c9c823" exitCode=0
May 21 12:38:08.177505 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:08.177135    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerDied","Data":"42b53a4ed210b6301e306f5d091193823ac71d89d0340071ae64c9bf01c9c823"}
May 21 12:38:08.207193 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:08.206504    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb" podStartSLOduration=31.492265823 podStartE2EDuration="42.206487217s" podCreationTimestamp="2026-05-21 12:37:26 +0000 UTC" firstStartedPulling="2026-05-21 12:37:55.743485351 +0000 UTC m=+34.360190145" lastFinishedPulling="2026-05-21 12:38:06.457706737 +0000 UTC m=+45.074411539" observedRunningTime="2026-05-21 12:38:07.207245309 +0000 UTC m=+45.823950123" watchObservedRunningTime="2026-05-21 12:38:08.206487217 +0000 UTC m=+46.823192030"
May 21 12:38:09.183134 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:09.183097    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j97sv" event={"ID":"509c9646-37ad-4665-a500-a9a454afe3a7","Type":"ContainerStarted","Data":"297f834054fb32fbb28caba2de6af39f471501b4ee51697521a52e875b90ba3a"}
May 21 12:38:09.212396 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:09.212345    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j97sv" podStartSLOduration=5.985080344 podStartE2EDuration="47.212329687s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:37:24.709062106 +0000 UTC m=+3.325766897" lastFinishedPulling="2026-05-21 12:38:05.936311435 +0000 UTC m=+44.553016240" observedRunningTime="2026-05-21 12:38:09.210714926 +0000 UTC m=+47.827419738" watchObservedRunningTime="2026-05-21 12:38:09.212329687 +0000 UTC m=+47.829034501"
May 21 12:38:11.112199 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.112159    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.112220    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.112241    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.112276    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112317    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112350    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112352    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112404    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.112391282 +0000 UTC m=+65.729096072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112410    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112322    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112416    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.112410123 +0000 UTC m=+65.729114913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112509    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.112490511 +0000 UTC m=+65.729195309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:38:11.112699 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:11.112550    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:27.112523972 +0000 UTC m=+65.729228763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:38:11.188639 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.188542    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerStarted","Data":"46a16a45a8e5e94ebe9c28e15b86438ef52080dd9e0a936c8f570b63f11663ab"}
May 21 12:38:11.188639 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.188586    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerStarted","Data":"12560f121c91d47c25efacb7edde8ab493980eac62b6b2d269398b82920db120"}
May 21 12:38:11.189696 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.189670    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gvv8" event={"ID":"de488ca8-1c90-428e-ad26-51f30dcf82a7","Type":"ContainerStarted","Data":"c0a1707361e58c37f1d9d9339eb477ae5a8d9ecaaed9f7338f2147b81908d1a3"}
May 21 12:38:11.207921 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.207876    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" podStartSLOduration=30.288917263 podStartE2EDuration="45.207862874s" podCreationTimestamp="2026-05-21 12:37:26 +0000 UTC" firstStartedPulling="2026-05-21 12:37:55.750397479 +0000 UTC m=+34.367102273" lastFinishedPulling="2026-05-21 12:38:10.669343093 +0000 UTC m=+49.286047884" observedRunningTime="2026-05-21 12:38:11.207491708 +0000 UTC m=+49.824196521" watchObservedRunningTime="2026-05-21 12:38:11.207862874 +0000 UTC m=+49.824567680"
May 21 12:38:11.222186 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:11.222145    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gvv8" podStartSLOduration=35.614656587 podStartE2EDuration="40.222131945s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:38:06.073437795 +0000 UTC m=+44.690142587" lastFinishedPulling="2026-05-21 12:38:10.680913141 +0000 UTC m=+49.297617945" observedRunningTime="2026-05-21 12:38:11.221269385 +0000 UTC m=+49.837974190" watchObservedRunningTime="2026-05-21 12:38:11.222131945 +0000 UTC m=+49.838836752"
May 21 12:38:22.135689 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:22.135662    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gn2dt"
May 21 12:38:27.140543 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.140502    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:38:27.140543 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.140545    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.140586    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.140628    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140674    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140722    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140737    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140750    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140724    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140749    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:59.140729513 +0000 UTC m=+97.757434304 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140813    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:38:59.140797853 +0000 UTC m=+97.757502646 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140832    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:59.14082303 +0000 UTC m=+97.757527821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:38:27.141115 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.140851    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:59.140842752 +0000 UTC m=+97.757547543 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:38:27.745026 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.744976    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:38:27.749282 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.749259    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 12:38:27.755435 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.755421    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 12:38:27.755518 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:27.755487    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:39:31.755465141 +0000 UTC m=+130.372169949 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : secret "metrics-daemon-secret" not found
May 21 12:38:27.845813 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.845758    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:38:27.848509 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.848493    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 12:38:27.858675 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.858656    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 12:38:27.868966 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.868949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllws\" (UniqueName: \"kubernetes.io/projected/7370cd2a-4dc8-43e9-8839-adafdd54c437-kube-api-access-bllws\") pod \"network-check-target-5prsm\" (UID: \"7370cd2a-4dc8-43e9-8839-adafdd54c437\") " pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:38:27.939225 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.939203    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mr26\""
May 21 12:38:27.947288 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:27.947261    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:38:28.065314 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:28.065281    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5prsm"]
May 21 12:38:28.068086 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:38:28.068056    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7370cd2a_4dc8_43e9_8839_adafdd54c437.slice/crio-0372376ccdbee256b1e101228ad85a1072be71e8f02f21603685c37b10f7ba82 WatchSource:0}: Error finding container 0372376ccdbee256b1e101228ad85a1072be71e8f02f21603685c37b10f7ba82: Status 404 returned error can't find the container with id 0372376ccdbee256b1e101228ad85a1072be71e8f02f21603685c37b10f7ba82
May 21 12:38:28.221895 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:28.221859    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5prsm" event={"ID":"7370cd2a-4dc8-43e9-8839-adafdd54c437","Type":"ContainerStarted","Data":"0372376ccdbee256b1e101228ad85a1072be71e8f02f21603685c37b10f7ba82"}
May 21 12:38:32.231698 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:32.231664    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5prsm" event={"ID":"7370cd2a-4dc8-43e9-8839-adafdd54c437","Type":"ContainerStarted","Data":"55148f2e2063eaca8961318d4ed6e7f752506b0225bd356c74501666d8204253"}
May 21 12:38:32.232138 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:32.231729    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:38:32.248137 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:32.248090    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5prsm" podStartSLOduration=67.049859915 podStartE2EDuration="1m10.248075821s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:38:28.069959564 +0000 UTC m=+66.686664359" lastFinishedPulling="2026-05-21 12:38:31.268175473 +0000 UTC m=+69.884880265" observedRunningTime="2026-05-21 12:38:32.247102342 +0000 UTC m=+70.863807168" watchObservedRunningTime="2026-05-21 12:38:32.248075821 +0000 UTC m=+70.864780635"
May 21 12:38:59.189214 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:59.189091    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:38:59.189214 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:59.189148    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:38:59.189214 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:59.189189    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:38:59.189214 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:38:59.189208    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189232    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189300    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189306    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189325    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189340    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189302    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.189285319 +0000 UTC m=+161.805990112 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189419    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.189402046 +0000 UTC m=+161.806106837 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189439    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.189427672 +0000 UTC m=+161.806132467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:38:59.189842 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:38:59.189461    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.189453064 +0000 UTC m=+161.806157861 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:39:03.236758 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:03.236726    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5prsm"
May 21 12:39:31.836279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:31.836240    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:39:31.836809 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:31.836380    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 12:39:31.836809 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:31.836446    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs podName:d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed nodeName:}" failed. No retries permitted until 2026-05-21 12:41:33.836430369 +0000 UTC m=+252.453135160 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs") pod "network-metrics-daemon-lsggw" (UID: "d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed") : secret "metrics-daemon-secret" not found
May 21 12:39:58.248857 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:58.248801    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k" podUID="f9d49aa7-773a-4699-a8fb-0d60353476fb"
May 21 12:39:58.256996 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:58.256964    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh" podUID="428cb66f-0b3c-4aea-96dd-41a504a9bd41"
May 21 12:39:58.304629 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:58.304599    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qdgl9" podUID="89fc7d90-3149-4af5-9efe-66728918af24"
May 21 12:39:58.309751 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:39:58.309729    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6sp9h" podUID="11f41710-4aac-456c-81f8-021fed7b6509"
May 21 12:39:58.432333 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:58.432302    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:39:58.432333 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:58.432322    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:39:58.432552 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:58.432346    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:39:58.432552 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:39:58.432520    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdgl9"
May 21 12:40:00.027002 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:00.026963    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lsggw" podUID="d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed"
May 21 12:40:03.285185 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:03.285145    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:03.285202    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") pod \"image-registry-644969c5d9-7wgjh\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") " pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:03.285235    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:03.285254    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285310    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285377    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285380    2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285448    2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644969c5d9-7wgjh: secret "image-registry-tls" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285384    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert podName:f9d49aa7-773a-4699-a8fb-0d60353476fb nodeName:}" failed. No retries permitted until 2026-05-21 12:42:05.285368023 +0000 UTC m=+283.902072814 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-dj54k" (UID: "f9d49aa7-773a-4699-a8fb-0d60353476fb") : secret "networking-console-plugin-cert" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285490    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls podName:89fc7d90-3149-4af5-9efe-66728918af24 nodeName:}" failed. No retries permitted until 2026-05-21 12:42:05.285477241 +0000 UTC m=+283.902182031 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls") pod "dns-default-qdgl9" (UID: "89fc7d90-3149-4af5-9efe-66728918af24") : secret "dns-default-metrics-tls" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285500    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls podName:428cb66f-0b3c-4aea-96dd-41a504a9bd41 nodeName:}" failed. No retries permitted until 2026-05-21 12:42:05.285494822 +0000 UTC m=+283.902199612 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls") pod "image-registry-644969c5d9-7wgjh" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41") : secret "image-registry-tls" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285324    2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 12:40:03.285575 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:03.285526    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert podName:11f41710-4aac-456c-81f8-021fed7b6509 nodeName:}" failed. No retries permitted until 2026-05-21 12:42:05.285517542 +0000 UTC m=+283.902222334 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert") pod "ingress-canary-6sp9h" (UID: "11f41710-4aac-456c-81f8-021fed7b6509") : secret "canary-serving-cert" not found
May 21 12:40:03.619891 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:03.619813    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dv2tz_29780791-9947-4453-b78b-263e5fef63cf/dns-node-resolver/0.log"
May 21 12:40:04.816701 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:04.816678    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7vck_9005567f-bcd0-42a3-b56d-dfb84b800d09/node-ca/0.log"
May 21 12:40:06.452641 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:06.452561    2567 generic.go:358] "Generic (PLEG): container finished" podID="a1b0bfa3-1eeb-4ba5-806d-84437c753bc1" containerID="0016722e6b68d7a4ec71fcb9468ac1ac26e9313dda50f148b68f9b4d74c2f101" exitCode=1
May 21 12:40:06.452641 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:06.452607    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q" event={"ID":"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1","Type":"ContainerDied","Data":"0016722e6b68d7a4ec71fcb9468ac1ac26e9313dda50f148b68f9b4d74c2f101"}
May 21 12:40:06.453039 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:06.452913    2567 scope.go:117] "RemoveContainer" containerID="0016722e6b68d7a4ec71fcb9468ac1ac26e9313dda50f148b68f9b4d74c2f101"
May 21 12:40:07.455499 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.455465    2567 generic.go:358] "Generic (PLEG): container finished" podID="5a4c48b9-105a-47d3-a69f-8c182df75d6d" containerID="b16fe1bab6aade867fd54a655b4cdbb7dac10adc929ad070c55cd019c9081252" exitCode=255
May 21 12:40:07.455979 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.455536    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb" event={"ID":"5a4c48b9-105a-47d3-a69f-8c182df75d6d","Type":"ContainerDied","Data":"b16fe1bab6aade867fd54a655b4cdbb7dac10adc929ad070c55cd019c9081252"}
May 21 12:40:07.455979 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.455924    2567 scope.go:117] "RemoveContainer" containerID="b16fe1bab6aade867fd54a655b4cdbb7dac10adc929ad070c55cd019c9081252"
May 21 12:40:07.457078 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.457056    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q" event={"ID":"a1b0bfa3-1eeb-4ba5-806d-84437c753bc1","Type":"ContainerStarted","Data":"fbbec975d262cae21b4ce83b000fb61d3eda465c5de5786802bbc62913816872"}
May 21 12:40:07.457333 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.457319    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:40:07.457867 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:07.457851    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7f84ddc4-zs77q"
May 21 12:40:08.460790 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:08.460742    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8546fdc766-lr8rb" event={"ID":"5a4c48b9-105a-47d3-a69f-8c182df75d6d","Type":"ContainerStarted","Data":"8542b70c83f94bce541482cc8092cbea884b3e8bd196b75bad39de68ba1506dc"}
May 21 12:40:13.008989 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:13.008918    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:40:23.225441 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.225408    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bznzd"]
May 21 12:40:23.228558 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.228538    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.232089 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.232067    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 12:40:23.232089 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.232077    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 12:40:23.232294 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.232078    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmq2h\""
May 21 12:40:23.232294 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.232085    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 12:40:23.234684 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.234515    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 12:40:23.249271 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.249237    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bznzd"]
May 21 12:40:23.340954 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.340917    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.341122 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.340985    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.341122 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.341016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6sq9\" (UniqueName: \"kubernetes.io/projected/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-api-access-x6sq9\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.341122 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.341035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-data-volume\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.341261 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.341139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-crio-socket\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.441720 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.441683    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.441882 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.441747    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.441882 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.441798    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6sq9\" (UniqueName: \"kubernetes.io/projected/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-api-access-x6sq9\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.441882 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.441819    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-data-volume\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.442073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.442048    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-crio-socket\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.442157 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.442128    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-data-volume\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.442232 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.442182    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-crio-socket\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.442372 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.442350    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.443983 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.443965    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.453806 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.453746    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6sq9\" (UniqueName: \"kubernetes.io/projected/51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380-kube-api-access-x6sq9\") pod \"insights-runtime-extractor-bznzd\" (UID: \"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380\") " pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.537566 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.537493    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bznzd"
May 21 12:40:23.691824 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:23.691795    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bznzd"]
May 21 12:40:23.695378 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:40:23.695349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a1e0ea_c0cb_49d9_9390_a1b7bc7ed380.slice/crio-e438e7e175335173f1b0c5e768e827bd3018b9d84fd0f92acb4271e594929120 WatchSource:0}: Error finding container e438e7e175335173f1b0c5e768e827bd3018b9d84fd0f92acb4271e594929120: Status 404 returned error can't find the container with id e438e7e175335173f1b0c5e768e827bd3018b9d84fd0f92acb4271e594929120
May 21 12:40:24.501479 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:24.501451    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bznzd" event={"ID":"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380","Type":"ContainerStarted","Data":"354bf61a86ca578360d4cd4c427c18737f54d1504e1a926ed208dea1a46a981b"}
May 21 12:40:24.501748 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:24.501487    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bznzd" event={"ID":"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380","Type":"ContainerStarted","Data":"e438e7e175335173f1b0c5e768e827bd3018b9d84fd0f92acb4271e594929120"}
May 21 12:40:25.504691 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:25.504657    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bznzd" event={"ID":"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380","Type":"ContainerStarted","Data":"415141721afe97c7c63d1d375c6bd6e4ed5f4ec67bbf4561ed8232c483570286"}
May 21 12:40:26.508247 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:26.508167    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bznzd" event={"ID":"51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380","Type":"ContainerStarted","Data":"aec21ec3e50ac19aa1aa16e661911a6bb0f79a56b2de546e7bbd78a3fa6a75bd"}
May 21 12:40:26.526556 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:26.526509    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bznzd" podStartSLOduration=1.118288224 podStartE2EDuration="3.526496302s" podCreationTimestamp="2026-05-21 12:40:23 +0000 UTC" firstStartedPulling="2026-05-21 12:40:23.745335301 +0000 UTC m=+182.362040098" lastFinishedPulling="2026-05-21 12:40:26.153543386 +0000 UTC m=+184.770248176" observedRunningTime="2026-05-21 12:40:26.52510126 +0000 UTC m=+185.141806073" watchObservedRunningTime="2026-05-21 12:40:26.526496302 +0000 UTC m=+185.143201131"
May 21 12:40:39.691078 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.691046    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tq4mq"]
May 21 12:40:39.694084 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.694066    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.696507 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.696479    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 12:40:39.696650 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.696493    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 12:40:39.696878 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.696860    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 12:40:39.697592 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.697574    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 12:40:39.698130 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.698113    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 12:40:39.698130 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.698113    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 12:40:39.698307 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.698230    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rnt62\""
May 21 12:40:39.776161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-root\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776280 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776169    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776280 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzqc5\" (UniqueName: \"kubernetes.io/projected/3b0d82fb-136a-4286-adcf-f4d78041fcb0-kube-api-access-gzqc5\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776280 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-tls\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776408 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-textfile\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776408 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-wtmp\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776408 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-sys\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776408 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.776568 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.776491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-metrics-client-ca\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.876823 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876797    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-metrics-client-ca\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.876936 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876837    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-root\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.876936 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876869    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.876936 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876921    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzqc5\" (UniqueName: \"kubernetes.io/projected/3b0d82fb-136a-4286-adcf-f4d78041fcb0-kube-api-access-gzqc5\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876951    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-tls\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.876983    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-root\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877081 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877002    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-textfile\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877230 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877131    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-wtmp\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877230 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877176    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-sys\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877230 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877216    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877384 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877264    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-textfile\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877384 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877276    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-sys\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877384 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-wtmp\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877508 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877419    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-metrics-client-ca\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.877508 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.877483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-accelerators-collector-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.879359 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.879337    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-tls\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.879454 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.879341    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b0d82fb-136a-4286-adcf-f4d78041fcb0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:39.887738 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:39.887714    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzqc5\" (UniqueName: \"kubernetes.io/projected/3b0d82fb-136a-4286-adcf-f4d78041fcb0-kube-api-access-gzqc5\") pod \"node-exporter-tq4mq\" (UID: \"3b0d82fb-136a-4286-adcf-f4d78041fcb0\") " pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:40.002734 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:40.002665    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tq4mq"
May 21 12:40:40.010453 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:40:40.010430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0d82fb_136a_4286_adcf_f4d78041fcb0.slice/crio-e496f62a15459c63401c5f58b5a2511affdc93e24185121fdc4a66150ff879d2 WatchSource:0}: Error finding container e496f62a15459c63401c5f58b5a2511affdc93e24185121fdc4a66150ff879d2: Status 404 returned error can't find the container with id e496f62a15459c63401c5f58b5a2511affdc93e24185121fdc4a66150ff879d2
May 21 12:40:40.541671 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:40.541632    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq4mq" event={"ID":"3b0d82fb-136a-4286-adcf-f4d78041fcb0","Type":"ContainerStarted","Data":"e496f62a15459c63401c5f58b5a2511affdc93e24185121fdc4a66150ff879d2"}
May 21 12:40:41.545488 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:41.545453    2567 generic.go:358] "Generic (PLEG): container finished" podID="3b0d82fb-136a-4286-adcf-f4d78041fcb0" containerID="4a41498e8e98fe104ecca94f9793baf8d884d7ffc403e3db3214c75ddf05fe49" exitCode=0
May 21 12:40:41.545884 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:41.545539    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq4mq" event={"ID":"3b0d82fb-136a-4286-adcf-f4d78041fcb0","Type":"ContainerDied","Data":"4a41498e8e98fe104ecca94f9793baf8d884d7ffc403e3db3214c75ddf05fe49"}
May 21 12:40:42.549969 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:42.549932    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq4mq" event={"ID":"3b0d82fb-136a-4286-adcf-f4d78041fcb0","Type":"ContainerStarted","Data":"5b6d7bcf2119ef2a4965db142fd5283a4ea7979acd3b0f522176d2bed4878891"}
May 21 12:40:42.549969 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:42.549972    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tq4mq" event={"ID":"3b0d82fb-136a-4286-adcf-f4d78041fcb0","Type":"ContainerStarted","Data":"7546fc462f0db48a7692b143379bdab0c5bd682a82e93847fc5e816f8f793cbb"}
May 21 12:40:42.577019 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:42.576966    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tq4mq" podStartSLOduration=2.657353761 podStartE2EDuration="3.576951993s" podCreationTimestamp="2026-05-21 12:40:39 +0000 UTC" firstStartedPulling="2026-05-21 12:40:40.012307213 +0000 UTC m=+198.629012004" lastFinishedPulling="2026-05-21 12:40:40.931905446 +0000 UTC m=+199.548610236" observedRunningTime="2026-05-21 12:40:42.57524282 +0000 UTC m=+201.191947669" watchObservedRunningTime="2026-05-21 12:40:42.576951993 +0000 UTC m=+201.193656842"
May 21 12:40:45.455572 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.455534    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644969c5d9-7wgjh"]
May 21 12:40:45.456060 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:40:45.455749    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh" podUID="428cb66f-0b3c-4aea-96dd-41a504a9bd41"
May 21 12:40:45.558148 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.558117    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:40:45.562346 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.562325    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:40:45.727317 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727235    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727317 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727288    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727320    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727342    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727372    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727401    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727458    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcqkx\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx\") pod \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\" (UID: \"428cb66f-0b3c-4aea-96dd-41a504a9bd41\") "
May 21 12:40:45.727796 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727739    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 12:40:45.727915 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727812    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 12:40:45.727915 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.727744    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 12:40:45.729710 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.729685    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 12:40:45.729710 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.729699    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:40:45.729982 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.729965    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx" (OuterVolumeSpecName: "kube-api-access-kcqkx") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "kube-api-access-kcqkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:40:45.730047 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.730031    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "428cb66f-0b3c-4aea-96dd-41a504a9bd41" (UID: "428cb66f-0b3c-4aea-96dd-41a504a9bd41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 12:40:45.828362 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828327    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/428cb66f-0b3c-4aea-96dd-41a504a9bd41-ca-trust-extracted\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828362 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828358    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcqkx\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-kube-api-access-kcqkx\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828570 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828368    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-image-registry-private-configuration\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828570 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828393    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-certificates\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828570 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828402    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/428cb66f-0b3c-4aea-96dd-41a504a9bd41-trusted-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828570 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828411    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-bound-sa-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:45.828570 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:45.828419    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/428cb66f-0b3c-4aea-96dd-41a504a9bd41-installation-pull-secrets\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:46.560591 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:46.560562    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644969c5d9-7wgjh"
May 21 12:40:46.605032 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:46.605002    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644969c5d9-7wgjh"]
May 21 12:40:46.611814 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:46.611789    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-644969c5d9-7wgjh"]
May 21 12:40:46.736659 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:46.736617    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/428cb66f-0b3c-4aea-96dd-41a504a9bd41-registry-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:40:48.012008 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:40:48.011972    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428cb66f-0b3c-4aea-96dd-41a504a9bd41" path="/var/lib/kubelet/pods/428cb66f-0b3c-4aea-96dd-41a504a9bd41/volumes"
May 21 12:41:15.590572 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:15.590524    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" podUID="7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 12:41:25.591125 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:25.591086    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" podUID="7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 12:41:33.890836 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:33.890790    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:41:33.893022 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:33.893001    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed-metrics-certs\") pod \"network-metrics-daemon-lsggw\" (UID: \"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed\") " pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:41:34.012164 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:34.012136    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsngm\""
May 21 12:41:34.020298 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:34.020281    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lsggw"
May 21 12:41:34.136601 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:34.136571    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lsggw"]
May 21 12:41:34.139865 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:41:34.139831    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d6b06d_1ea8_4d9c_960f_fa5a3f9f43ed.slice/crio-2999ee64b3a9985d055b1be9b3b93fb220693d7b35bdd95b2c919f08696ad8f2 WatchSource:0}: Error finding container 2999ee64b3a9985d055b1be9b3b93fb220693d7b35bdd95b2c919f08696ad8f2: Status 404 returned error can't find the container with id 2999ee64b3a9985d055b1be9b3b93fb220693d7b35bdd95b2c919f08696ad8f2
May 21 12:41:34.678735 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:34.678698    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lsggw" event={"ID":"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed","Type":"ContainerStarted","Data":"2999ee64b3a9985d055b1be9b3b93fb220693d7b35bdd95b2c919f08696ad8f2"}
May 21 12:41:35.590759 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.590724    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" podUID="7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 12:41:35.591197 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.590804    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l"
May 21 12:41:35.591273 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.591243    2567 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"46a16a45a8e5e94ebe9c28e15b86438ef52080dd9e0a936c8f570b63f11663ab"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 12:41:35.591322 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.591292    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" podUID="7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b" containerName="service-proxy" containerID="cri-o://46a16a45a8e5e94ebe9c28e15b86438ef52080dd9e0a936c8f570b63f11663ab" gracePeriod=30
May 21 12:41:35.682434 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.682400    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lsggw" event={"ID":"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed","Type":"ContainerStarted","Data":"fbb76a130f97c33ebda46bf076813a57fe14abb20a9f33f396257d493ded82a8"}
May 21 12:41:35.682434 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.682437    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lsggw" event={"ID":"d5d6b06d-1ea8-4d9c-960f-fa5a3f9f43ed","Type":"ContainerStarted","Data":"ffc7903154c16825a1c976df895137ed561931ee09897554e324307c7ff6b726"}
May 21 12:41:35.702192 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:35.702153    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lsggw" podStartSLOduration=252.72428049 podStartE2EDuration="4m13.70213849s" podCreationTimestamp="2026-05-21 12:37:22 +0000 UTC" firstStartedPulling="2026-05-21 12:41:34.141549117 +0000 UTC m=+252.758253909" lastFinishedPulling="2026-05-21 12:41:35.119407118 +0000 UTC m=+253.736111909" observedRunningTime="2026-05-21 12:41:35.70127651 +0000 UTC m=+254.317981326" watchObservedRunningTime="2026-05-21 12:41:35.70213849 +0000 UTC m=+254.318843302"
May 21 12:41:36.686991 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:36.686958    2567 generic.go:358] "Generic (PLEG): container finished" podID="7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b" containerID="46a16a45a8e5e94ebe9c28e15b86438ef52080dd9e0a936c8f570b63f11663ab" exitCode=2
May 21 12:41:36.687351 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:36.687035    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerDied","Data":"46a16a45a8e5e94ebe9c28e15b86438ef52080dd9e0a936c8f570b63f11663ab"}
May 21 12:41:36.687351 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:41:36.687074    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79c7b4974-s8q4l" event={"ID":"7aeb4f76-e5c5-42c5-bd5c-0bcf2ff24f1b","Type":"ContainerStarted","Data":"2f9a9fc7d214854b3938196d880de064dfa8a09569b95e9ebe093b06d1db4ed3"}
May 21 12:42:01.433116 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:42:01.433069    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k" podUID="f9d49aa7-773a-4699-a8fb-0d60353476fb"
May 21 12:42:01.433116 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:42:01.433095    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6sp9h" podUID="11f41710-4aac-456c-81f8-021fed7b6509"
May 21 12:42:01.433563 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:42:01.433134    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qdgl9" podUID="89fc7d90-3149-4af5-9efe-66728918af24"
May 21 12:42:01.744275 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:01.744189    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:42:01.744448 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:01.744192    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:01.744448 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:01.744192    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:42:05.332548 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.332502    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:42:05.332974 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.332575    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:05.332974 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.332594    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:42:05.334943 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.334920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/89fc7d90-3149-4af5-9efe-66728918af24-metrics-tls\") pod \"dns-default-qdgl9\" (UID: \"89fc7d90-3149-4af5-9efe-66728918af24\") " pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:05.334943 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.334931    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11f41710-4aac-456c-81f8-021fed7b6509-cert\") pod \"ingress-canary-6sp9h\" (UID: \"11f41710-4aac-456c-81f8-021fed7b6509\") " pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:42:05.335114 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.334970    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9d49aa7-773a-4699-a8fb-0d60353476fb-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-dj54k\" (UID: \"f9d49aa7-773a-4699-a8fb-0d60353476fb\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:42:05.348140 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.348119    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbjhg\""
May 21 12:42:05.348248 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.348147    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m7gww\""
May 21 12:42:05.348248 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.348160    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-ztrnv\""
May 21 12:42:05.355189 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.355163    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:05.355189 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.355178    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sp9h"
May 21 12:42:05.355316 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.355166    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"
May 21 12:42:05.494894 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.494864    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qdgl9"]
May 21 12:42:05.499542 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:42:05.499355    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fc7d90_3149_4af5_9efe_66728918af24.slice/crio-beb74f8390554161bca35211df7d6b4074d15b17659b4dae3a86014c08d0c04d WatchSource:0}: Error finding container beb74f8390554161bca35211df7d6b4074d15b17659b4dae3a86014c08d0c04d: Status 404 returned error can't find the container with id beb74f8390554161bca35211df7d6b4074d15b17659b4dae3a86014c08d0c04d
May 21 12:42:05.509269 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.509241    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6sp9h"]
May 21 12:42:05.512057 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:42:05.512033    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f41710_4aac_456c_81f8_021fed7b6509.slice/crio-63a9f2396c4c00568ad027bf3b8c4dbe79177ac9bbeb444a05d0f91dadfae972 WatchSource:0}: Error finding container 63a9f2396c4c00568ad027bf3b8c4dbe79177ac9bbeb444a05d0f91dadfae972: Status 404 returned error can't find the container with id 63a9f2396c4c00568ad027bf3b8c4dbe79177ac9bbeb444a05d0f91dadfae972
May 21 12:42:05.529331 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.529306    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k"]
May 21 12:42:05.531638 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:42:05.531607    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d49aa7_773a_4699_a8fb_0d60353476fb.slice/crio-c99d2bf4e69c258aa90fd3a4554a305eb28aa06a4c158221192140abfbbbc56b WatchSource:0}: Error finding container c99d2bf4e69c258aa90fd3a4554a305eb28aa06a4c158221192140abfbbbc56b: Status 404 returned error can't find the container with id c99d2bf4e69c258aa90fd3a4554a305eb28aa06a4c158221192140abfbbbc56b
May 21 12:42:05.754088 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.754045    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k" event={"ID":"f9d49aa7-773a-4699-a8fb-0d60353476fb","Type":"ContainerStarted","Data":"c99d2bf4e69c258aa90fd3a4554a305eb28aa06a4c158221192140abfbbbc56b"}
May 21 12:42:05.755013 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.754990    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdgl9" event={"ID":"89fc7d90-3149-4af5-9efe-66728918af24","Type":"ContainerStarted","Data":"beb74f8390554161bca35211df7d6b4074d15b17659b4dae3a86014c08d0c04d"}
May 21 12:42:05.755830 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:05.755810    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6sp9h" event={"ID":"11f41710-4aac-456c-81f8-021fed7b6509","Type":"ContainerStarted","Data":"63a9f2396c4c00568ad027bf3b8c4dbe79177ac9bbeb444a05d0f91dadfae972"}
May 21 12:42:08.770286 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.770249    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k" event={"ID":"f9d49aa7-773a-4699-a8fb-0d60353476fb","Type":"ContainerStarted","Data":"9fbcd654ddf3574978c7454ed8b09c7db9d4c09f226f670a8c4a87655715cff6"}
May 21 12:42:08.771745 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.771717    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdgl9" event={"ID":"89fc7d90-3149-4af5-9efe-66728918af24","Type":"ContainerStarted","Data":"9f9252d0b0fabb650edf9a190db75016bce204832f23f112cd34bf9d883fefbf"}
May 21 12:42:08.771877 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.771750    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qdgl9" event={"ID":"89fc7d90-3149-4af5-9efe-66728918af24","Type":"ContainerStarted","Data":"cfd16c39b8224298011e95842803190ef334d7f2fdeeefa526a42caf4cd69abf"}
May 21 12:42:08.771877 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.771828    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:08.772943 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.772924    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6sp9h" event={"ID":"11f41710-4aac-456c-81f8-021fed7b6509","Type":"ContainerStarted","Data":"8f531c0a0b5af6a37c08f471173092cb94422eac22f517915050473076f76dd7"}
May 21 12:42:08.789135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.789095    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-dj54k" podStartSLOduration=267.629707875 podStartE2EDuration="4m29.789083338s" podCreationTimestamp="2026-05-21 12:37:39 +0000 UTC" firstStartedPulling="2026-05-21 12:42:05.53331863 +0000 UTC m=+284.150023421" lastFinishedPulling="2026-05-21 12:42:07.692694091 +0000 UTC m=+286.309398884" observedRunningTime="2026-05-21 12:42:08.787679125 +0000 UTC m=+287.404383949" watchObservedRunningTime="2026-05-21 12:42:08.789083338 +0000 UTC m=+287.405788151"
May 21 12:42:08.833637 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.833592    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qdgl9" podStartSLOduration=251.641535747 podStartE2EDuration="4m13.833572113s" podCreationTimestamp="2026-05-21 12:37:55 +0000 UTC" firstStartedPulling="2026-05-21 12:42:05.50259446 +0000 UTC m=+284.119299252" lastFinishedPulling="2026-05-21 12:42:07.694630822 +0000 UTC m=+286.311335618" observedRunningTime="2026-05-21 12:42:08.814619994 +0000 UTC m=+287.431324806" watchObservedRunningTime="2026-05-21 12:42:08.833572113 +0000 UTC m=+287.450276928"
May 21 12:42:08.833818 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:08.833680    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6sp9h" podStartSLOduration=251.647639533 podStartE2EDuration="4m13.833676418s" podCreationTimestamp="2026-05-21 12:37:55 +0000 UTC" firstStartedPulling="2026-05-21 12:42:05.514236399 +0000 UTC m=+284.130941191" lastFinishedPulling="2026-05-21 12:42:07.700273284 +0000 UTC m=+286.316978076" observedRunningTime="2026-05-21 12:42:08.832957489 +0000 UTC m=+287.449662328" watchObservedRunningTime="2026-05-21 12:42:08.833676418 +0000 UTC m=+287.450381230"
May 21 12:42:18.777613 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:18.777579    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qdgl9"
May 21 12:42:21.919743 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:42:21.919716    2567 kubelet.go:1628] "Image garbage collection succeeded"
May 21 12:43:30.988041 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:30.987957    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zhtw2"]
May 21 12:43:30.991033 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:30.991012    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:30.993402 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:30.993385    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 12:43:30.994161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:30.994146    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-frc7q\""
May 21 12:43:30.994214 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:30.994149    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 12:43:31.000869 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.000842    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zhtw2"]
May 21 12:43:31.121486 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.121449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nztt\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-kube-api-access-8nztt\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.121661 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.121499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.222076 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.222034    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nztt\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-kube-api-access-8nztt\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.222257 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.222087    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.230484 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.230448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.230592 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.230556    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nztt\" (UniqueName: \"kubernetes.io/projected/f477a1de-509d-4cc1-903c-67c4c469a2fb-kube-api-access-8nztt\") pod \"cert-manager-cainjector-68b757865b-zhtw2\" (UID: \"f477a1de-509d-4cc1-903c-67c4c469a2fb\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.300462 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.300377    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2"
May 21 12:43:31.424902 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.424875    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zhtw2"]
May 21 12:43:31.427410 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:43:31.427387    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf477a1de_509d_4cc1_903c_67c4c469a2fb.slice/crio-7cae907ddb46d20b271702df6dbf36c31f50cff13508c6ddf0543c571ab29a60 WatchSource:0}: Error finding container 7cae907ddb46d20b271702df6dbf36c31f50cff13508c6ddf0543c571ab29a60: Status 404 returned error can't find the container with id 7cae907ddb46d20b271702df6dbf36c31f50cff13508c6ddf0543c571ab29a60
May 21 12:43:31.429099 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.429083    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 12:43:31.989788 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:31.989743    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2" event={"ID":"f477a1de-509d-4cc1-903c-67c4c469a2fb","Type":"ContainerStarted","Data":"7cae907ddb46d20b271702df6dbf36c31f50cff13508c6ddf0543c571ab29a60"}
May 21 12:43:33.995805 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:33.995753    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2" event={"ID":"f477a1de-509d-4cc1-903c-67c4c469a2fb","Type":"ContainerStarted","Data":"4269a6c0d45371261430f034b767d56d476f4cd905a4abaceacb075ccf96d7d3"}
May 21 12:43:34.015781 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:43:34.015718    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-zhtw2" podStartSLOduration=1.664767842 podStartE2EDuration="4.015704554s" podCreationTimestamp="2026-05-21 12:43:30 +0000 UTC" firstStartedPulling="2026-05-21 12:43:31.429235974 +0000 UTC m=+370.045940765" lastFinishedPulling="2026-05-21 12:43:33.780172665 +0000 UTC m=+372.396877477" observedRunningTime="2026-05-21 12:43:34.014495005 +0000 UTC m=+372.631199818" watchObservedRunningTime="2026-05-21 12:43:34.015704554 +0000 UTC m=+372.632409368"
May 21 12:44:01.497718 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.497679    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"]
May 21 12:44:01.500869 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.500847    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.504693 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.504667    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgw88\""
May 21 12:44:01.504846 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.504716    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 12:44:01.505459 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.505442    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 12:44:01.505562 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.505516    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 12:44:01.505682 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.505657    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 12:44:01.525016 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.524992    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"]
May 21 12:44:01.640269 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.640227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rdq\" (UniqueName: \"kubernetes.io/projected/ad5ef8a0-35a3-419d-bd96-594fec79664c-kube-api-access-h4rdq\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.640438 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.640295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.640438 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.640326    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.741659 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.741617    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.741659 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.741663    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.741895 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.741698    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rdq\" (UniqueName: \"kubernetes.io/projected/ad5ef8a0-35a3-419d-bd96-594fec79664c-kube-api-access-h4rdq\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.744302 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.744267    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.744413 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.744272    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad5ef8a0-35a3-419d-bd96-594fec79664c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.762636 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.762574    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rdq\" (UniqueName: \"kubernetes.io/projected/ad5ef8a0-35a3-419d-bd96-594fec79664c-kube-api-access-h4rdq\") pod \"opendatahub-operator-controller-manager-84556f689c-q5f86\" (UID: \"ad5ef8a0-35a3-419d-bd96-594fec79664c\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.811219 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.811190    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:01.951146 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:01.951111    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"]
May 21 12:44:01.956415 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:44:01.956386    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5ef8a0_35a3_419d_bd96_594fec79664c.slice/crio-70e1dd70cac0cd71d95e8f89e8a80670e38f7acd1d3db41b15e33c507ac06541 WatchSource:0}: Error finding container 70e1dd70cac0cd71d95e8f89e8a80670e38f7acd1d3db41b15e33c507ac06541: Status 404 returned error can't find the container with id 70e1dd70cac0cd71d95e8f89e8a80670e38f7acd1d3db41b15e33c507ac06541
May 21 12:44:02.062569 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:02.062479    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86" event={"ID":"ad5ef8a0-35a3-419d-bd96-594fec79664c","Type":"ContainerStarted","Data":"70e1dd70cac0cd71d95e8f89e8a80670e38f7acd1d3db41b15e33c507ac06541"}
May 21 12:44:05.071413 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:05.071377    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86" event={"ID":"ad5ef8a0-35a3-419d-bd96-594fec79664c","Type":"ContainerStarted","Data":"1eb44a25813f3e84ab16ab8dbcab971d28d2b62c8cd09d38a322479f3069d039"}
May 21 12:44:05.071842 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:05.071482    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:05.166277 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:05.166227    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86" podStartSLOduration=1.555850098 podStartE2EDuration="4.166211471s" podCreationTimestamp="2026-05-21 12:44:01 +0000 UTC" firstStartedPulling="2026-05-21 12:44:01.958045855 +0000 UTC m=+400.574750646" lastFinishedPulling="2026-05-21 12:44:04.568407224 +0000 UTC m=+403.185112019" observedRunningTime="2026-05-21 12:44:05.130101929 +0000 UTC m=+403.746806742" watchObservedRunningTime="2026-05-21 12:44:05.166211471 +0000 UTC m=+403.782916283"
May 21 12:44:16.076064 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:16.076036    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-q5f86"
May 21 12:44:19.153648 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.153612    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"]
May 21 12:44:19.156555 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.156537    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.159805 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.159759    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ptzpn\""
May 21 12:44:19.160667 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.160648    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 12:44:19.160812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.160671    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 12:44:19.160812 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.160670    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 12:44:19.161514 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.161487    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 12:44:19.166471 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.166451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff90ed5-10c7-4967-b773-16766eb079c7-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.166566 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.166499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9msx\" (UniqueName: \"kubernetes.io/projected/aff90ed5-10c7-4967-b773-16766eb079c7-kube-api-access-c9msx\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.166616 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.166601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aff90ed5-10c7-4967-b773-16766eb079c7-tmp\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.183587 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.183555    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"]
May 21 12:44:19.266971 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.266939    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff90ed5-10c7-4967-b773-16766eb079c7-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.267154 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.266985    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9msx\" (UniqueName: \"kubernetes.io/projected/aff90ed5-10c7-4967-b773-16766eb079c7-kube-api-access-c9msx\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.267154 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.267128    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aff90ed5-10c7-4967-b773-16766eb079c7-tmp\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.269463 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.269439    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aff90ed5-10c7-4967-b773-16766eb079c7-tmp\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.269593 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.269576    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aff90ed5-10c7-4967-b773-16766eb079c7-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.280493 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.280453    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9msx\" (UniqueName: \"kubernetes.io/projected/aff90ed5-10c7-4967-b773-16766eb079c7-kube-api-access-c9msx\") pod \"kube-auth-proxy-7485fd7bf5-mrp89\" (UID: \"aff90ed5-10c7-4967-b773-16766eb079c7\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.468070 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.467994    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"
May 21 12:44:19.600620 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:19.600590    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89"]
May 21 12:44:19.603999 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:44:19.603972    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff90ed5_10c7_4967_b773_16766eb079c7.slice/crio-7ce6de2af3f51f6440199633b06cfa2e2a77de8c3b3ad1c9abc1d4de5d732157 WatchSource:0}: Error finding container 7ce6de2af3f51f6440199633b06cfa2e2a77de8c3b3ad1c9abc1d4de5d732157: Status 404 returned error can't find the container with id 7ce6de2af3f51f6440199633b06cfa2e2a77de8c3b3ad1c9abc1d4de5d732157
May 21 12:44:20.110469 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:20.110428    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89" event={"ID":"aff90ed5-10c7-4967-b773-16766eb079c7","Type":"ContainerStarted","Data":"7ce6de2af3f51f6440199633b06cfa2e2a77de8c3b3ad1c9abc1d4de5d732157"}
May 21 12:44:23.387471 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.387432    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nhhnw"]
May 21 12:44:23.390928 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.390898    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:23.393343 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.393320    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 12:44:23.393474 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.393387    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ggzb7\""
May 21 12:44:23.401543 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.401491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5gf\" (UniqueName: \"kubernetes.io/projected/0e1ef120-0307-4475-a327-deee2f13b53c-kube-api-access-xl5gf\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:23.401672 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.401629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:23.401877 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.401843    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nhhnw"]
May 21 12:44:23.485471 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.485449    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 12:44:23.502725 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.502699    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5gf\" (UniqueName: \"kubernetes.io/projected/0e1ef120-0307-4475-a327-deee2f13b53c-kube-api-access-xl5gf\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:23.502830 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.502814    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:23.502949 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:23.502934    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 12:44:23.503017 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:23.503006    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert podName:0e1ef120-0307-4475-a327-deee2f13b53c nodeName:}" failed. No retries permitted until 2026-05-21 12:44:24.002983251 +0000 UTC m=+422.619688047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert") pod "odh-model-controller-858dbf95b8-nhhnw" (UID: "0e1ef120-0307-4475-a327-deee2f13b53c") : secret "odh-model-controller-webhook-cert" not found
May 21 12:44:23.511471 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:23.511447    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5gf\" (UniqueName: \"kubernetes.io/projected/0e1ef120-0307-4475-a327-deee2f13b53c-kube-api-access-xl5gf\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:24.007671 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.007634    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:24.010161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.010138    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e1ef120-0307-4475-a327-deee2f13b53c-cert\") pod \"odh-model-controller-858dbf95b8-nhhnw\" (UID: \"0e1ef120-0307-4475-a327-deee2f13b53c\") " pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:24.122302 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.122271    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89" event={"ID":"aff90ed5-10c7-4967-b773-16766eb079c7","Type":"ContainerStarted","Data":"59359122e516a1234c7a5041a2da177df552830f8bd6efe2540a3c6d1dacc718"}
May 21 12:44:24.147391 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.147331    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-mrp89" podStartSLOduration=1.26985273 podStartE2EDuration="5.147315341s" podCreationTimestamp="2026-05-21 12:44:19 +0000 UTC" firstStartedPulling="2026-05-21 12:44:19.605659589 +0000 UTC m=+418.222364383" lastFinishedPulling="2026-05-21 12:44:23.483122199 +0000 UTC m=+422.099826994" observedRunningTime="2026-05-21 12:44:24.146416595 +0000 UTC m=+422.763121409" watchObservedRunningTime="2026-05-21 12:44:24.147315341 +0000 UTC m=+422.764020154"
May 21 12:44:24.304190 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.304099    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:24.435036 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:24.434839    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nhhnw"]
May 21 12:44:24.437624 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:44:24.437595    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1ef120_0307_4475_a327_deee2f13b53c.slice/crio-59e93b6fb92cd39c6510f7ae470c1330f91caf58f23f039a34aea0a044d8af14 WatchSource:0}: Error finding container 59e93b6fb92cd39c6510f7ae470c1330f91caf58f23f039a34aea0a044d8af14: Status 404 returned error can't find the container with id 59e93b6fb92cd39c6510f7ae470c1330f91caf58f23f039a34aea0a044d8af14
May 21 12:44:25.127521 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:25.127482    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" event={"ID":"0e1ef120-0307-4475-a327-deee2f13b53c","Type":"ContainerStarted","Data":"59e93b6fb92cd39c6510f7ae470c1330f91caf58f23f039a34aea0a044d8af14"}
May 21 12:44:27.134332 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:27.134302    2567 generic.go:358] "Generic (PLEG): container finished" podID="0e1ef120-0307-4475-a327-deee2f13b53c" containerID="21947b17718b21ec93b3ea6a9fb5e54117a8e3a7b567e0aac61a5200975047d6" exitCode=1
May 21 12:44:27.134628 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:27.134344    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" event={"ID":"0e1ef120-0307-4475-a327-deee2f13b53c","Type":"ContainerDied","Data":"21947b17718b21ec93b3ea6a9fb5e54117a8e3a7b567e0aac61a5200975047d6"}
May 21 12:44:27.134628 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:27.134568    2567 scope.go:117] "RemoveContainer" containerID="21947b17718b21ec93b3ea6a9fb5e54117a8e3a7b567e0aac61a5200975047d6"
May 21 12:44:28.138474 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:28.138441    2567 generic.go:358] "Generic (PLEG): container finished" podID="0e1ef120-0307-4475-a327-deee2f13b53c" containerID="d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8" exitCode=1
May 21 12:44:28.138932 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:28.138485    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" event={"ID":"0e1ef120-0307-4475-a327-deee2f13b53c","Type":"ContainerDied","Data":"d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8"}
May 21 12:44:28.138932 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:28.138512    2567 scope.go:117] "RemoveContainer" containerID="21947b17718b21ec93b3ea6a9fb5e54117a8e3a7b567e0aac61a5200975047d6"
May 21 12:44:28.138932 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:28.138738    2567 scope.go:117] "RemoveContainer" containerID="d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8"
May 21 12:44:28.139096 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:28.138941    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nhhnw_opendatahub(0e1ef120-0307-4475-a327-deee2f13b53c)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" podUID="0e1ef120-0307-4475-a327-deee2f13b53c"
May 21 12:44:29.143359 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.143331    2567 scope.go:117] "RemoveContainer" containerID="d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8"
May 21 12:44:29.143698 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:29.143497    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nhhnw_opendatahub(0e1ef120-0307-4475-a327-deee2f13b53c)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" podUID="0e1ef120-0307-4475-a327-deee2f13b53c"
May 21 12:44:29.412610 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.412529    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7gxmj"]
May 21 12:44:29.417416 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.417383    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:29.420523 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.420500    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-skt8r\""
May 21 12:44:29.420653 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.420583    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 12:44:29.429134 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.429112    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7gxmj"]
May 21 12:44:29.453010 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.452983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6plw\" (UniqueName: \"kubernetes.io/projected/dce100c1-c814-43b9-bd16-f7592638fe9c-kube-api-access-f6plw\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:29.453143 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.453043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:29.554177 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.554143    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:29.554330 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.554201    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6plw\" (UniqueName: \"kubernetes.io/projected/dce100c1-c814-43b9-bd16-f7592638fe9c-kube-api-access-f6plw\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:29.554330 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:29.554292    2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 12:44:29.554407 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:29.554357    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert podName:dce100c1-c814-43b9-bd16-f7592638fe9c nodeName:}" failed. No retries permitted until 2026-05-21 12:44:30.054338857 +0000 UTC m=+428.671043651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert") pod "kserve-controller-manager-856948b99f-7gxmj" (UID: "dce100c1-c814-43b9-bd16-f7592638fe9c") : secret "kserve-webhook-server-cert" not found
May 21 12:44:29.572091 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:29.572065    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6plw\" (UniqueName: \"kubernetes.io/projected/dce100c1-c814-43b9-bd16-f7592638fe9c-kube-api-access-f6plw\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:30.057074 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:30.057041    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:30.059355 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:30.059332    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dce100c1-c814-43b9-bd16-f7592638fe9c-cert\") pod \"kserve-controller-manager-856948b99f-7gxmj\" (UID: \"dce100c1-c814-43b9-bd16-f7592638fe9c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:30.328192 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:30.328111    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:30.454603 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:30.454576    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7gxmj"]
May 21 12:44:30.456461 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:44:30.456436    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce100c1_c814_43b9_bd16_f7592638fe9c.slice/crio-7806be5cda3cb87d18bd411b8404c8c81211c1ae6298b58cc0ef802cfab3ac46 WatchSource:0}: Error finding container 7806be5cda3cb87d18bd411b8404c8c81211c1ae6298b58cc0ef802cfab3ac46: Status 404 returned error can't find the container with id 7806be5cda3cb87d18bd411b8404c8c81211c1ae6298b58cc0ef802cfab3ac46
May 21 12:44:31.149356 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:31.149318    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj" event={"ID":"dce100c1-c814-43b9-bd16-f7592638fe9c","Type":"ContainerStarted","Data":"7806be5cda3cb87d18bd411b8404c8c81211c1ae6298b58cc0ef802cfab3ac46"}
May 21 12:44:34.159278 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:34.159233    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj" event={"ID":"dce100c1-c814-43b9-bd16-f7592638fe9c","Type":"ContainerStarted","Data":"3a49e9abca7c4abd0543a5bb5e7e13b4faa9713760a433b7b7d71b478e2dd6de"}
May 21 12:44:34.159740 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:34.159390    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:44:34.211388 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:34.211335    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj" podStartSLOduration=2.341454899 podStartE2EDuration="5.211321095s" podCreationTimestamp="2026-05-21 12:44:29 +0000 UTC" firstStartedPulling="2026-05-21 12:44:30.457760422 +0000 UTC m=+429.074465213" lastFinishedPulling="2026-05-21 12:44:33.327626619 +0000 UTC m=+431.944331409" observedRunningTime="2026-05-21 12:44:34.209703189 +0000 UTC m=+432.826408002" watchObservedRunningTime="2026-05-21 12:44:34.211321095 +0000 UTC m=+432.828025908"
May 21 12:44:34.304879 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:34.304848    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:34.305238 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:34.305222    2567 scope.go:117] "RemoveContainer" containerID="d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8"
May 21 12:44:34.305425 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:44:34.305407    2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nhhnw_opendatahub(0e1ef120-0307-4475-a327-deee2f13b53c)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" podUID="0e1ef120-0307-4475-a327-deee2f13b53c"
May 21 12:44:36.196086 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.196050    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"]
May 21 12:44:36.200959 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.200937    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.203223 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.203199    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6tklx\""
May 21 12:44:36.203338 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.203199    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 12:44:36.203554 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.203538    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 12:44:36.222103 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.222078    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"]
May 21 12:44:36.305510 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.305465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/65933043-7063-4312-b1c7-8d292552fd3d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.305682 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.305518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5qj\" (UniqueName: \"kubernetes.io/projected/65933043-7063-4312-b1c7-8d292552fd3d-kube-api-access-5w5qj\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.407123 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.407088    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/65933043-7063-4312-b1c7-8d292552fd3d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.407287 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.407132    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5qj\" (UniqueName: \"kubernetes.io/projected/65933043-7063-4312-b1c7-8d292552fd3d-kube-api-access-5w5qj\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.409530 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.409504    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/65933043-7063-4312-b1c7-8d292552fd3d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.416979 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.416954    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5qj\" (UniqueName: \"kubernetes.io/projected/65933043-7063-4312-b1c7-8d292552fd3d-kube-api-access-5w5qj\") pod \"servicemesh-operator3-55f49c5f94-shsmh\" (UID: \"65933043-7063-4312-b1c7-8d292552fd3d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.510462 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.510376    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:36.653060 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:36.653022    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"]
May 21 12:44:36.655957 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:44:36.655927    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65933043_7063_4312_b1c7_8d292552fd3d.slice/crio-860d3a18d6203382236d37b34f95615145fae037ae7c8f4710ac87870f17ad55 WatchSource:0}: Error finding container 860d3a18d6203382236d37b34f95615145fae037ae7c8f4710ac87870f17ad55: Status 404 returned error can't find the container with id 860d3a18d6203382236d37b34f95615145fae037ae7c8f4710ac87870f17ad55
May 21 12:44:37.169295 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:37.169263    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh" event={"ID":"65933043-7063-4312-b1c7-8d292552fd3d","Type":"ContainerStarted","Data":"860d3a18d6203382236d37b34f95615145fae037ae7c8f4710ac87870f17ad55"}
May 21 12:44:40.179533 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:40.179445    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh" event={"ID":"65933043-7063-4312-b1c7-8d292552fd3d","Type":"ContainerStarted","Data":"40301746fa46e364dd63da5e4f43a41edc5cd885e48d81d1dd4c541caffba76e"}
May 21 12:44:40.179971 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:40.179553    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:40.200959 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:40.200916    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh" podStartSLOduration=1.627801137 podStartE2EDuration="4.200904965s" podCreationTimestamp="2026-05-21 12:44:36 +0000 UTC" firstStartedPulling="2026-05-21 12:44:36.65843345 +0000 UTC m=+435.275138242" lastFinishedPulling="2026-05-21 12:44:39.23153727 +0000 UTC m=+437.848242070" observedRunningTime="2026-05-21 12:44:40.198527909 +0000 UTC m=+438.815232721" watchObservedRunningTime="2026-05-21 12:44:40.200904965 +0000 UTC m=+438.817609777"
May 21 12:44:44.304584 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:44.304548    2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:44.305001 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:44.304941    2567 scope.go:117] "RemoveContainer" containerID="d109f56bd177961a6d93a5934904ffc67c44a1c4662f593ea496eebc95bf53e8"
May 21 12:44:45.196527 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:45.196490    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" event={"ID":"0e1ef120-0307-4475-a327-deee2f13b53c","Type":"ContainerStarted","Data":"768afa3a2bbf0f0d9428b0d3a19d0ba680a063fc131d2c8d9186c7fc157728ae"}
May 21 12:44:45.196721 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:45.196706    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:44:45.215954 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:45.215888    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw" podStartSLOduration=2.080438453 podStartE2EDuration="22.215876759s" podCreationTimestamp="2026-05-21 12:44:23 +0000 UTC" firstStartedPulling="2026-05-21 12:44:24.438961376 +0000 UTC m=+423.055666168" lastFinishedPulling="2026-05-21 12:44:44.574399663 +0000 UTC m=+443.191104474" observedRunningTime="2026-05-21 12:44:45.214277728 +0000 UTC m=+443.830982541" watchObservedRunningTime="2026-05-21 12:44:45.215876759 +0000 UTC m=+443.832581571"
May 21 12:44:51.186122 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:51.186088    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-shsmh"
May 21 12:44:56.201399 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:44:56.201367    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-nhhnw"
May 21 12:45:00.795782 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.795731    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"]
May 21 12:45:00.801945 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.801926    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.804688 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.804603    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 12:45:00.804688 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.804632    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 12:45:00.804688 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.804666    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 12:45:00.805013 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.804919    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 12:45:00.805195 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.805179    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tbhx9\""
May 21 12:45:00.814951 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.814928    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"]
May 21 12:45:00.907279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29kj\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-kube-api-access-w29kj\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26807820-21a8-42a4-beb4-b114e1c610be-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:00.907537 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:00.907529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008622    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008682    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008715    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w29kj\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-kube-api-access-w29kj\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008746    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008814    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26807820-21a8-42a4-beb4-b114e1c610be-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008843    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.008870    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.009817 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.009461    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.012829 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.012803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26807820-21a8-42a4-beb4-b114e1c610be-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.012945 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.012837    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.012998 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.012960    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.013128 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.013112    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26807820-21a8-42a4-beb4-b114e1c610be-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.018730 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.018707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.019037 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.019018    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29kj\" (UniqueName: \"kubernetes.io/projected/26807820-21a8-42a4-beb4-b114e1c610be-kube-api-access-w29kj\") pod \"istiod-openshift-gateway-798958bb55-fjrcm\" (UID: \"26807820-21a8-42a4-beb4-b114e1c610be\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.116423 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.116391    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:01.262138 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:01.262106    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"]
May 21 12:45:01.265590 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:45:01.265559    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26807820_21a8_42a4_beb4_b114e1c610be.slice/crio-23e290629f824e267b03d541fe2963d5ecff451acc67eb48cc47084a03ca9349 WatchSource:0}: Error finding container 23e290629f824e267b03d541fe2963d5ecff451acc67eb48cc47084a03ca9349: Status 404 returned error can't find the container with id 23e290629f824e267b03d541fe2963d5ecff451acc67eb48cc47084a03ca9349
May 21 12:45:02.244801 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:02.244745    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm" event={"ID":"26807820-21a8-42a4-beb4-b114e1c610be","Type":"ContainerStarted","Data":"23e290629f824e267b03d541fe2963d5ecff451acc67eb48cc47084a03ca9349"}
May 21 12:45:05.169392 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:05.169353    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-7gxmj"
May 21 12:45:05.563704 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:05.563662    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 21 12:45:05.563803 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:05.563737    2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 21 12:45:06.261494 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:06.261449    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm" event={"ID":"26807820-21a8-42a4-beb4-b114e1c610be","Type":"ContainerStarted","Data":"26aa418d8881ca0fb14910b20ead3796c09cdf1747066a596ed09ccb7380e00b"}
May 21 12:45:06.261962 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:06.261580    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:06.263195 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:06.263173    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-fjrcm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 12:45:06.263306 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:06.263221    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm" podUID="26807820-21a8-42a4-beb4-b114e1c610be" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 12:45:06.287020 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:06.286964    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm" podStartSLOduration=1.991506188 podStartE2EDuration="6.286948231s" podCreationTimestamp="2026-05-21 12:45:00 +0000 UTC" firstStartedPulling="2026-05-21 12:45:01.268006759 +0000 UTC m=+459.884711563" lastFinishedPulling="2026-05-21 12:45:05.563448797 +0000 UTC m=+464.180153606" observedRunningTime="2026-05-21 12:45:06.28451366 +0000 UTC m=+464.901218472" watchObservedRunningTime="2026-05-21 12:45:06.286948231 +0000 UTC m=+464.903653045"
May 21 12:45:07.265037 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:07.265007    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fjrcm"
May 21 12:45:20.709326 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.709282    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkxqp"]
May 21 12:45:20.712885 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.712862    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:20.718396 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.718370    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 12:45:20.718719 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.718378    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l2bgz\""
May 21 12:45:20.724310 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.724287    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 12:45:20.726041 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.726010    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkxqp"]
May 21 12:45:20.772386 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.772333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbv7c\" (UniqueName: \"kubernetes.io/projected/45412d1f-d47c-4a3f-80cc-e8294a1fd2cd-kube-api-access-wbv7c\") pod \"kuadrant-operator-catalog-pkxqp\" (UID: \"45412d1f-d47c-4a3f-80cc-e8294a1fd2cd\") " pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:20.873958 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.873925    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbv7c\" (UniqueName: \"kubernetes.io/projected/45412d1f-d47c-4a3f-80cc-e8294a1fd2cd-kube-api-access-wbv7c\") pod \"kuadrant-operator-catalog-pkxqp\" (UID: \"45412d1f-d47c-4a3f-80cc-e8294a1fd2cd\") " pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:20.881871 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:20.881831    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbv7c\" (UniqueName: \"kubernetes.io/projected/45412d1f-d47c-4a3f-80cc-e8294a1fd2cd-kube-api-access-wbv7c\") pod \"kuadrant-operator-catalog-pkxqp\" (UID: \"45412d1f-d47c-4a3f-80cc-e8294a1fd2cd\") " pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:21.029645 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:21.029547    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:21.162747 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:21.162717    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pkxqp"]
May 21 12:45:21.165532 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:45:21.165504    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45412d1f_d47c_4a3f_80cc_e8294a1fd2cd.slice/crio-eb1c762a15bbe396ce14bd6d7c5c828481c713709ad7ef4c8e3d6b0d284f6e3b WatchSource:0}: Error finding container eb1c762a15bbe396ce14bd6d7c5c828481c713709ad7ef4c8e3d6b0d284f6e3b: Status 404 returned error can't find the container with id eb1c762a15bbe396ce14bd6d7c5c828481c713709ad7ef4c8e3d6b0d284f6e3b
May 21 12:45:21.309655 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:21.309568    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp" event={"ID":"45412d1f-d47c-4a3f-80cc-e8294a1fd2cd","Type":"ContainerStarted","Data":"eb1c762a15bbe396ce14bd6d7c5c828481c713709ad7ef4c8e3d6b0d284f6e3b"}
May 21 12:45:23.317972 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:23.317936    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp" event={"ID":"45412d1f-d47c-4a3f-80cc-e8294a1fd2cd","Type":"ContainerStarted","Data":"ec393fa76bb68c8cc2ac90982a38d713dfb5c3d84619862d37dd24e956a5ee3d"}
May 21 12:45:23.335076 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:23.335018    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp" podStartSLOduration=1.305812004 podStartE2EDuration="3.334999724s" podCreationTimestamp="2026-05-21 12:45:20 +0000 UTC" firstStartedPulling="2026-05-21 12:45:21.166885133 +0000 UTC m=+479.783589923" lastFinishedPulling="2026-05-21 12:45:23.196072849 +0000 UTC m=+481.812777643" observedRunningTime="2026-05-21 12:45:23.334010265 +0000 UTC m=+481.950715078" watchObservedRunningTime="2026-05-21 12:45:23.334999724 +0000 UTC m=+481.951704538"
May 21 12:45:31.030370 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:31.030331    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:31.030370 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:31.030372    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:31.051709 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:31.051685    2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:31.364889 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:31.364823    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pkxqp"
May 21 12:45:51.821385 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:51.821344    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gg56w"]
May 21 12:45:51.824786 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:51.824749    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:51.827298 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:51.827280    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b4l4q\""
May 21 12:45:51.836706 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:51.836676    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gg56w"]
May 21 12:45:51.921628 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:51.921590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479nw\" (UniqueName: \"kubernetes.io/projected/0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d-kube-api-access-479nw\") pod \"authorino-operator-657f44b778-gg56w\" (UID: \"0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d\") " pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:52.022709 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:52.022674    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-479nw\" (UniqueName: \"kubernetes.io/projected/0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d-kube-api-access-479nw\") pod \"authorino-operator-657f44b778-gg56w\" (UID: \"0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d\") " pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:52.037715 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:52.037687    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-479nw\" (UniqueName: \"kubernetes.io/projected/0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d-kube-api-access-479nw\") pod \"authorino-operator-657f44b778-gg56w\" (UID: \"0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d\") " pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:52.134504 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:52.134478    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:52.263958 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:52.261284    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-gg56w"]
May 21 12:45:52.265471 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:45:52.265436    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b4e88c9_d7e7_44b0_b2a3_ce1d63ab3f7d.slice/crio-eef80fb1234db19b567eba8e13468352d8b338fa8c77e91897779519c8574864 WatchSource:0}: Error finding container eef80fb1234db19b567eba8e13468352d8b338fa8c77e91897779519c8574864: Status 404 returned error can't find the container with id eef80fb1234db19b567eba8e13468352d8b338fa8c77e91897779519c8574864
May 21 12:45:52.408662 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:52.408569    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-gg56w" event={"ID":"0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d","Type":"ContainerStarted","Data":"eef80fb1234db19b567eba8e13468352d8b338fa8c77e91897779519c8574864"}
May 21 12:45:55.419634 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:55.419592    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-gg56w" event={"ID":"0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d","Type":"ContainerStarted","Data":"563825d46349a37240e0cb19d81c0f34730e4dec99d40b165c1da002e9e4d979"}
May 21 12:45:55.420022 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:55.419713    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:45:55.437135 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:45:55.437074    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-gg56w" podStartSLOduration=2.245334879 podStartE2EDuration="4.437054574s" podCreationTimestamp="2026-05-21 12:45:51 +0000 UTC" firstStartedPulling="2026-05-21 12:45:52.267291763 +0000 UTC m=+510.883996553" lastFinishedPulling="2026-05-21 12:45:54.459011458 +0000 UTC m=+513.075716248" observedRunningTime="2026-05-21 12:45:55.435933128 +0000 UTC m=+514.052637944" watchObservedRunningTime="2026-05-21 12:45:55.437054574 +0000 UTC m=+514.053759388"
May 21 12:46:06.424828 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:06.424799    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-gg56w"
May 21 12:46:08.446075 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.446035    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"]
May 21 12:46:08.452224 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.452203    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:08.455077 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.455054    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2l7p8\""
May 21 12:46:08.459255 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.459233    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"]
May 21 12:46:08.567279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.567235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrlkl\" (UniqueName: \"kubernetes.io/projected/8acdbdf1-2de3-4561-b3ab-1eaf3274653a-kube-api-access-rrlkl\") pod \"limitador-operator-controller-manager-85c4996f8c-qnwz4\" (UID: \"8acdbdf1-2de3-4561-b3ab-1eaf3274653a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:08.668612 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.668574    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrlkl\" (UniqueName: \"kubernetes.io/projected/8acdbdf1-2de3-4561-b3ab-1eaf3274653a-kube-api-access-rrlkl\") pod \"limitador-operator-controller-manager-85c4996f8c-qnwz4\" (UID: \"8acdbdf1-2de3-4561-b3ab-1eaf3274653a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:08.677761 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.677735    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrlkl\" (UniqueName: \"kubernetes.io/projected/8acdbdf1-2de3-4561-b3ab-1eaf3274653a-kube-api-access-rrlkl\") pod \"limitador-operator-controller-manager-85c4996f8c-qnwz4\" (UID: \"8acdbdf1-2de3-4561-b3ab-1eaf3274653a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:08.762655 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.762574    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:08.897749 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:08.897580    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"]
May 21 12:46:08.900576 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:46:08.900550    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acdbdf1_2de3_4561_b3ab_1eaf3274653a.slice/crio-29ca9a28bdd44ec8d7502c1351c6ab62961b32bf7f3e6ab49d1eeaae1e272401 WatchSource:0}: Error finding container 29ca9a28bdd44ec8d7502c1351c6ab62961b32bf7f3e6ab49d1eeaae1e272401: Status 404 returned error can't find the container with id 29ca9a28bdd44ec8d7502c1351c6ab62961b32bf7f3e6ab49d1eeaae1e272401
May 21 12:46:09.462333 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:09.462270    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4" event={"ID":"8acdbdf1-2de3-4561-b3ab-1eaf3274653a","Type":"ContainerStarted","Data":"29ca9a28bdd44ec8d7502c1351c6ab62961b32bf7f3e6ab49d1eeaae1e272401"}
May 21 12:46:10.469084 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:10.469041    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4" event={"ID":"8acdbdf1-2de3-4561-b3ab-1eaf3274653a","Type":"ContainerStarted","Data":"56b52a6d0f7e62cdabfa4110c4e28fda29d20acf852afdb0fef2f6ed15d1feca"}
May 21 12:46:10.469468 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:10.469168    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:46:10.485998 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:10.485945    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4" podStartSLOduration=1.302938167 podStartE2EDuration="2.485929953s" podCreationTimestamp="2026-05-21 12:46:08 +0000 UTC" firstStartedPulling="2026-05-21 12:46:08.902904322 +0000 UTC m=+527.519609113" lastFinishedPulling="2026-05-21 12:46:10.085896105 +0000 UTC m=+528.702600899" observedRunningTime="2026-05-21 12:46:10.484067482 +0000 UTC m=+529.100772296" watchObservedRunningTime="2026-05-21 12:46:10.485929953 +0000 UTC m=+529.102634766"
May 21 12:46:21.474986 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:46:21.474958    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qnwz4"
May 21 12:47:14.985827 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:14.985791    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:14.988830 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:14.988812    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:14.992052 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:14.992027    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z4jtm\""
May 21 12:47:14.992813 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:14.992800    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 12:47:15.008535 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.008489    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:15.086038 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.085999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4rp\" (UniqueName: \"kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp\") pod \"maas-controller-68fb5d86bc-6lmp8\" (UID: \"6e96c2e8-47f5-422b-b068-052ccf9c9ae3\") " pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:15.170794 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.170737    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:15.173928 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.173912    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:15.187260 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.187234    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4rp\" (UniqueName: \"kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp\") pod \"maas-controller-68fb5d86bc-6lmp8\" (UID: \"6e96c2e8-47f5-422b-b068-052ccf9c9ae3\") " pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:15.196614 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.196581    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:15.202635 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.202611    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4rp\" (UniqueName: \"kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp\") pod \"maas-controller-68fb5d86bc-6lmp8\" (UID: \"6e96c2e8-47f5-422b-b068-052ccf9c9ae3\") " pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:15.288493 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.288393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htscp\" (UniqueName: \"kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp\") pod \"maas-controller-7c9d7cb6f6-bqhm6\" (UID: \"b7312d05-c919-4b60-a79c-acbcf356ceb3\") " pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:15.298323 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.298295    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:15.328220 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.328186    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:15.366532 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.366497    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:15.370732 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.370706    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:15.390083 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.389824    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htscp\" (UniqueName: \"kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp\") pod \"maas-controller-7c9d7cb6f6-bqhm6\" (UID: \"b7312d05-c919-4b60-a79c-acbcf356ceb3\") " pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:15.392918 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.392893    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:15.402121 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.402042    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htscp\" (UniqueName: \"kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp\") pod \"maas-controller-7c9d7cb6f6-bqhm6\" (UID: \"b7312d05-c919-4b60-a79c-acbcf356ceb3\") " pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:15.434476 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.434432    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:15.437079 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:47:15.437053    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e96c2e8_47f5_422b_b068_052ccf9c9ae3.slice/crio-fce48f12d6dde5d4002e9c57c97b79f0ee8ed2640084a719cae158a514778753 WatchSource:0}: Error finding container fce48f12d6dde5d4002e9c57c97b79f0ee8ed2640084a719cae158a514778753: Status 404 returned error can't find the container with id fce48f12d6dde5d4002e9c57c97b79f0ee8ed2640084a719cae158a514778753
May 21 12:47:15.484279 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.484237    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:15.491285 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.491255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwhl\" (UniqueName: \"kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl\") pod \"maas-controller-79d6db75bb-7s9pq\" (UID: \"92b9c0d5-d7d6-42af-b838-15698d6d2feb\") " pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:15.591980 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.591946    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwhl\" (UniqueName: \"kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl\") pod \"maas-controller-79d6db75bb-7s9pq\" (UID: \"92b9c0d5-d7d6-42af-b838-15698d6d2feb\") " pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:15.600713 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.600691    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwhl\" (UniqueName: \"kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl\") pod \"maas-controller-79d6db75bb-7s9pq\" (UID: \"92b9c0d5-d7d6-42af-b838-15698d6d2feb\") " pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:15.608329 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.608304    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:15.612282 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:47:15.612186    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7312d05_c919_4b60_a79c_acbcf356ceb3.slice/crio-a9a36cfa31479a60224a003508ed5ef11e024f8c5cf1959f8a84bfd7c28c4dd0 WatchSource:0}: Error finding container a9a36cfa31479a60224a003508ed5ef11e024f8c5cf1959f8a84bfd7c28c4dd0: Status 404 returned error can't find the container with id a9a36cfa31479a60224a003508ed5ef11e024f8c5cf1959f8a84bfd7c28c4dd0
May 21 12:47:15.674073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.674043    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" event={"ID":"b7312d05-c919-4b60-a79c-acbcf356ceb3","Type":"ContainerStarted","Data":"a9a36cfa31479a60224a003508ed5ef11e024f8c5cf1959f8a84bfd7c28c4dd0"}
May 21 12:47:15.675102 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.675074    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" event={"ID":"6e96c2e8-47f5-422b-b068-052ccf9c9ae3","Type":"ContainerStarted","Data":"fce48f12d6dde5d4002e9c57c97b79f0ee8ed2640084a719cae158a514778753"}
May 21 12:47:15.683003 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.682982    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:15.806456 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:15.806427    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:15.809765 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:47:15.809707    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b9c0d5_d7d6_42af_b838_15698d6d2feb.slice/crio-a3ceea458ed7e2026a9108f906cafabd7278a8867e275f5c085073e4c5012ee9 WatchSource:0}: Error finding container a3ceea458ed7e2026a9108f906cafabd7278a8867e275f5c085073e4c5012ee9: Status 404 returned error can't find the container with id a3ceea458ed7e2026a9108f906cafabd7278a8867e275f5c085073e4c5012ee9
May 21 12:47:16.685284 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:16.685222    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" event={"ID":"92b9c0d5-d7d6-42af-b838-15698d6d2feb","Type":"ContainerStarted","Data":"a3ceea458ed7e2026a9108f906cafabd7278a8867e275f5c085073e4c5012ee9"}
May 21 12:47:19.696311 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.696272    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" event={"ID":"b7312d05-c919-4b60-a79c-acbcf356ceb3","Type":"ContainerStarted","Data":"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"}
May 21 12:47:19.696796 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.696502    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:19.697580 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.697561    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" event={"ID":"6e96c2e8-47f5-422b-b068-052ccf9c9ae3","Type":"ContainerStarted","Data":"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"}
May 21 12:47:19.697667 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.697628    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:19.697667 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.697624    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" podUID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" containerName="manager" containerID="cri-o://672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca" gracePeriod=30
May 21 12:47:19.698938 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.698915    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" event={"ID":"92b9c0d5-d7d6-42af-b838-15698d6d2feb","Type":"ContainerStarted","Data":"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"}
May 21 12:47:19.699022 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.698953    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:19.726465 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.726420    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" podStartSLOduration=1.432541638 podStartE2EDuration="4.726406021s" podCreationTimestamp="2026-05-21 12:47:15 +0000 UTC" firstStartedPulling="2026-05-21 12:47:15.613538636 +0000 UTC m=+594.230243428" lastFinishedPulling="2026-05-21 12:47:18.907403017 +0000 UTC m=+597.524107811" observedRunningTime="2026-05-21 12:47:19.723899633 +0000 UTC m=+598.340604442" watchObservedRunningTime="2026-05-21 12:47:19.726406021 +0000 UTC m=+598.343110833"
May 21 12:47:19.785090 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.785032    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" podStartSLOduration=1.679184723 podStartE2EDuration="4.785015768s" podCreationTimestamp="2026-05-21 12:47:15 +0000 UTC" firstStartedPulling="2026-05-21 12:47:15.81098834 +0000 UTC m=+594.427693131" lastFinishedPulling="2026-05-21 12:47:18.916819385 +0000 UTC m=+597.533524176" observedRunningTime="2026-05-21 12:47:19.782528974 +0000 UTC m=+598.399233787" watchObservedRunningTime="2026-05-21 12:47:19.785015768 +0000 UTC m=+598.401720580"
May 21 12:47:19.826237 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.826188    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" podStartSLOduration=2.357276297 podStartE2EDuration="5.826171804s" podCreationTimestamp="2026-05-21 12:47:14 +0000 UTC" firstStartedPulling="2026-05-21 12:47:15.438430522 +0000 UTC m=+594.055135326" lastFinishedPulling="2026-05-21 12:47:18.907326025 +0000 UTC m=+597.524030833" observedRunningTime="2026-05-21 12:47:19.824162741 +0000 UTC m=+598.440867567" watchObservedRunningTime="2026-05-21 12:47:19.826171804 +0000 UTC m=+598.442876618"
May 21 12:47:19.941234 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:19.941211    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:20.033500 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.033411    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps4rp\" (UniqueName: \"kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp\") pod \"6e96c2e8-47f5-422b-b068-052ccf9c9ae3\" (UID: \"6e96c2e8-47f5-422b-b068-052ccf9c9ae3\") "
May 21 12:47:20.035571 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.035544    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp" (OuterVolumeSpecName: "kube-api-access-ps4rp") pod "6e96c2e8-47f5-422b-b068-052ccf9c9ae3" (UID: "6e96c2e8-47f5-422b-b068-052ccf9c9ae3"). InnerVolumeSpecName "kube-api-access-ps4rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:47:20.134502 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.134468    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps4rp\" (UniqueName: \"kubernetes.io/projected/6e96c2e8-47f5-422b-b068-052ccf9c9ae3-kube-api-access-ps4rp\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:47:20.702706 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.702669    2567 generic.go:358] "Generic (PLEG): container finished" podID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" containerID="672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca" exitCode=0
May 21 12:47:20.703201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.702745    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8"
May 21 12:47:20.703201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.702761    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" event={"ID":"6e96c2e8-47f5-422b-b068-052ccf9c9ae3","Type":"ContainerDied","Data":"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"}
May 21 12:47:20.703201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.702833    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68fb5d86bc-6lmp8" event={"ID":"6e96c2e8-47f5-422b-b068-052ccf9c9ae3","Type":"ContainerDied","Data":"fce48f12d6dde5d4002e9c57c97b79f0ee8ed2640084a719cae158a514778753"}
May 21 12:47:20.703201 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.702859    2567 scope.go:117] "RemoveContainer" containerID="672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"
May 21 12:47:20.711617 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.711598    2567 scope.go:117] "RemoveContainer" containerID="672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"
May 21 12:47:20.711914 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:47:20.711893    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca\": container with ID starting with 672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca not found: ID does not exist" containerID="672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"
May 21 12:47:20.711990 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.711925    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca"} err="failed to get container status \"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca\": rpc error: code = NotFound desc = could not find container \"672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca\": container with ID starting with 672b1b889ccad939c9b2bd7bbc3c6c112506ef90c8d413e09e4ae85d432478ca not found: ID does not exist"
May 21 12:47:20.724447 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.724423    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:20.728692 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:20.728667    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-6lmp8"]
May 21 12:47:22.013457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:22.013426    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" path="/var/lib/kubelet/pods/6e96c2e8-47f5-422b-b068-052ccf9c9ae3/volumes"
May 21 12:47:30.709186 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:30.709152    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:30.709564 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:30.709208    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:30.779912 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:30.779874    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:30.780126 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:30.780087    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" podUID="b7312d05-c919-4b60-a79c-acbcf356ceb3" containerName="manager" containerID="cri-o://063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d" gracePeriod=30
May 21 12:47:31.004503 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.004475    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:47:31.004848 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.004831    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" containerName="manager"
May 21 12:47:31.004916 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.004850    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" containerName="manager"
May 21 12:47:31.004916 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.004907    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e96c2e8-47f5-422b-b068-052ccf9c9ae3" containerName="manager"
May 21 12:47:31.014152 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.014129    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:31.019160 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.019140    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:31.023724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.023687    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:47:31.025722 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.025702    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htscp\" (UniqueName: \"kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp\") pod \"b7312d05-c919-4b60-a79c-acbcf356ceb3\" (UID: \"b7312d05-c919-4b60-a79c-acbcf356ceb3\") "
May 21 12:47:31.025820 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.025807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvjp\" (UniqueName: \"kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp\") pod \"maas-controller-54cf999744-5xngd\" (UID: \"d51de5bf-573e-49bc-be15-ab53aa5f2469\") " pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:31.027978 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.027952    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp" (OuterVolumeSpecName: "kube-api-access-htscp") pod "b7312d05-c919-4b60-a79c-acbcf356ceb3" (UID: "b7312d05-c919-4b60-a79c-acbcf356ceb3"). InnerVolumeSpecName "kube-api-access-htscp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:47:31.126591 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.126547    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvjp\" (UniqueName: \"kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp\") pod \"maas-controller-54cf999744-5xngd\" (UID: \"d51de5bf-573e-49bc-be15-ab53aa5f2469\") " pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:31.126757 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.126612    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htscp\" (UniqueName: \"kubernetes.io/projected/b7312d05-c919-4b60-a79c-acbcf356ceb3-kube-api-access-htscp\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:47:31.135927 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.135904    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvjp\" (UniqueName: \"kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp\") pod \"maas-controller-54cf999744-5xngd\" (UID: \"d51de5bf-573e-49bc-be15-ab53aa5f2469\") " pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:31.328458 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.328377    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:31.461124 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.461100    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:47:31.463162 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:47:31.463135    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51de5bf_573e_49bc_be15_ab53aa5f2469.slice/crio-425e6e989fec45f395a39d33ad28aa5a0896c47a43c132ef4f6ee908192fc83d WatchSource:0}: Error finding container 425e6e989fec45f395a39d33ad28aa5a0896c47a43c132ef4f6ee908192fc83d: Status 404 returned error can't find the container with id 425e6e989fec45f395a39d33ad28aa5a0896c47a43c132ef4f6ee908192fc83d
May 21 12:47:31.745342 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.745312    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-5xngd" event={"ID":"d51de5bf-573e-49bc-be15-ab53aa5f2469","Type":"ContainerStarted","Data":"425e6e989fec45f395a39d33ad28aa5a0896c47a43c132ef4f6ee908192fc83d"}
May 21 12:47:31.746322 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.746297    2567 generic.go:358] "Generic (PLEG): container finished" podID="b7312d05-c919-4b60-a79c-acbcf356ceb3" containerID="063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d" exitCode=0
May 21 12:47:31.746387 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.746357    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6"
May 21 12:47:31.746387 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.746375    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" event={"ID":"b7312d05-c919-4b60-a79c-acbcf356ceb3","Type":"ContainerDied","Data":"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"}
May 21 12:47:31.746457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.746401    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9d7cb6f6-bqhm6" event={"ID":"b7312d05-c919-4b60-a79c-acbcf356ceb3","Type":"ContainerDied","Data":"a9a36cfa31479a60224a003508ed5ef11e024f8c5cf1959f8a84bfd7c28c4dd0"}
May 21 12:47:31.746457 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.746415    2567 scope.go:117] "RemoveContainer" containerID="063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"
May 21 12:47:31.754052 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.754008    2567 scope.go:117] "RemoveContainer" containerID="063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"
May 21 12:47:31.754396 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:47:31.754365    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d\": container with ID starting with 063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d not found: ID does not exist" containerID="063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"
May 21 12:47:31.754472 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.754403    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d"} err="failed to get container status \"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d\": rpc error: code = NotFound desc = could not find container \"063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d\": container with ID starting with 063b39764e62f2d94f4c473d53626dab48e76e792e2669c06b081bbbd4119c3d not found: ID does not exist"
May 21 12:47:31.770928 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.770904    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:31.778713 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:31.778688    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c9d7cb6f6-bqhm6"]
May 21 12:47:32.013863 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:32.013758    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7312d05-c919-4b60-a79c-acbcf356ceb3" path="/var/lib/kubelet/pods/b7312d05-c919-4b60-a79c-acbcf356ceb3/volumes"
May 21 12:47:32.752290 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:32.752256    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-5xngd" event={"ID":"d51de5bf-573e-49bc-be15-ab53aa5f2469","Type":"ContainerStarted","Data":"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"}
May 21 12:47:32.752654 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:32.752429    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:32.772062 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:32.772011    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54cf999744-5xngd" podStartSLOduration=2.388615231 podStartE2EDuration="2.771996354s" podCreationTimestamp="2026-05-21 12:47:30 +0000 UTC" firstStartedPulling="2026-05-21 12:47:31.464429348 +0000 UTC m=+610.081134139" lastFinishedPulling="2026-05-21 12:47:31.847810469 +0000 UTC m=+610.464515262" observedRunningTime="2026-05-21 12:47:32.770286165 +0000 UTC m=+611.386991016" watchObservedRunningTime="2026-05-21 12:47:32.771996354 +0000 UTC m=+611.388701166"
May 21 12:47:43.762020 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:43.761947    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:47:43.820761 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:43.820730    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:43.821148 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:43.820962    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" podUID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" containerName="manager" containerID="cri-o://faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e" gracePeriod=30
May 21 12:47:44.062886 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.062863    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:44.131229 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.131196    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nwhl\" (UniqueName: \"kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl\") pod \"92b9c0d5-d7d6-42af-b838-15698d6d2feb\" (UID: \"92b9c0d5-d7d6-42af-b838-15698d6d2feb\") "
May 21 12:47:44.133232 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.133211    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl" (OuterVolumeSpecName: "kube-api-access-2nwhl") pod "92b9c0d5-d7d6-42af-b838-15698d6d2feb" (UID: "92b9c0d5-d7d6-42af-b838-15698d6d2feb"). InnerVolumeSpecName "kube-api-access-2nwhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:47:44.231990 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.231961    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nwhl\" (UniqueName: \"kubernetes.io/projected/92b9c0d5-d7d6-42af-b838-15698d6d2feb-kube-api-access-2nwhl\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:47:44.794835 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.794797    2567 generic.go:358] "Generic (PLEG): container finished" podID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" containerID="faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e" exitCode=0
May 21 12:47:44.795257 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.794845    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" event={"ID":"92b9c0d5-d7d6-42af-b838-15698d6d2feb","Type":"ContainerDied","Data":"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"}
May 21 12:47:44.795257 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.794854    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79d6db75bb-7s9pq"
May 21 12:47:44.795257 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.794873    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79d6db75bb-7s9pq" event={"ID":"92b9c0d5-d7d6-42af-b838-15698d6d2feb","Type":"ContainerDied","Data":"a3ceea458ed7e2026a9108f906cafabd7278a8867e275f5c085073e4c5012ee9"}
May 21 12:47:44.795257 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.794891    2567 scope.go:117] "RemoveContainer" containerID="faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"
May 21 12:47:44.803613 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.803565    2567 scope.go:117] "RemoveContainer" containerID="faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"
May 21 12:47:44.803920 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:47:44.803895    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e\": container with ID starting with faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e not found: ID does not exist" containerID="faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"
May 21 12:47:44.804007 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.803932    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e"} err="failed to get container status \"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e\": rpc error: code = NotFound desc = could not find container \"faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e\": container with ID starting with faaefcfc2873d52866b8ff39d4335acb0b3308950eb618d0601c0959fef82b3e not found: ID does not exist"
May 21 12:47:44.816601 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.816579    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:44.818475 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:44.818455    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79d6db75bb-7s9pq"]
May 21 12:47:46.013066 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:46.013031    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" path="/var/lib/kubelet/pods/92b9c0d5-d7d6-42af-b838-15698d6d2feb/volumes"
May 21 12:47:49.669200 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669162    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"]
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669463    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" containerName="manager"
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669473    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" containerName="manager"
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669482    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7312d05-c919-4b60-a79c-acbcf356ceb3" containerName="manager"
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669488    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7312d05-c919-4b60-a79c-acbcf356ceb3" containerName="manager"
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669544    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="92b9c0d5-d7d6-42af-b838-15698d6d2feb" containerName="manager"
May 21 12:47:49.669724 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.669554    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7312d05-c919-4b60-a79c-acbcf356ceb3" containerName="manager"
May 21 12:47:49.673819 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.673800    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:49.678266 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.678233    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sdbsj\""
May 21 12:47:49.678398 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.678286    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 12:47:49.687970 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.687947    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"]
May 21 12:47:49.776871 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.776831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2n2x\" (UniqueName: \"kubernetes.io/projected/8345390a-7f71-4afb-9cc1-5f66972fee17-kube-api-access-q2n2x\") pod \"payload-processing-58b6c8fdc7-t7jsq\" (UID: \"8345390a-7f71-4afb-9cc1-5f66972fee17\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:49.878132 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.878097    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2n2x\" (UniqueName: \"kubernetes.io/projected/8345390a-7f71-4afb-9cc1-5f66972fee17-kube-api-access-q2n2x\") pod \"payload-processing-58b6c8fdc7-t7jsq\" (UID: \"8345390a-7f71-4afb-9cc1-5f66972fee17\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:49.886947 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.886920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2n2x\" (UniqueName: \"kubernetes.io/projected/8345390a-7f71-4afb-9cc1-5f66972fee17-kube-api-access-q2n2x\") pod \"payload-processing-58b6c8fdc7-t7jsq\" (UID: \"8345390a-7f71-4afb-9cc1-5f66972fee17\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:49.983931 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:49.983848    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:50.109365 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:50.109330    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"]
May 21 12:47:50.113168 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:47:50.113136    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8345390a_7f71_4afb_9cc1_5f66972fee17.slice/crio-9d49ca423f6d39c3d1ff6a4fe9173becba458201b66f011e425e0e8be65d1f34 WatchSource:0}: Error finding container 9d49ca423f6d39c3d1ff6a4fe9173becba458201b66f011e425e0e8be65d1f34: Status 404 returned error can't find the container with id 9d49ca423f6d39c3d1ff6a4fe9173becba458201b66f011e425e0e8be65d1f34
May 21 12:47:50.822425 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:50.822392    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq" event={"ID":"8345390a-7f71-4afb-9cc1-5f66972fee17","Type":"ContainerStarted","Data":"9d49ca423f6d39c3d1ff6a4fe9173becba458201b66f011e425e0e8be65d1f34"}
May 21 12:47:52.833433 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:52.833396    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq" event={"ID":"8345390a-7f71-4afb-9cc1-5f66972fee17","Type":"ContainerStarted","Data":"6b84d69a0cdf73e30303592acf6e2a16d0f51baffb82ffe3ec2771432f7818f9"}
May 21 12:47:52.833954 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:52.833504    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:47:52.852415 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:47:52.852363    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq" podStartSLOduration=1.8048305070000001 podStartE2EDuration="3.852346685s" podCreationTimestamp="2026-05-21 12:47:49 +0000 UTC" firstStartedPulling="2026-05-21 12:47:50.115092132 +0000 UTC m=+628.731796924" lastFinishedPulling="2026-05-21 12:47:52.162608309 +0000 UTC m=+630.779313102" observedRunningTime="2026-05-21 12:47:52.850514746 +0000 UTC m=+631.467219560" watchObservedRunningTime="2026-05-21 12:47:52.852346685 +0000 UTC m=+631.469051501"
May 21 12:48:03.838013 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:03.837972    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-t7jsq"
May 21 12:48:17.598282 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.598246    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"]
May 21 12:48:17.601538 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.601520    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.605981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.605954    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 12:48:17.606825 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.606803    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 21 12:48:17.607132 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.607112    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9lqrk\""
May 21 12:48:17.608364 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.608340    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 12:48:17.618893 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.618864    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"]
May 21 12:48:17.709858 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.709821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.710034 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.709872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.710034 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.709977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhm4q\" (UniqueName: \"kubernetes.io/projected/713b183b-64b7-4929-98ff-05d65f94ca2e-kube-api-access-zhm4q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.710109 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.710031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.710109 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.710058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.710109 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.710080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b183b-64b7-4929-98ff-05d65f94ca2e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810463 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810427    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810657 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810598    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhm4q\" (UniqueName: \"kubernetes.io/projected/713b183b-64b7-4929-98ff-05d65f94ca2e-kube-api-access-zhm4q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810727 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810664    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810727 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810691    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810727 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810717    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b183b-64b7-4929-98ff-05d65f94ca2e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810923 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810742    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.810981 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.810952    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.811143 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.811127    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.811208 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.811162    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.812995 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.812977    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/713b183b-64b7-4929-98ff-05d65f94ca2e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.813402 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.813384    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/713b183b-64b7-4929-98ff-05d65f94ca2e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.832264 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.832236    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhm4q\" (UniqueName: \"kubernetes.io/projected/713b183b-64b7-4929-98ff-05d65f94ca2e-kube-api-access-zhm4q\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-4xf5v\" (UID: \"713b183b-64b7-4929-98ff-05d65f94ca2e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:17.916304 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:17.916273    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:18.063551 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:18.063523    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"]
May 21 12:48:18.065195 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:48:18.065157    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713b183b_64b7_4929_98ff_05d65f94ca2e.slice/crio-ba40f968dd6551bc27a6cd636a9f2334747bcc9dcb00a764eb7768eec43a0563 WatchSource:0}: Error finding container ba40f968dd6551bc27a6cd636a9f2334747bcc9dcb00a764eb7768eec43a0563: Status 404 returned error can't find the container with id ba40f968dd6551bc27a6cd636a9f2334747bcc9dcb00a764eb7768eec43a0563
May 21 12:48:18.915141 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:18.915109    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v" event={"ID":"713b183b-64b7-4929-98ff-05d65f94ca2e","Type":"ContainerStarted","Data":"ba40f968dd6551bc27a6cd636a9f2334747bcc9dcb00a764eb7768eec43a0563"}
May 21 12:48:24.940139 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:24.940102    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v" event={"ID":"713b183b-64b7-4929-98ff-05d65f94ca2e","Type":"ContainerStarted","Data":"0f1b134c6546825e42701e635690a1d1532631054a9d5fbecdc68413250aa1cc"}
May 21 12:48:30.960875 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:30.960837    2567 generic.go:358] "Generic (PLEG): container finished" podID="713b183b-64b7-4929-98ff-05d65f94ca2e" containerID="0f1b134c6546825e42701e635690a1d1532631054a9d5fbecdc68413250aa1cc" exitCode=0
May 21 12:48:30.961243 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:30.960911    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v" event={"ID":"713b183b-64b7-4929-98ff-05d65f94ca2e","Type":"ContainerDied","Data":"0f1b134c6546825e42701e635690a1d1532631054a9d5fbecdc68413250aa1cc"}
May 21 12:48:32.969671 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:32.969638    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v" event={"ID":"713b183b-64b7-4929-98ff-05d65f94ca2e","Type":"ContainerStarted","Data":"d884c17b14d1dc965aa1c4475c55d549b19ad66ed95fb196268fb8fa18832fed"}
May 21 12:48:32.970064 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:32.969839    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:48:33.007488 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:33.007440    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v" podStartSLOduration=1.836035206 podStartE2EDuration="16.007423781s" podCreationTimestamp="2026-05-21 12:48:17 +0000 UTC" firstStartedPulling="2026-05-21 12:48:18.067166125 +0000 UTC m=+656.683870915" lastFinishedPulling="2026-05-21 12:48:32.238554699 +0000 UTC m=+670.855259490" observedRunningTime="2026-05-21 12:48:33.00422998 +0000 UTC m=+671.620934793" watchObservedRunningTime="2026-05-21 12:48:33.007423781 +0000 UTC m=+671.624128594"
May 21 12:48:43.986066 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:48:43.986036    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-4xf5v"
May 21 12:49:10.467025 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.466942    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"]
May 21 12:49:10.502500 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.502470    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"]
May 21 12:49:10.502654 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.502593    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.505853 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.505831    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 12:49:10.657643 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.657607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.657859 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.657664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.657859 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.657733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.657990 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.657926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw8cp\" (UniqueName: \"kubernetes.io/projected/08566252-4525-4771-9d9e-b12ae7c36ced-kube-api-access-rw8cp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.657990 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.657983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.658088 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.658004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08566252-4525-4771-9d9e-b12ae7c36ced-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.758910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.758825    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.758910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.758867    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.758910 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.758891    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759158 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759008    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rw8cp\" (UniqueName: \"kubernetes.io/projected/08566252-4525-4771-9d9e-b12ae7c36ced-kube-api-access-rw8cp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759158 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759047    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759158 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759066    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08566252-4525-4771-9d9e-b12ae7c36ced-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759298 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759228    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759349 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759325    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.759556 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.759533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.761161 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.761140    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08566252-4525-4771-9d9e-b12ae7c36ced-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.761418 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.761401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08566252-4525-4771-9d9e-b12ae7c36ced-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.774532 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.774508    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw8cp\" (UniqueName: \"kubernetes.io/projected/08566252-4525-4771-9d9e-b12ae7c36ced-kube-api-access-rw8cp\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87\" (UID: \"08566252-4525-4771-9d9e-b12ae7c36ced\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.813314 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.813283    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:10.966580 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.962414    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"]
May 21 12:49:10.969495 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:10.969471    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 12:49:11.094991 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:11.094951    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87" event={"ID":"08566252-4525-4771-9d9e-b12ae7c36ced","Type":"ContainerStarted","Data":"89db8999b8749a4a7812d7bdcd6514e1019551ffeef57667c58b5d1fbe5bd03c"}
May 21 12:49:11.094991 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:11.094993    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87" event={"ID":"08566252-4525-4771-9d9e-b12ae7c36ced","Type":"ContainerStarted","Data":"6dc014ddea9399a615072c7f92bffd100aa7b544a5385c25defe91e2760d39a0"}
May 21 12:49:17.114913 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:17.114828    2567 generic.go:358] "Generic (PLEG): container finished" podID="08566252-4525-4771-9d9e-b12ae7c36ced" containerID="89db8999b8749a4a7812d7bdcd6514e1019551ffeef57667c58b5d1fbe5bd03c" exitCode=0
May 21 12:49:17.114913 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:17.114881    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87" event={"ID":"08566252-4525-4771-9d9e-b12ae7c36ced","Type":"ContainerDied","Data":"89db8999b8749a4a7812d7bdcd6514e1019551ffeef57667c58b5d1fbe5bd03c"}
May 21 12:49:18.119332 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:18.119295    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87" event={"ID":"08566252-4525-4771-9d9e-b12ae7c36ced","Type":"ContainerStarted","Data":"6ef9b111986429b66e3b4c509605cc6ae326ef9a61e17426f0bfeb56700d4f8a"}
May 21 12:49:18.119708 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:18.119506    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:49:18.159150 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:18.159090    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87" podStartSLOduration=7.90570732 podStartE2EDuration="8.159070057s" podCreationTimestamp="2026-05-21 12:49:10 +0000 UTC" firstStartedPulling="2026-05-21 12:49:17.115451904 +0000 UTC m=+715.732156695" lastFinishedPulling="2026-05-21 12:49:17.36881464 +0000 UTC m=+715.985519432" observedRunningTime="2026-05-21 12:49:18.154868112 +0000 UTC m=+716.771572925" watchObservedRunningTime="2026-05-21 12:49:18.159070057 +0000 UTC m=+716.775774872"
May 21 12:49:29.136600 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:49:29.136570    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87"
May 21 12:50:54.623109 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:54.623028    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:50:54.623606 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:54.623269    2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-54cf999744-5xngd" podUID="d51de5bf-573e-49bc-be15-ab53aa5f2469" containerName="manager" containerID="cri-o://235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1" gracePeriod=30
May 21 12:50:54.865163 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:54.865139    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:50:54.982130 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:54.982046    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qvjp\" (UniqueName: \"kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp\") pod \"d51de5bf-573e-49bc-be15-ab53aa5f2469\" (UID: \"d51de5bf-573e-49bc-be15-ab53aa5f2469\") "
May 21 12:50:54.984140 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:54.984111    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp" (OuterVolumeSpecName: "kube-api-access-4qvjp") pod "d51de5bf-573e-49bc-be15-ab53aa5f2469" (UID: "d51de5bf-573e-49bc-be15-ab53aa5f2469"). InnerVolumeSpecName "kube-api-access-4qvjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 12:50:55.083073 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.083025    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qvjp\" (UniqueName: \"kubernetes.io/projected/d51de5bf-573e-49bc-be15-ab53aa5f2469-kube-api-access-4qvjp\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 12:50:55.445311 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.445272    2567 generic.go:358] "Generic (PLEG): container finished" podID="d51de5bf-573e-49bc-be15-ab53aa5f2469" containerID="235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1" exitCode=0
May 21 12:50:55.445478 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.445334    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-5xngd" event={"ID":"d51de5bf-573e-49bc-be15-ab53aa5f2469","Type":"ContainerDied","Data":"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"}
May 21 12:50:55.445478 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.445340    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-5xngd"
May 21 12:50:55.445478 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.445369    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-5xngd" event={"ID":"d51de5bf-573e-49bc-be15-ab53aa5f2469","Type":"ContainerDied","Data":"425e6e989fec45f395a39d33ad28aa5a0896c47a43c132ef4f6ee908192fc83d"}
May 21 12:50:55.445478 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.445392    2567 scope.go:117] "RemoveContainer" containerID="235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"
May 21 12:50:55.453907 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.453884    2567 scope.go:117] "RemoveContainer" containerID="235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"
May 21 12:50:55.454203 ip-10-0-143-244 kubenswrapper[2567]: E0521 12:50:55.454173    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1\": container with ID starting with 235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1 not found: ID does not exist" containerID="235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"
May 21 12:50:55.454253 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.454218    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1"} err="failed to get container status \"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1\": rpc error: code = NotFound desc = could not find container \"235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1\": container with ID starting with 235ea741990e2ef659acab388361cc39365b2a6fcbf4db74a33f8c5e4b5d2ed1 not found: ID does not exist"
May 21 12:50:55.473267 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.473243    2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:50:55.477079 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:55.477055    2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54cf999744-5xngd"]
May 21 12:50:56.012955 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.012923    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51de5bf-573e-49bc-be15-ab53aa5f2469" path="/var/lib/kubelet/pods/d51de5bf-573e-49bc-be15-ab53aa5f2469/volumes"
May 21 12:50:56.333088 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.333016    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54cf999744-lf5gg"]
May 21 12:50:56.333325 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.333313    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51de5bf-573e-49bc-be15-ab53aa5f2469" containerName="manager"
May 21 12:50:56.333370 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.333327    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51de5bf-573e-49bc-be15-ab53aa5f2469" containerName="manager"
May 21 12:50:56.333403 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.333388    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="d51de5bf-573e-49bc-be15-ab53aa5f2469" containerName="manager"
May 21 12:50:56.336249 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.336234    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:56.340655 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.340638    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z4jtm\""
May 21 12:50:56.340720 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.340656    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 12:50:56.349119 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.349096    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cf999744-lf5gg"]
May 21 12:50:56.496355 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.496324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnstd\" (UniqueName: \"kubernetes.io/projected/a3d71897-e6d9-4522-98a0-1f904b077686-kube-api-access-vnstd\") pod \"maas-controller-54cf999744-lf5gg\" (UID: \"a3d71897-e6d9-4522-98a0-1f904b077686\") " pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:56.597752 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.597669    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnstd\" (UniqueName: \"kubernetes.io/projected/a3d71897-e6d9-4522-98a0-1f904b077686-kube-api-access-vnstd\") pod \"maas-controller-54cf999744-lf5gg\" (UID: \"a3d71897-e6d9-4522-98a0-1f904b077686\") " pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:56.608572 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.608532    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnstd\" (UniqueName: \"kubernetes.io/projected/a3d71897-e6d9-4522-98a0-1f904b077686-kube-api-access-vnstd\") pod \"maas-controller-54cf999744-lf5gg\" (UID: \"a3d71897-e6d9-4522-98a0-1f904b077686\") " pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:56.646209 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.646179    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:56.776094 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:56.776069    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54cf999744-lf5gg"]
May 21 12:50:56.778314 ip-10-0-143-244 kubenswrapper[2567]: W0521 12:50:56.778284    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d71897_e6d9_4522_98a0_1f904b077686.slice/crio-6cf27e8e9abc6fd1ad06a6c1ea7b265b9628d2ff1f5e7e233110c8b73949fd93 WatchSource:0}: Error finding container 6cf27e8e9abc6fd1ad06a6c1ea7b265b9628d2ff1f5e7e233110c8b73949fd93: Status 404 returned error can't find the container with id 6cf27e8e9abc6fd1ad06a6c1ea7b265b9628d2ff1f5e7e233110c8b73949fd93
May 21 12:50:57.453029 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:57.452938    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-lf5gg" event={"ID":"a3d71897-e6d9-4522-98a0-1f904b077686","Type":"ContainerStarted","Data":"8edf3b8834e421fb50882e011b48f30ef9a1b93f82d9d15962f9c44c95de5ea8"}
May 21 12:50:57.453029 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:57.452975    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54cf999744-lf5gg" event={"ID":"a3d71897-e6d9-4522-98a0-1f904b077686","Type":"ContainerStarted","Data":"6cf27e8e9abc6fd1ad06a6c1ea7b265b9628d2ff1f5e7e233110c8b73949fd93"}
May 21 12:50:57.453029 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:57.453004    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 12:50:57.476231 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:50:57.476186    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-54cf999744-lf5gg" podStartSLOduration=1.061426808 podStartE2EDuration="1.476172228s" podCreationTimestamp="2026-05-21 12:50:56 +0000 UTC" firstStartedPulling="2026-05-21 12:50:56.779988481 +0000 UTC m=+815.396693272" lastFinishedPulling="2026-05-21 12:50:57.194733898 +0000 UTC m=+815.811438692" observedRunningTime="2026-05-21 12:50:57.473296076 +0000 UTC m=+816.090000886" watchObservedRunningTime="2026-05-21 12:50:57.476172228 +0000 UTC m=+816.092877042"
May 21 12:51:08.462019 ip-10-0-143-244 kubenswrapper[2567]: I0521 12:51:08.461985    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54cf999744-lf5gg"
May 21 13:00:00.144658 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.144576    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29656140-6pbn4"]
May 21 13:00:00.151750 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.151725    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:00.154156 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.154133    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-knjrx\""
May 21 13:00:00.169350 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.169321    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656140-6pbn4"]
May 21 13:00:00.296896 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.296859    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn557\" (UniqueName: \"kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557\") pod \"maas-api-key-cleanup-29656140-6pbn4\" (UID: \"b90eb735-5fec-4c60-a174-63d81aa1597d\") " pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:00.398340 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.398245    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pn557\" (UniqueName: \"kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557\") pod \"maas-api-key-cleanup-29656140-6pbn4\" (UID: \"b90eb735-5fec-4c60-a174-63d81aa1597d\") " pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:00.407091 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.407067    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn557\" (UniqueName: \"kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557\") pod \"maas-api-key-cleanup-29656140-6pbn4\" (UID: \"b90eb735-5fec-4c60-a174-63d81aa1597d\") " pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:00.461550 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.461514    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:00.590493 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.590467    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29656140-6pbn4"]
May 21 13:00:00.593282 ip-10-0-143-244 kubenswrapper[2567]: W0521 13:00:00.593254    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90eb735_5fec_4c60_a174_63d81aa1597d.slice/crio-3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6 WatchSource:0}: Error finding container 3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6: Status 404 returned error can't find the container with id 3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6
May 21 13:00:00.595434 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:00.595418    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 13:00:01.256463 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:01.256429    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4" event={"ID":"b90eb735-5fec-4c60-a174-63d81aa1597d","Type":"ContainerStarted","Data":"3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6"}
May 21 13:00:06.274178 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:06.274143    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4" event={"ID":"b90eb735-5fec-4c60-a174-63d81aa1597d","Type":"ContainerStarted","Data":"9b48a9c0d9186350031b52bb099f6e2e35246d2d31a8298bc5a38918bd2b81c6"}
May 21 13:00:07.278919 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:07.278883    2567 generic.go:358] "Generic (PLEG): container finished" podID="b90eb735-5fec-4c60-a174-63d81aa1597d" containerID="9b48a9c0d9186350031b52bb099f6e2e35246d2d31a8298bc5a38918bd2b81c6" exitCode=0
May 21 13:00:07.279287 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:07.278938    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4" event={"ID":"b90eb735-5fec-4c60-a174-63d81aa1597d","Type":"ContainerDied","Data":"9b48a9c0d9186350031b52bb099f6e2e35246d2d31a8298bc5a38918bd2b81c6"}
May 21 13:00:08.410027 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:08.410002    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:00:08.567362 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:08.567272    2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn557\" (UniqueName: \"kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557\") pod \"b90eb735-5fec-4c60-a174-63d81aa1597d\" (UID: \"b90eb735-5fec-4c60-a174-63d81aa1597d\") "
May 21 13:00:08.569314 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:08.569282    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557" (OuterVolumeSpecName: "kube-api-access-pn557") pod "b90eb735-5fec-4c60-a174-63d81aa1597d" (UID: "b90eb735-5fec-4c60-a174-63d81aa1597d"). InnerVolumeSpecName "kube-api-access-pn557". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 13:00:08.668507 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:08.668462    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn557\" (UniqueName: \"kubernetes.io/projected/b90eb735-5fec-4c60-a174-63d81aa1597d-kube-api-access-pn557\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
May 21 13:00:09.287847 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:09.287808    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4" event={"ID":"b90eb735-5fec-4c60-a174-63d81aa1597d","Type":"ContainerDied","Data":"3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6"}
May 21 13:00:09.287847 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:09.287849    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3058e0eb075e6d94e0b80d187e5d5436bcc65988f69016ce97443a986de8f4c6"
May 21 13:00:09.288060 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:00:09.287870    2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29656140-6pbn4"
May 21 13:12:12.141043 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:12.140962    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7gxmj_dce100c1-c814-43b9-bd16-f7592638fe9c/manager/0.log"
May 21 13:12:12.383368 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:12.383339    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656140-6pbn4_b90eb735-5fec-4c60-a174-63d81aa1597d/cleanup/0.log"
May 21 13:12:12.507869 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:12.507794    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54cf999744-lf5gg_a3d71897-e6d9-4522-98a0-1f904b077686/manager/0.log"
May 21 13:12:12.645340 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:12.645306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nhhnw_0e1ef120-0307-4475-a327-deee2f13b53c/manager/2.log"
May 21 13:12:12.900989 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:12.900956    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84556f689c-q5f86_ad5ef8a0-35a3-419d-bd96-594fec79664c/manager/0.log"
May 21 13:12:14.584236 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:14.584205    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-gg56w_0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d/manager/0.log"
May 21 13:12:14.932571 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:14.932538    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pkxqp_45412d1f-d47c-4a3f-80cc-e8294a1fd2cd/registry-server/0.log"
May 21 13:12:15.292736 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:15.292657    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qnwz4_8acdbdf1-2de3-4561-b3ab-1eaf3274653a/manager/0.log"
May 21 13:12:15.783517 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:15.783486    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-fjrcm_26807820-21a8-42a4-beb4-b114e1c610be/discovery/0.log"
May 21 13:12:16.010723 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:16.010692    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7485fd7bf5-mrp89_aff90ed5-10c7-4967-b773-16766eb079c7/kube-auth-proxy/0.log"
May 21 13:12:16.246440 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:16.246322    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-t7jsq_8345390a-7f71-4afb-9cc1-5f66972fee17/payload-processing/0.log"
May 21 13:12:16.962436 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:16.962404    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-4xf5v_713b183b-64b7-4929-98ff-05d65f94ca2e/storage-initializer/0.log"
May 21 13:12:16.972391 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:16.972364    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-4xf5v_713b183b-64b7-4929-98ff-05d65f94ca2e/main/0.log"
May 21 13:12:17.221491 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:17.221411    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87_08566252-4525-4771-9d9e-b12ae7c36ced/storage-initializer/0.log"
May 21 13:12:17.229760 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:17.229709    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qfz87_08566252-4525-4771-9d9e-b12ae7c36ced/main/0.log"
May 21 13:12:24.462234 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:24.462178    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gvv8_de488ca8-1c90-428e-ad26-51f30dcf82a7/global-pull-secret-syncer/0.log"
May 21 13:12:24.666054 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:24.665998    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tqrm5_2d177b48-deca-4753-8144-87f9b007f729/konnectivity-agent/0.log"
May 21 13:12:24.831021 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:24.830911    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-244.ec2.internal_567053fa0164152f4a9f0b75552251c3/haproxy/0.log"
May 21 13:12:29.067479 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:29.067431    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-gg56w_0b4e88c9-d7e7-44b0-b2a3-ce1d63ab3f7d/manager/0.log"
May 21 13:12:29.256480 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:29.256437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pkxqp_45412d1f-d47c-4a3f-80cc-e8294a1fd2cd/registry-server/0.log"
May 21 13:12:29.428704 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:29.428655    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qnwz4_8acdbdf1-2de3-4561-b3ab-1eaf3274653a/manager/0.log"
May 21 13:12:31.457917 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:31.457889    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq4mq_3b0d82fb-136a-4286-adcf-f4d78041fcb0/node-exporter/0.log"
May 21 13:12:31.481243 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:31.481207    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq4mq_3b0d82fb-136a-4286-adcf-f4d78041fcb0/kube-rbac-proxy/0.log"
May 21 13:12:31.506244 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:31.506215    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tq4mq_3b0d82fb-136a-4286-adcf-f4d78041fcb0/init-textfile/0.log"
May 21 13:12:33.016598 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.016552    2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"]
May 21 13:12:33.017004 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.016915    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b90eb735-5fec-4c60-a174-63d81aa1597d" containerName="cleanup"
May 21 13:12:33.017004 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.016926    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b90eb735-5fec-4c60-a174-63d81aa1597d" containerName="cleanup"
May 21 13:12:33.017089 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.017007    2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b90eb735-5fec-4c60-a174-63d81aa1597d" containerName="cleanup"
May 21 13:12:33.019908 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.019891    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.023578 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.023554    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dx5f\"/\"openshift-service-ca.crt\""
May 21 13:12:33.024358 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.024337    2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dx5f\"/\"default-dockercfg-jq2jw\""
May 21 13:12:33.024358 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.024343    2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dx5f\"/\"kube-root-ca.crt\""
May 21 13:12:33.032400 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.032380    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"]
May 21 13:12:33.118992 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.118954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-sys\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.118992 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.118994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-podres\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.119207 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.119081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-lib-modules\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.119207 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.119126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wbx6\" (UniqueName: \"kubernetes.io/projected/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-kube-api-access-2wbx6\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.119207 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.119159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-proc\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220507 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220446    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-lib-modules\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220507 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220502    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wbx6\" (UniqueName: \"kubernetes.io/projected/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-kube-api-access-2wbx6\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220532    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-proc\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220564    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-sys\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220582    2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-podres\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220638    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-lib-modules\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220673    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-proc\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220698    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-podres\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.220808 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.220675    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-sys\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.229297 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.229271    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wbx6\" (UniqueName: \"kubernetes.io/projected/055bdc7f-ad40-4fb1-8900-b58a3e8d2122-kube-api-access-2wbx6\") pod \"perf-node-gather-daemonset-n4w7c\" (UID: \"055bdc7f-ad40-4fb1-8900-b58a3e8d2122\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.329121 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.329032    2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.466000 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.465964    2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"]
May 21 13:12:33.469299 ip-10-0-143-244 kubenswrapper[2567]: W0521 13:12:33.469261    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod055bdc7f_ad40_4fb1_8900_b58a3e8d2122.slice/crio-9a60ef589df89bddf82f749fb8ce72055c1c997252c04dc6a4aeab06deec0505 WatchSource:0}: Error finding container 9a60ef589df89bddf82f749fb8ce72055c1c997252c04dc6a4aeab06deec0505: Status 404 returned error can't find the container with id 9a60ef589df89bddf82f749fb8ce72055c1c997252c04dc6a4aeab06deec0505
May 21 13:12:33.471240 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.471222    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 13:12:33.508049 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.508028    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-dj54k_f9d49aa7-773a-4699-a8fb-0d60353476fb/networking-console-plugin/0.log"
May 21 13:12:33.771699 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.771664    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c" event={"ID":"055bdc7f-ad40-4fb1-8900-b58a3e8d2122","Type":"ContainerStarted","Data":"820d1098263b3fdb5809516bda555201467ccca019f4aff7788d5740c6f02416"}
May 21 13:12:33.771699 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.771700    2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c" event={"ID":"055bdc7f-ad40-4fb1-8900-b58a3e8d2122","Type":"ContainerStarted","Data":"9a60ef589df89bddf82f749fb8ce72055c1c997252c04dc6a4aeab06deec0505"}
May 21 13:12:33.771939 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.771789    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:33.792591 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:33.792538    2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c" podStartSLOduration=1.79252244 podStartE2EDuration="1.79252244s" podCreationTimestamp="2026-05-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:12:33.79128607 +0000 UTC m=+2112.407990898" watchObservedRunningTime="2026-05-21 13:12:33.79252244 +0000 UTC m=+2112.409227252"
May 21 13:12:35.939891 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:35.939865    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qdgl9_89fc7d90-3149-4af5-9efe-66728918af24/dns/0.log"
May 21 13:12:35.968471 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:35.968443    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qdgl9_89fc7d90-3149-4af5-9efe-66728918af24/kube-rbac-proxy/0.log"
May 21 13:12:36.111230 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:36.111192    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dv2tz_29780791-9947-4453-b78b-263e5fef63cf/dns-node-resolver/0.log"
May 21 13:12:36.706751 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:36.706728    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7vck_9005567f-bcd0-42a3-b56d-dfb84b800d09/node-ca/0.log"
May 21 13:12:37.743945 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:37.743910    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-fjrcm_26807820-21a8-42a4-beb4-b114e1c610be/discovery/0.log"
May 21 13:12:37.797469 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:37.797437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7485fd7bf5-mrp89_aff90ed5-10c7-4967-b773-16766eb079c7/kube-auth-proxy/0.log"
May 21 13:12:37.924701 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:37.924673    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-t7jsq_8345390a-7f71-4afb-9cc1-5f66972fee17/payload-processing/0.log"
May 21 13:12:38.523761 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:38.523730    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6sp9h_11f41710-4aac-456c-81f8-021fed7b6509/serve-healthcheck-canary/0.log"
May 21 13:12:39.079884 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:39.079855    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bznzd_51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380/kube-rbac-proxy/0.log"
May 21 13:12:39.103206 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:39.103176    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bznzd_51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380/exporter/0.log"
May 21 13:12:39.129649 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:39.129619    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bznzd_51a1e0ea-c0cb-49d9-9390-a1b7bc7ed380/extractor/0.log"
May 21 13:12:39.784636 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:39.784605    2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-n4w7c"
May 21 13:12:41.484402 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.484366    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7gxmj_dce100c1-c814-43b9-bd16-f7592638fe9c/manager/0.log"
May 21 13:12:41.561697 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.561669    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29656140-6pbn4_b90eb735-5fec-4c60-a174-63d81aa1597d/cleanup/0.log"
May 21 13:12:41.649453 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.649420    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54cf999744-lf5gg_a3d71897-e6d9-4522-98a0-1f904b077686/manager/0.log"
May 21 13:12:41.682134 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.682107    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nhhnw_0e1ef120-0307-4475-a327-deee2f13b53c/manager/1.log"
May 21 13:12:41.693137 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.693109    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nhhnw_0e1ef120-0307-4475-a327-deee2f13b53c/manager/2.log"
May 21 13:12:41.811096 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:41.811071    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84556f689c-q5f86_ad5ef8a0-35a3-419d-bd96-594fec79664c/manager/0.log"
May 21 13:12:49.435852 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.435821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-69jb2_9bcd021b-eab5-461b-9c49-331cca103fbf/kube-multus/0.log"
May 21 13:12:49.704701 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.704622    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/kube-multus-additional-cni-plugins/0.log"
May 21 13:12:49.776948 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.776919    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/egress-router-binary-copy/0.log"
May 21 13:12:49.830848 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.830824    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/cni-plugins/0.log"
May 21 13:12:49.865867 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.865826    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/bond-cni-plugin/0.log"
May 21 13:12:49.902900 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.902875    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/routeoverride-cni/0.log"
May 21 13:12:49.942764 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.942739    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/whereabouts-cni-bincopy/0.log"
May 21 13:12:49.972052 ip-10-0-143-244 kubenswrapper[2567]: I0521 13:12:49.971980    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j97sv_509c9646-37ad-4665-a500-a9a454afe3a7/whereabouts-cni/0.log"