Jun 09 11:52:22.487979 ip-10-0-129-223 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 11:52:22.487992 ip-10-0-129-223 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 11:52:22.487999 ip-10-0-129-223 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 11:52:22.488144 ip-10-0-129-223 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 11:52:34.021779 ip-10-0-129-223 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 11:52:34.021798 ip-10-0-129-223 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 58006275308a4f14abf360753fc3163b -- Jun 09 11:54:54.026121 ip-10-0-129-223 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:54:54.430913 ip-10-0-129-223 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:54.430913 ip-10-0-129-223 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:54:54.430913 ip-10-0-129-223 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:54.430913 ip-10-0-129-223 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:54:54.430913 ip-10-0-129-223 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:54:54.431686 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.430980 2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436156 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436176 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436180 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436183 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436187 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436190 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.436181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436192 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436195 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436198 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436201 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436204 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436206 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436211 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436213 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436216 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436218 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436221 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436224 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436226 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436229 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436231 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436234 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436237 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436242 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436246 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.436430 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436249 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436252 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436255 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436257 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436260 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436263 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436270 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436273 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436276 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436278 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436281 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436284 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436286 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436289 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436291 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436296 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436298 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436301 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436305 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.436919 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436310 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436313 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436316 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436319 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436321 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436324 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436328 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436331 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436333 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436336 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436339 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436341 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436344 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436347 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436350 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436352 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436355 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436357 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436360 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436363 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.437416 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436365 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436369 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436372 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436375 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436378 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436380 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436383 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436385 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436388 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436391 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436393 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436396 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436400 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436404 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436409 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436411 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436414 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436416 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436419 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436422 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.437924 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436425 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436427 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436430 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436433 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436436 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436439 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436442 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436445 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436447 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436451 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436453 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436456 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436459 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436461 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.436464 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437213 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437220 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437223 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437225 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437228 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.438403 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437231 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437234 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437236 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437239 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437242 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437245 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437247 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437250 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437252 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437255 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437258 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437260 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437263 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437266 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437268 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437271 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437274 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437277 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437280 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.438899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437283 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437285 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437288 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437291 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437294 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437296 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437299 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437301 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437304 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437307 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437309 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437312 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437314 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437317 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437319 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437322 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437324 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437327 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437330 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.439383 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437332 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437335 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437337 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437340 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437343 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437346 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437348 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437351 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437354 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437356 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437360 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437363 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437366 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437368 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437371 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437373 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437376 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437378 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437381 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437383 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.439879 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437387 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437390 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437393 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437395 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437398 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437400 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437403 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437405 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437408 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437410 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437413 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437415 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437418 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437420 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437423 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437426 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437429 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437431 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437434 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437438 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.440370 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437441 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437444 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437447 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437450 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437452 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437456 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437460 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437464 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437468 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437470 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437473 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437477 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437479 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437482 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437485 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437488 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437976 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437982 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437986 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.440877 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437989 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437992 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437995 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.437998 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438001 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438004 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438007 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438010 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438013 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438016 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438019 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438022 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438024 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438029 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438032 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438036 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438039 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438043 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438046 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.441346 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438048 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438051 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438053 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438056 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438058 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438061 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438063 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438066 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438068 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438071 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438073 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438076 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438078 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438082 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438086 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438089 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438092 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438094 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438096 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438099 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.441821 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438101 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438104 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438106 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438109 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438112 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438115 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438118 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438121 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438124 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438127 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438130 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438132 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438134 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438137 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438139 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438142 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438144 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438146 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438149 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438152 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.442312 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438155 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438157 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438159 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438162 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438165 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438167 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438170 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438173 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438175 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438178 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438181 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438183 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438186 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438188 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438190 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438193 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438196 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438198 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438200 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438203 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.442816 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438209 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438211 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438214 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438216 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438219 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438221 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438225 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438227 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438230 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438232 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438235 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438237 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438240 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438242 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438246 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438249 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438252 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438325 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438333 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438340 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:54:54.443296 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438344 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438349 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438352 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438357 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438361 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438364 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438367 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438371 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438374 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438377 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438380 2567 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438383 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438387 2567 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438391 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438394 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438399 2567 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438402 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438405 2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438408 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438412 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438416 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438419 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438422 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:54:54.443783 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438425 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438428 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438431 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438434 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438437 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438440 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438444 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438447 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438450 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438452 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438455 2567 flags.go:64] FLAG: --enable-server="true" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438458 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438462 2567 flags.go:64] FLAG: --event-burst="100" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438465 2567 flags.go:64] FLAG: --event-qps="50" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438468 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438471 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438473 2567 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438477 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438479 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438482 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438485 2567 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438489 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438492 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438495 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438498 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:54:54.444336 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438501 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438503 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438506 2567 flags.go:64] FLAG: --feature-gates="" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438510 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438513 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438515 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438518 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438521 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438524 2567 flags.go:64] FLAG: --help="false" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438527 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438530 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438533 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438536 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438539 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438544 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438547 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438549 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438552 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438555 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438557 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438560 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438563 2567 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438566 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438569 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:54:54.445040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438572 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438575 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438577 2567 flags.go:64] FLAG: --lock-file="" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438580 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438584 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438587 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438593 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438596 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438599 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438602 2567 flags.go:64] FLAG: --logging-format="text" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438605 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438610 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438615 2567 flags.go:64] FLAG: --manifest-url="" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438620 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438626 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438628 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438633 2567 flags.go:64] FLAG: --max-pods="110" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438635 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438638 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438641 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438644 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438647 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438651 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438654 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438668 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:54:54.445621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438673 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438676 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438679 2567 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438682 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438688 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438691 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438693 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438696 2567 flags.go:64] FLAG: --port="10250" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438699 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438702 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08097e74ee736435a" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438706 2567 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438710 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438713 2567 flags.go:64] FLAG: --register-node="true" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438716 2567 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438720 2567 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438724 2567 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438726 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438729 2567 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438733 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438736 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438738 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438741 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438744 2567 flags.go:64] FLAG: --runonce="false" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438747 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438750 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:54:54.446276 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438753 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438755 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438758 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438774 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438778 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438782 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438785 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438788 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438791 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438793 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438796 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438799 2567 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438802 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438807 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438810 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438813 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438818 2567 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438820 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438824 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438827 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438830 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438833 2567 flags.go:64] FLAG: --v="2" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438837 2567 flags.go:64] FLAG: --version="false" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438842 2567 flags.go:64] FLAG: --vmodule="" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438846 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:54:54.446999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.438849 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438964 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438968 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438971 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438974 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438976 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438979 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438982 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438984 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438987 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438989 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438992 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438996 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.438999 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439001 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439004 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439006 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439009 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439011 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.447608 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439013 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439016 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439019 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439021 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439024 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439026 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439029 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439032 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439035 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439038 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439040 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439043 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439046 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439048 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439051 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439053 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439056 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439058 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439062 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439066 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.448114 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439068 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439071 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439074 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439077 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439079 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439084 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439087 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439089 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439092 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439095 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439098 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439101 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439103 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439106 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439108 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439111 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439113 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439115 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439118 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439121 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.448605 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439124 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439127 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439129 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439132 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439134 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439137 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439140 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439142 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439145 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439147 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439149 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439152 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439154 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439157 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439159 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439161 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439164 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439167 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439170 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439172 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.449234 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439175 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439177 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439180 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439182 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439185 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439189 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439192 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439195 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439198 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439200 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439203 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439205 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439208 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439210 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439213 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439216 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439219 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439221 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439226 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439229 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.449725 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.439232 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.439964 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.447196 2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.447215 2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.448111 2567 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.448121 2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448191 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448196 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448199 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448202 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448205 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448209 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448214 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448217 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.450233 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448220 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448223 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448226 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448229 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448232 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448235 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448238 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448242 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448245 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448248 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448251 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448254 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448257 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448260 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448263 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448266 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448269 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448272 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448274 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448277 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.450577 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448279 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448285 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448288 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448290 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448293 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448296 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448298 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448301 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448304 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448307 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448309 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448312 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448314 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448316 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448319 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448321 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448325 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448327 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448330 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448332 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.451083 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448335 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448338 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448341 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448343 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448346 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448348 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448351 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448354 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448356 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448360 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448364 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448367 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448370 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448373 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448377 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448379 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448382 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448385 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448388 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.451569 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448390 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448393 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448395 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448398 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448400 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448403 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448405 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448407 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448410 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448412 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448415 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448418 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448421 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448423 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448426 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448428 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448431 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448433 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448436 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448439 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.452061 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448442 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448444 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448447 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448450 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448453 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448456 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448458 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448461 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448464 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448467 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448469 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448472 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.448477 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448610 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:54:54.452573 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448616 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448619 2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448622 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448625 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448628 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448630 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448633 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448636 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448639 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448642 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448644 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448646 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448649 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448652 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448654 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448657 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448659 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448662 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448664 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:54:54.453022 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448667 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448671 2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448675 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448678 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448681 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448684 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448687 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448690 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448698 2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448701 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448704 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448706 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448709 2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448711 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448714 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448716 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448719 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448721 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448723 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:54:54.453469 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448726 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448728 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448731 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448733 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448736 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448738 2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448740 2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448743 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448745 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448747 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448750 2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448752 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448756 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448779 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448784 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448788 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448791 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448794 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448797 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448800 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:54:54.453937 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448802 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448805 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448815 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448818 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448820 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448823 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448825 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448828 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448830 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448833 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448835 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448838 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448841 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448843 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448846 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448848 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448850 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448853 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448855 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448858 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:54:54.454413 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448860 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448863 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448865 2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448868 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448871 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448873 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448876 2567 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448878 2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448880 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448884 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448886 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448889 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448891 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448894 2567 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448896 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448906 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448910 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448913 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448916 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:54:54.454899 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:54.448919 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:54:54.455357 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.448924 2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:54:54.455357 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.449073 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:54:54.455357 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.453144 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:54:54.455357 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.454786 2567 server.go:1019] "Starting client certificate rotation" Jun 09 11:54:54.455357 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.454898 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:54:54.455692 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.455678 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:54:54.458049 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.458033 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:54:54.464402 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.464377 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:54:54.476025 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.476000 2567 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:54:54.479161 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.479145 2567 log.go:25] "Validated CRI v1 image API" Jun 09 11:54:54.480089 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.480072 2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:54:54.483048 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.483029 2567 fs.go:135] Filesystem UUIDs: map[65a5d0e0-bf07-4a13-85fc-bb4c3eab3772:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7d15c3cd-e993-4a9e-875f-7d34c57047fe:/dev/nvme0n1p3] Jun 09 11:54:54.483104 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.483049 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:54:54.488879 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.488862 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:54:54.489113 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.488983 2567 manager.go:216] Machine: {Timestamp:2026-06-09 11:54:54.487495492 +0000 UTC m=+0.353810306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100246 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212e41dfe9d14b164c44b6dd99f32c SystemUUID:ec212e41-dfe9-d14b-164c-44b6dd99f32c BootID:58006275-308a-4f14-abf3-60753fc3163b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:39:cc:bb:d9:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:39:cc:bb:d9:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:5c:ab:a8:61:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:54:54.489113 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.489113 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:54:54.489213 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.489202 2567 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:54:54.492890 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.492844 2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:54:54.493035 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.492894 2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:54:54.493793 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.493782 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:54:54.493828 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.493796 2567 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:54:54.493828 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.493803 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:54:54.494629 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.494619 2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:54:54.495775 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.495755 2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:54:54.500008 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.499995 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:54:54.500127 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500117 2567 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:54:54.500157 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500149 2567 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:54:54.500192 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500158 2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:54:54.500192 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500173 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:54:54.500192 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500183 2567 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:54:54.500294 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500202 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:54:54.500604 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500593 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:54:54.500639 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.500616 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:54:54.510006 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.509988 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4g5f" Jun 09 11:54:54.513692 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.513674 2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:54:54.515012 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.514998 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4g5f" Jun 09 11:54:54.515687 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.515658 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:54:54.515687 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.515654 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:54:54.515999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.515978 2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:54:54.516068 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.516017 2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:54:54.517929 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517912 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:54:54.517929 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517931 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517937 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517944 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517953 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517959 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517968 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517973 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517980 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.517986 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.518002 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:54:54.518058 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.518008 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:54:54.518942 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.518932 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:54:54.518942 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.518941 2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:54:54.522165 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.522150 2567 server.go:1268] "Started kubelet" Jun 09 11:54:54.522267 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.522233 2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:54:54.522337 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.522252 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:54:54.522337 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.522293 2567 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:54:54.523192 ip-10-0-129-223 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:54:54.524464 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.524451 2567 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:54:54.527346 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.527325 2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:54:54.530480 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.530459 2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:54:54.532218 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.532202 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:54:54.532323 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.532295 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:54:54.532537 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.532511 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.534707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.534008 2567 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:54:54.534707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.534033 2567 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:54:54.534707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.534267 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:54:54.534707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.534277 2567 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:54:54.534707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.534706 2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:54:54.535125 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535047 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:54.535280 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535260 2567 factory.go:55] Registering systemd factory Jun 09 11:54:54.535280 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535281 2567 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:54:54.535419 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535379 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-223.ec2.internal" not found Jun 09 11:54:54.535665 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535652 2567 factory.go:153] Registering CRI-O factory Jun 09 11:54:54.535709 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535668 2567 factory.go:223] Registration of the crio container factory successfully Jun 09 11:54:54.535741 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535714 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:54:54.535741 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535738 2567 factory.go:103] Registering Raw factory Jun 09 11:54:54.535845 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.535749 2567 manager.go:1196] Started watching for new ooms in manager Jun 09 11:54:54.536282 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.536269 2567 manager.go:349] Starting recovery of all containers Jun 09 11:54:54.537143 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.537116 2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-223.ec2.internal\" not found" node="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.548183 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.547998 2567 manager.go:354] Recovery completed Jun 09 11:54:54.552071 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.552050 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-223.ec2.internal" not found Jun 09 11:54:54.553173 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.553159 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.555194 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555177 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.555273 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555202 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.555273 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555212 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.555840 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555829 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:54:54.555840 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555839 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:54:54.555928 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.555856 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:54:54.556282 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.556265 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.557901 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.557882 2567 policy_none.go:49] "None policy: Start" Jun 09 11:54:54.557980 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.557904 2567 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:54:54.557980 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.557918 2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:54:54.558075 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.558065 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.558119 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.558093 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.558119 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.558104 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.559865 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.559851 2567 policy_none.go:47] "Start" Jun 09 11:54:54.596389 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596371 2567 manager.go:337] "Starting Device Plugin manager" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.596405 2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596415 2567 server.go:87] "Starting device plugin registration server" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596712 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596725 2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596877 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596960 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.596969 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.597442 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.597484 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.609464 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.610868 2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.610920 2567 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.610941 2567 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.610979 2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.611051 2567 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-223.ec2.internal" not found Jun 09 11:54:54.617393 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.612984 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:54.697320 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.697280 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.698478 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.698459 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.698568 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.698490 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.698568 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.698499 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.698568 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.698521 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.708177 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.708152 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.708306 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.708182 2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-223.ec2.internal\": node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.712079 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.712059 2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal"] Jun 09 11:54:54.712138 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.712129 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.713957 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.713940 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.714039 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.714003 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.714039 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.714029 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.716522 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.716508 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.716611 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.716598 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.716658 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.716625 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.717189 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717171 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.717189 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717184 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.717324 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717202 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.717324 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717205 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.717324 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717243 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.717324 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.717217 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.719363 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.719349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.719437 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.719374 2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:54:54.720051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.720035 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:54:54.720131 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.720062 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:54:54.720131 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.720072 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:54:54.724602 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.724584 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.746710 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.746681 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-223.ec2.internal\" not found" node="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.751418 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.751400 2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-223.ec2.internal\" not found" node="ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.825149 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.825110 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.835819 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.835790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.835901 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.835822 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.835901 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.835861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/696c8cfe943a182a33032adecd257449-config\") pod \"kube-apiserver-proxy-ip-10-0-129-223.ec2.internal\" (UID: \"696c8cfe943a182a33032adecd257449\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.926259 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:54.926173 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:54.936647 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936612 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.936815 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.936815 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936676 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/696c8cfe943a182a33032adecd257449-config\") pod \"kube-apiserver-proxy-ip-10-0-129-223.ec2.internal\" (UID: \"696c8cfe943a182a33032adecd257449\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.936815 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/696c8cfe943a182a33032adecd257449-config\") pod \"kube-apiserver-proxy-ip-10-0-129-223.ec2.internal\" (UID: \"696c8cfe943a182a33032adecd257449\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.936815 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:54.936815 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:54.936776 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c93b09a2aaaf766f7ab1a0b491fb8085-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal\" (UID: \"c93b09a2aaaf766f7ab1a0b491fb8085\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:55.027021 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.026975 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.053571 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.053549 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:55.058467 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.058248 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:55.128009 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.127950 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.228597 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.228567 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.329219 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.329165 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.429909 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.429879 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.454506 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.454476 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:54:55.455171 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.454651 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:54:55.455171 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.454665 2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:54:55.523096 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.523003 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:49:54 +0000 UTC" deadline="2028-03-26 01:41:04.40493306 +0000 UTC" Jun 09 11:54:55.523096 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.523042 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15733h46m8.881894388s" Jun 09 11:54:55.530180 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.530154 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.584181 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:55.584141 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93b09a2aaaf766f7ab1a0b491fb8085.slice/crio-9c0b5d1f89fc58f9f1ecec10a4acaecd7497b436dfe6addda729509b5368c15c WatchSource:0}: Error finding container 9c0b5d1f89fc58f9f1ecec10a4acaecd7497b436dfe6addda729509b5368c15c: Status 404 returned error can't find the container with id 9c0b5d1f89fc58f9f1ecec10a4acaecd7497b436dfe6addda729509b5368c15c Jun 09 11:54:55.584434 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:55.584411 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696c8cfe943a182a33032adecd257449.slice/crio-905d0d0283282ff3003964086fe37514afb50c4b1e105cc016cfa2a474a47b4b WatchSource:0}: Error finding container 905d0d0283282ff3003964086fe37514afb50c4b1e105cc016cfa2a474a47b4b: Status 404 returned error can't find the container with id 905d0d0283282ff3003964086fe37514afb50c4b1e105cc016cfa2a474a47b4b Jun 09 11:54:55.591938 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.591919 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:54:55.614850 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.614795 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" event={"ID":"c93b09a2aaaf766f7ab1a0b491fb8085","Type":"ContainerStarted","Data":"9c0b5d1f89fc58f9f1ecec10a4acaecd7497b436dfe6addda729509b5368c15c"} Jun 09 11:54:55.615834 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.615814 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" event={"ID":"696c8cfe943a182a33032adecd257449","Type":"ContainerStarted","Data":"905d0d0283282ff3003964086fe37514afb50c4b1e105cc016cfa2a474a47b4b"} Jun 09 11:54:55.631006 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.630954 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.731603 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.731565 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.832218 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:55.832146 2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-223.ec2.internal\" not found" Jun 09 11:54:55.870767 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.870744 2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:55.933228 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.933195 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" Jun 09 11:54:55.943485 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.943457 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:54:55.945733 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.945704 2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" Jun 09 11:54:55.955879 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:55.955856 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:54:56.081106 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.081072 2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:56.383750 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.383714 2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:56.501626 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.501586 2567 apiserver.go:52] "Watching apiserver" Jun 09 11:54:56.514071 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.514045 2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:54:56.514462 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.514439 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal","openshift-dns/node-resolver-75zr2","openshift-image-registry/node-ca-25spp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-fbblh","openshift-multus/network-metrics-daemon-hn75f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb","openshift-cluster-node-tuning-operator/tuned-jb7mk","openshift-multus/multus-5dckx","openshift-network-diagnostics/network-check-target-c8f48","openshift-network-operator/iptables-alerter-28csz","openshift-ovn-kubernetes/ovnkube-node-5tsk8","kube-system/global-pull-secret-syncer-kkntp","kube-system/konnectivity-agent-lsbn5"] Jun 09 11:54:56.517061 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.517032 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:56.517180 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.517116 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:54:56.519110 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.519088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.519197 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.519164 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:54:56.521203 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.521184 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.523305 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.523285 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.523723 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.523701 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-82dt6\"" Jun 09 11:54:56.523865 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.523844 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.523922 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.523866 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.523922 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.523894 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:54:56.525523 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.525505 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.526037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.526022 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:54:56.526405 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.526389 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:54:56.526593 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.526578 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-57cjh\"" Jun 09 11:54:56.527611 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.527592 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.527685 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.527663 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:54:56.528108 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.528092 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kk728\"" Jun 09 11:54:56.529162 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.529143 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.529267 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.529192 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:54:56.529640 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.529620 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:54:56.529710 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.529628 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:54:56.529928 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.529913 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.530120 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.530104 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.532186 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.532168 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.532781 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.532582 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:54:56.532781 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.532655 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vtpcs\"" Jun 09 11:54:56.533388 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.533370 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:54:56.534274 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.534258 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.534732 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.534711 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.534826 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.534742 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.534826 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.534750 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:54:56.534945 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.534853 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6mbxp\"" Jun 09 11:54:56.536890 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.536784 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.537038 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.537020 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.537221 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.537198 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.537439 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.537416 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xv5hs\"" Jun 09 11:54:56.539485 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.539078 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.540116 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.540096 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.540238 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.540221 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.540516 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.540502 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znkrk\"" Jun 09 11:54:56.542212 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.542191 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:54:56.542342 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.542251 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.542400 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.542201 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.542516 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.542500 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.543577 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.543554 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6g6ss\"" Jun 09 11:54:56.544661 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.544640 2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:54:56.545081 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545065 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:54:56.545348 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545326 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d74l\" (UniqueName: \"kubernetes.io/projected/f0a7af62-383e-4c22-b8a8-e4649fed0be9-kube-api-access-2d74l\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.545442 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545361 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8xh\" (UniqueName: \"kubernetes.io/projected/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kube-api-access-nh8xh\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.545442 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-kubernetes\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545442 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545396 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:54:56.545442 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545413 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545442 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545436 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cni-binary-copy\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545460 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-conf-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-hosts-file\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545503 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-lib-modules\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545528 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545550 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-run\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545568 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-var-lib-kubelet\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545590 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdq46\" (UniqueName: \"kubernetes.io/projected/3f35d578-6b44-46a9-a576-117c98fdffee-kube-api-access-mdq46\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-multus-certs\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-device-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545667 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-tmp-dir\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-dbus\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545719 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-system-cni-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.545803 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-multus\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zln\" (UniqueName: \"kubernetes.io/projected/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-kube-api-access-r5zln\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-socket-dir-parent\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545882 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8w6\" (UniqueName: \"kubernetes.io/projected/ba081705-3921-4c66-9c79-642330c65850-kube-api-access-mw8w6\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545931 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-hostroot\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545945 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545955 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.545978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-tmp\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0a7af62-383e-4c22-b8a8-e4649fed0be9-serviceca\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzh49\" (UniqueName: \"kubernetes.io/projected/6d4682ac-9b0f-41d2-b47f-561c4dee9522-kube-api-access-lzh49\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546044 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cnibin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546140 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546179 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-os-release\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-kubelet\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.546479 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546230 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-os-release\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546274 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546300 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-sys\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546341 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2l5q6\"" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546343 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-daemon-config\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546478 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-kubelet-config\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546499 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0a7af62-383e-4c22-b8a8-e4649fed0be9-host\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546531 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546557 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s875l\" (UniqueName: \"kubernetes.io/projected/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-kube-api-access-s875l\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546576 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysconfig\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-conf\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-etc-tuned\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546655 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-modprobe-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546677 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d083a496-f29b-4b6c-b323-25c2f663dc27-konnectivity-ca\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.547423 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-system-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-etc-kubernetes\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546736 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546781 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d083a496-f29b-4b6c-b323-25c2f663dc27-agent-certs\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546863 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-cnibin\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-systemd\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546902 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-k8s-cni-cncf-io\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.546995 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-netns\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.547039 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-bin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.548340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.547062 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-host\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.573096 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.573058 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfzkp" Jun 09 11:54:56.580827 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.580799 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfzkp" Jun 09 11:54:56.636051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.635953 2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:54:56.647434 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647393 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-kubelet-config\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.647434 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647432 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0a7af62-383e-4c22-b8a8-e4649fed0be9-host\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647491 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s875l\" (UniqueName: \"kubernetes.io/projected/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-kube-api-access-s875l\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647515 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysconfig\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647544 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-kubelet-config\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-conf\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647610 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-etc-tuned\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647639 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.647678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-modprobe-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647683 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-conf\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647688 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-systemd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647730 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-var-lib-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647779 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d083a496-f29b-4b6c-b323-25c2f663dc27-konnectivity-ca\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647806 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-system-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647832 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-etc-kubernetes\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647853 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647875 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59cd7e49-52d7-4bdd-888a-705d6cad340e-iptables-alerter-script\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647923 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647946 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d083a496-f29b-4b6c-b323-25c2f663dc27-agent-certs\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.647984 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-cnibin\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648015 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-systemd\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fcf\" (UniqueName: \"kubernetes.io/projected/6236bdba-fde6-4ab0-8571-6f36f4beed7a-kube-api-access-g6fcf\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648083 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysconfig\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648099 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648085 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-k8s-cni-cncf-io\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-netns\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648145 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-bin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648169 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-host\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-log-socket\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d74l\" (UniqueName: \"kubernetes.io/projected/f0a7af62-383e-4c22-b8a8-e4649fed0be9-kube-api-access-2d74l\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648241 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8xh\" (UniqueName: \"kubernetes.io/projected/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kube-api-access-nh8xh\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-kubernetes\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648289 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-slash\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-netns\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0a7af62-383e-4c22-b8a8-e4649fed0be9-host\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648360 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cni-binary-copy\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648415 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-conf-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648442 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-hosts-file\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648467 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-lib-modules\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648497 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-etc-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.648861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648501 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648527 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-run\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-var-lib-kubelet\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648629 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdq46\" (UniqueName: \"kubernetes.io/projected/3f35d578-6b44-46a9-a576-117c98fdffee-kube-api-access-mdq46\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648657 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-multus-certs\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-device-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-tmp-dir\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648747 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-kubelet\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648793 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-dbus\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648818 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-var-lib-kubelet\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648899 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-lib-modules\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648958 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-multus-certs\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.648993 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-system-cni-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-device-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.649670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-dbus\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-system-cni-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-host\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649402 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-sysctl-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649413 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-systemd\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-system-cni-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649482 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-cnibin\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-k8s-cni-cncf-io\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-etc-kubernetes\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649594 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-run\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.649595 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.649676 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:57.149654871 +0000 UTC m=+3.015969677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovn-node-metrics-cert\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649740 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-multus\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649790 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zln\" (UniqueName: \"kubernetes.io/projected/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-kube-api-access-r5zln\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649818 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx25\" (UniqueName: \"kubernetes.io/projected/59cd7e49-52d7-4bdd-888a-705d6cad340e-kube-api-access-clx25\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.650469 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-conf-dir\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649842 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649871 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-socket-dir-parent\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649891 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d083a496-f29b-4b6c-b323-25c2f663dc27-konnectivity-ca\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649899 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8w6\" (UniqueName: \"kubernetes.io/projected/ba081705-3921-4c66-9c79-642330c65850-kube-api-access-mw8w6\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-ovn\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.649950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-hosts-file\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650139 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-bin\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650154 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-bin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650169 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650198 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-kubernetes\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650197 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-script-lib\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650218 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650227 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-hostroot\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.650276 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:56.651279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650279 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-etc-modprobe-d\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba081705-3921-4c66-9c79-642330c65850-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650315 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-run-netns\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.650313 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:57.150302766 +0000 UTC m=+3.016617550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-sys-fs\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-tmp\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-socket-dir-parent\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-hostroot\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650388 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-env-overrides\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650416 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0a7af62-383e-4c22-b8a8-e4649fed0be9-serviceca\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650445 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650472 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-cni-multus\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-socket-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-node-log\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650570 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzh49\" (UniqueName: \"kubernetes.io/projected/6d4682ac-9b0f-41d2-b47f-561c4dee9522-kube-api-access-lzh49\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.652051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cnibin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650648 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-os-release\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650680 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-kubelet\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650709 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-os-release\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650831 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-sys\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-daemon-config\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650887 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650917 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59cd7e49-52d7-4bdd-888a-705d6cad340e-host-slash\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-systemd-units\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-netd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651050 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f35d578-6b44-46a9-a576-117c98fdffee-sys\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651116 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-config\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651129 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-tmp-dir\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0a7af62-383e-4c22-b8a8-e4649fed0be9-serviceca\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.650861 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cnibin\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.652863 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651271 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba081705-3921-4c66-9c79-642330c65850-os-release\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-host-var-lib-kubelet\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651537 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-multus-daemon-config\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651565 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-os-release\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651604 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-registration-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.651999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-cni-binary-copy\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.652929 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-tmp\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.653676 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.652976 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f35d578-6b44-46a9-a576-117c98fdffee-etc-tuned\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.654125 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.653715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d083a496-f29b-4b6c-b323-25c2f663dc27-agent-certs\") pod \"konnectivity-agent-lsbn5\" (UID: \"d083a496-f29b-4b6c-b323-25c2f663dc27\") " pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.657165 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.657140 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:56.657165 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.657169 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:56.657350 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.657183 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:56.657350 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:56.657241 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:57.157224206 +0000 UTC m=+3.023539004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:56.657350 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.657341 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s875l\" (UniqueName: \"kubernetes.io/projected/ede206f8-ecd6-4fc1-917e-1b6d7a86148c-kube-api-access-s875l\") pod \"node-resolver-75zr2\" (UID: \"ede206f8-ecd6-4fc1-917e-1b6d7a86148c\") " pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.658508 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.658484 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdq46\" (UniqueName: \"kubernetes.io/projected/3f35d578-6b44-46a9-a576-117c98fdffee-kube-api-access-mdq46\") pod \"tuned-jb7mk\" (UID: \"3f35d578-6b44-46a9-a576-117c98fdffee\") " pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.658716 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.658692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8xh\" (UniqueName: \"kubernetes.io/projected/acd8c5af-db17-461d-ac02-c5b3c56be1c9-kube-api-access-nh8xh\") pod \"aws-ebs-csi-driver-node-gn9fb\" (UID: \"acd8c5af-db17-461d-ac02-c5b3c56be1c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.659265 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.659238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d74l\" (UniqueName: \"kubernetes.io/projected/f0a7af62-383e-4c22-b8a8-e4649fed0be9-kube-api-access-2d74l\") pod \"node-ca-25spp\" (UID: \"f0a7af62-383e-4c22-b8a8-e4649fed0be9\") " pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.659999 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.659979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzh49\" (UniqueName: \"kubernetes.io/projected/6d4682ac-9b0f-41d2-b47f-561c4dee9522-kube-api-access-lzh49\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:56.660745 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.660721 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8w6\" (UniqueName: \"kubernetes.io/projected/ba081705-3921-4c66-9c79-642330c65850-kube-api-access-mw8w6\") pod \"multus-additional-cni-plugins-fbblh\" (UID: \"ba081705-3921-4c66-9c79-642330c65850\") " pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.661988 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.661965 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zln\" (UniqueName: \"kubernetes.io/projected/e8c408c8-8f9c-44ad-92a8-c100d05d0b80-kube-api-access-r5zln\") pod \"multus-5dckx\" (UID: \"e8c408c8-8f9c-44ad-92a8-c100d05d0b80\") " pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.751452 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751417 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59cd7e49-52d7-4bdd-888a-705d6cad340e-iptables-alerter-script\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fcf\" (UniqueName: \"kubernetes.io/projected/6236bdba-fde6-4ab0-8571-6f36f4beed7a-kube-api-access-g6fcf\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751506 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-log-socket\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751534 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-slash\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-netns\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-etc-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-kubelet\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751607 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovn-node-metrics-cert\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.751637 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751632 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clx25\" (UniqueName: \"kubernetes.io/projected/59cd7e49-52d7-4bdd-888a-705d6cad340e-kube-api-access-clx25\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751633 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-slash\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-netns\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-etc-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751674 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751709 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751716 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-ovn\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751747 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-ovn\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751706 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-kubelet\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751791 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-bin\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751815 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751822 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-log-socket\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751842 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-script-lib\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751864 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-bin\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751880 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-env-overrides\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752041 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751911 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-node-log\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751949 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-node-log\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751965 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59cd7e49-52d7-4bdd-888a-705d6cad340e-host-slash\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.751997 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-systemd-units\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752027 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-netd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-host-cni-netd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752066 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59cd7e49-52d7-4bdd-888a-705d6cad340e-host-slash\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752068 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-systemd-units\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752108 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-config\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-systemd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752172 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-var-lib-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-var-lib-openvswitch\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752251 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6236bdba-fde6-4ab0-8571-6f36f4beed7a-run-systemd\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-env-overrides\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752401 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59cd7e49-52d7-4bdd-888a-705d6cad340e-iptables-alerter-script\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752438 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-script-lib\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.752810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.752794 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovnkube-config\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.754258 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.754242 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6236bdba-fde6-4ab0-8571-6f36f4beed7a-ovn-node-metrics-cert\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.759678 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.759650 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx25\" (UniqueName: \"kubernetes.io/projected/59cd7e49-52d7-4bdd-888a-705d6cad340e-kube-api-access-clx25\") pod \"iptables-alerter-28csz\" (UID: \"59cd7e49-52d7-4bdd-888a-705d6cad340e\") " pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.760713 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.760684 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fcf\" (UniqueName: \"kubernetes.io/projected/6236bdba-fde6-4ab0-8571-6f36f4beed7a-kube-api-access-g6fcf\") pod \"ovnkube-node-5tsk8\" (UID: \"6236bdba-fde6-4ab0-8571-6f36f4beed7a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:56.770405 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.770379 2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:54:56.834800 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.834756 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-25spp" Jun 09 11:54:56.843422 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.843392 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbblh" Jun 09 11:54:56.853301 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.853274 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:54:56.857066 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.857038 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dckx" Jun 09 11:54:56.863865 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.863847 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" Jun 09 11:54:56.869748 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.869728 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-75zr2" Jun 09 11:54:56.876645 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.876625 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" Jun 09 11:54:56.883452 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.883425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-28csz" Jun 09 11:54:56.888183 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:56.888163 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:54:57.155104 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.155024 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:57.155232 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.155121 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:57.155232 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.155177 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:57.155303 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.155236 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:57.155303 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.155258 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:58.155240716 +0000 UTC m=+4.021555503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:57.155303 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.155284 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:58.155265584 +0000 UTC m=+4.021580380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:57.256135 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.256100 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:57.256315 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.256266 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:57.256315 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.256286 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:57.256315 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.256296 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:57.256462 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:57.256354 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:54:58.256336994 +0000 UTC m=+4.122651801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:57.494918 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.494838 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede206f8_ecd6_4fc1_917e_1b6d7a86148c.slice/crio-197e70186186460dc1d0be1d551814ab2776048995fd189ee266316b998b9879 WatchSource:0}: Error finding container 197e70186186460dc1d0be1d551814ab2776048995fd189ee266316b998b9879: Status 404 returned error can't find the container with id 197e70186186460dc1d0be1d551814ab2776048995fd189ee266316b998b9879 Jun 09 11:54:57.496248 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.496189 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba081705_3921_4c66_9c79_642330c65850.slice/crio-443cbf5ce29c11c7602565cfe677f27fa0da632290458348836996f2cb91ebff WatchSource:0}: Error finding container 443cbf5ce29c11c7602565cfe677f27fa0da632290458348836996f2cb91ebff: Status 404 returned error can't find the container with id 443cbf5ce29c11c7602565cfe677f27fa0da632290458348836996f2cb91ebff Jun 09 11:54:57.497806 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.497755 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd083a496_f29b_4b6c_b323_25c2f663dc27.slice/crio-1eb5359f02eb824323f37d36520504cffb42249fdc5e76f1bd0f3ce7c931498d WatchSource:0}: Error finding container 1eb5359f02eb824323f37d36520504cffb42249fdc5e76f1bd0f3ce7c931498d: Status 404 returned error can't find the container with id 1eb5359f02eb824323f37d36520504cffb42249fdc5e76f1bd0f3ce7c931498d Jun 09 11:54:57.500517 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.500494 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a7af62_383e_4c22_b8a8_e4649fed0be9.slice/crio-40d6ce66e0d4273a313670cb154b1c084df2bc84c7b524b933530e699953ca41 WatchSource:0}: Error finding container 40d6ce66e0d4273a313670cb154b1c084df2bc84c7b524b933530e699953ca41: Status 404 returned error can't find the container with id 40d6ce66e0d4273a313670cb154b1c084df2bc84c7b524b933530e699953ca41 Jun 09 11:54:57.503020 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.502996 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f35d578_6b44_46a9_a576_117c98fdffee.slice/crio-fc39f522da0125e414a4ded9b0f5803d729199853dcef9b41fcb7248dc1b52eb WatchSource:0}: Error finding container fc39f522da0125e414a4ded9b0f5803d729199853dcef9b41fcb7248dc1b52eb: Status 404 returned error can't find the container with id fc39f522da0125e414a4ded9b0f5803d729199853dcef9b41fcb7248dc1b52eb Jun 09 11:54:57.503992 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.503966 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6236bdba_fde6_4ab0_8571_6f36f4beed7a.slice/crio-38a7be9498c5507287b5ebe545851ab15f55b8b8d0efaf35f9e295fef63cad23 WatchSource:0}: Error finding container 38a7be9498c5507287b5ebe545851ab15f55b8b8d0efaf35f9e295fef63cad23: Status 404 returned error can't find the container with id 38a7be9498c5507287b5ebe545851ab15f55b8b8d0efaf35f9e295fef63cad23 Jun 09 11:54:57.504974 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.504954 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c408c8_8f9c_44ad_92a8_c100d05d0b80.slice/crio-43190ec017dcaeb639f52b4f97ee6c4d9a7d3053739f24779512b2e1ad6aedc5 WatchSource:0}: Error finding container 43190ec017dcaeb639f52b4f97ee6c4d9a7d3053739f24779512b2e1ad6aedc5: Status 404 returned error can't find the container with id 43190ec017dcaeb639f52b4f97ee6c4d9a7d3053739f24779512b2e1ad6aedc5 Jun 09 11:54:57.505842 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:54:57.505675 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59cd7e49_52d7_4bdd_888a_705d6cad340e.slice/crio-85f226acc3b933b8d6803cdd4512d22d605922322b2df8bcd465a8730b0049cc WatchSource:0}: Error finding container 85f226acc3b933b8d6803cdd4512d22d605922322b2df8bcd465a8730b0049cc: Status 404 returned error can't find the container with id 85f226acc3b933b8d6803cdd4512d22d605922322b2df8bcd465a8730b0049cc Jun 09 11:54:57.585447 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.585273 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:49:56 +0000 UTC" deadline="2028-02-07 01:08:41.914362446 +0000 UTC" Jun 09 11:54:57.585546 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.585448 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14581h13m44.328918375s" Jun 09 11:54:57.622157 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.622122 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" event={"ID":"696c8cfe943a182a33032adecd257449","Type":"ContainerStarted","Data":"1706255f97439b7cb3053c8e3a7f17bf18da2605e0e32af9d50b025ae1d9c43d"} Jun 09 11:54:57.623995 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.623966 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dckx" event={"ID":"e8c408c8-8f9c-44ad-92a8-c100d05d0b80","Type":"ContainerStarted","Data":"43190ec017dcaeb639f52b4f97ee6c4d9a7d3053739f24779512b2e1ad6aedc5"} Jun 09 11:54:57.625039 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.625017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"38a7be9498c5507287b5ebe545851ab15f55b8b8d0efaf35f9e295fef63cad23"} Jun 09 11:54:57.626137 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.626107 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" event={"ID":"3f35d578-6b44-46a9-a576-117c98fdffee","Type":"ContainerStarted","Data":"fc39f522da0125e414a4ded9b0f5803d729199853dcef9b41fcb7248dc1b52eb"} Jun 09 11:54:57.627444 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.627413 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-25spp" event={"ID":"f0a7af62-383e-4c22-b8a8-e4649fed0be9","Type":"ContainerStarted","Data":"40d6ce66e0d4273a313670cb154b1c084df2bc84c7b524b933530e699953ca41"} Jun 09 11:54:57.628488 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.628459 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsbn5" event={"ID":"d083a496-f29b-4b6c-b323-25c2f663dc27","Type":"ContainerStarted","Data":"1eb5359f02eb824323f37d36520504cffb42249fdc5e76f1bd0f3ce7c931498d"} Jun 09 11:54:57.629694 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.629674 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" event={"ID":"acd8c5af-db17-461d-ac02-c5b3c56be1c9","Type":"ContainerStarted","Data":"55c71ec9b8f362b29a8d01bb3d93c556d7194b917889f5b5b9f9295bf2c17d60"} Jun 09 11:54:57.630896 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.630871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-28csz" event={"ID":"59cd7e49-52d7-4bdd-888a-705d6cad340e","Type":"ContainerStarted","Data":"85f226acc3b933b8d6803cdd4512d22d605922322b2df8bcd465a8730b0049cc"} Jun 09 11:54:57.631986 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.631967 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerStarted","Data":"443cbf5ce29c11c7602565cfe677f27fa0da632290458348836996f2cb91ebff"} Jun 09 11:54:57.635909 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.635880 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-75zr2" event={"ID":"ede206f8-ecd6-4fc1-917e-1b6d7a86148c","Type":"ContainerStarted","Data":"197e70186186460dc1d0be1d551814ab2776048995fd189ee266316b998b9879"} Jun 09 11:54:57.636222 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:57.636126 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-223.ec2.internal" podStartSLOduration=2.636115113 podStartE2EDuration="2.636115113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:57.63588729 +0000 UTC m=+3.502202097" watchObservedRunningTime="2026-06-09 11:54:57.636115113 +0000 UTC m=+3.502429919" Jun 09 11:54:58.164389 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.164294 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:58.164389 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.164373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:58.164612 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.164460 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:58.164612 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.164460 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:58.164612 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.164523 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:00.164505247 +0000 UTC m=+6.030820044 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:54:58.164612 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.164544 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:00.164533475 +0000 UTC m=+6.030848259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:54:58.265363 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.265304 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:58.265529 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.265483 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:54:58.265529 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.265506 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:54:58.265529 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.265519 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:58.265700 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.265581 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:00.265562459 +0000 UTC m=+6.131877246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:54:58.586495 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.586396 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:49:56 +0000 UTC" deadline="2028-03-27 05:14:43.372608262 +0000 UTC" Jun 09 11:54:58.586495 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.586457 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15761h19m44.786156164s" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.611888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.611888 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.612038 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.612068 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.612175 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:54:58.612381 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:54:58.612253 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:54:58.652795 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.652002 2567 generic.go:356] "Generic (PLEG): container finished" podID="c93b09a2aaaf766f7ab1a0b491fb8085" containerID="d23805c4dc12c5e7957c468f201a6cf857c986c3e5b7b16d33083e5fc160e18c" exitCode=0 Jun 09 11:54:58.653371 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:58.653145 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" event={"ID":"c93b09a2aaaf766f7ab1a0b491fb8085","Type":"ContainerDied","Data":"d23805c4dc12c5e7957c468f201a6cf857c986c3e5b7b16d33083e5fc160e18c"} Jun 09 11:54:59.699045 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:54:59.699010 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" event={"ID":"c93b09a2aaaf766f7ab1a0b491fb8085","Type":"ContainerStarted","Data":"46ec75068d38511ccfdd0836cb388e48ae808cf1b35cf6d82e9f10ea96186561"} Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.180315 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.180396 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.180543 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.180606 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.18058783 +0000 UTC m=+10.046902672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.181037 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:00.181125 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.181088 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.181071665 +0000 UTC m=+10.047386455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:00.281881 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.281193 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:00.281881 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.281426 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:00.281881 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.281445 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:00.281881 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.281457 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:00.281881 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.281522 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:04.281503107 +0000 UTC m=+10.147817913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:00.613439 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.613405 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:00.613625 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.613554 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:00.614237 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.613940 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:00.614237 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.614038 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:00.614237 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:00.614087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:00.614237 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:00.614176 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:02.615557 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:02.614897 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:02.615557 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:02.615034 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:02.615557 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:02.615419 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:02.615557 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:02.615516 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:02.616130 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:02.615654 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:02.616130 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:02.615739 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:04.213366 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.213332 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:04.213829 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.213384 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:04.213829 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.213499 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:04.213829 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.213509 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:04.213829 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.213557 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:12.213540029 +0000 UTC m=+18.079854814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:04.213829 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.213570 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:12.213564419 +0000 UTC m=+18.079879203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:04.314066 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.314026 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:04.314262 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.314210 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:04.314262 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.314230 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:04.314262 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.314238 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:04.314395 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.314288 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:12.314268585 +0000 UTC m=+18.180583371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:04.612960 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.612932 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:04.612960 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.612950 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:04.612960 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:04.612963 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:04.613233 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.613045 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:04.613233 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.613117 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:04.613233 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:04.613204 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:06.611279 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:06.611242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:06.611747 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:06.611242 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:06.611747 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:06.611386 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:06.611747 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:06.611409 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:06.611747 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:06.611499 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:06.611747 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:06.611587 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:08.611735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:08.611701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:08.612190 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:08.611819 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:08.612190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:08.611701 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:08.612190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:08.611879 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:08.612190 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:08.611970 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:08.612190 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:08.612110 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:10.612087 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:10.612054 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:10.612087 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:10.612090 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:10.612636 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:10.612055 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:10.612636 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:10.612176 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:10.612636 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:10.612251 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:10.612636 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:10.612335 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:12.274014 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.273978 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:12.274487 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.274067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:12.274487 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.274132 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:12.274487 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.274183 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:12.274487 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.274208 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:28.274186687 +0000 UTC m=+34.140501477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:12.274487 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.274236 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:28.274219151 +0000 UTC m=+34.140533937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:12.374901 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.374862 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:12.375060 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.375019 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:12.375060 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.375051 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:12.375168 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.375062 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:12.375168 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.375115 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:55:28.375102485 +0000 UTC m=+34.241417268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:12.611855 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.611743 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:12.611855 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.611818 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:12.612051 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:12.611751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:12.612051 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.611905 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:12.612051 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.612012 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:12.612171 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:12.612091 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:14.612707 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:14.612668 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:14.613224 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:14.612793 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:14.613224 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:14.612829 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:14.613224 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:14.612930 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:14.613224 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:14.612991 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:14.613224 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:14.613051 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:16.611883 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:16.611846 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:16.611883 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:16.611878 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:16.612473 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:16.611846 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:16.612473 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:16.611980 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:16.612473 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:16.612078 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:16.612473 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:16.612178 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:17.742371 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.741996 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="5be39a7b75f3f33bd7668f667933d797a8100a522da3b24f21c00293ffbd85aa" exitCode=0 Jun 09 11:55:17.743181 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.742077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"5be39a7b75f3f33bd7668f667933d797a8100a522da3b24f21c00293ffbd85aa"} Jun 09 11:55:17.744212 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.744187 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-75zr2" event={"ID":"ede206f8-ecd6-4fc1-917e-1b6d7a86148c","Type":"ContainerStarted","Data":"a118f47a6e15ad00e4fa73c70373a451c5f22e1deb1bdf959e9667bc1f9a1df0"} Jun 09 11:55:17.745699 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.745672 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dckx" event={"ID":"e8c408c8-8f9c-44ad-92a8-c100d05d0b80","Type":"ContainerStarted","Data":"b586d999d0f85af7f06b32d76f66c983b42fdff0a9f1deb568923aae7bd3eb4d"} Jun 09 11:55:17.748866 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.748840 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"0ad94cb05826bcfbce1d80f4cafd5e5b755aba0bdd015a93d7b141747eb178f4"} Jun 09 11:55:17.748995 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.748919 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"3e26973e0eab16f39a816afdce9a0d10b2dc3fd971466f05d3c5f59db27566a1"} Jun 09 11:55:17.748995 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.748952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"8d53aa64dce0210a534e55983c9b093adefba598fc4f420af77f6bdcff4dc205"} Jun 09 11:55:17.748995 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.748980 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"024236ae50f4ca38247303f4ff1d7007d830cdda0b4468cb78bb78e1659d7d0a"} Jun 09 11:55:17.749196 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.749016 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"9d573c3ac95c5f3cba3008fd874db38016f4b8d9c310c0b612b810ea2fb186e0"} Jun 09 11:55:17.749196 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.749045 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"8c434e8e2461fa0e19a7b4b4af9cc833edd301197e9389f39eac4642147b4c0c"} Jun 09 11:55:17.750575 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.750531 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" event={"ID":"3f35d578-6b44-46a9-a576-117c98fdffee","Type":"ContainerStarted","Data":"b7e2b510673a5aa5f9b4e75e3eb295c1d94ce79f7f046b42279e079499ad7e53"} Jun 09 11:55:17.753427 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.753403 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-25spp" event={"ID":"f0a7af62-383e-4c22-b8a8-e4649fed0be9","Type":"ContainerStarted","Data":"536ab1ffe9d43d14d00188c1c053a5e2314aa0a662bb2c1d884d9f9943117401"} Jun 09 11:55:17.754861 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.754841 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lsbn5" event={"ID":"d083a496-f29b-4b6c-b323-25c2f663dc27","Type":"ContainerStarted","Data":"31dc2b427e0172ece4d2fc8c896b030dbe8b5e5b01f04ae71b561bbc38c714c9"} Jun 09 11:55:17.756287 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.756268 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" event={"ID":"acd8c5af-db17-461d-ac02-c5b3c56be1c9","Type":"ContainerStarted","Data":"ea4a4a556aeb2bbaa75cd13c6375d8b68a811280b7962b9b4cec9897651262a2"} Jun 09 11:55:17.771054 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.770651 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-223.ec2.internal" podStartSLOduration=22.770630869 podStartE2EDuration="22.770630869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:59.721392802 +0000 UTC m=+5.587707609" watchObservedRunningTime="2026-06-09 11:55:17.770630869 +0000 UTC m=+23.636945677" Jun 09 11:55:17.790790 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.790125 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-75zr2" podStartSLOduration=4.35553755 podStartE2EDuration="23.790105766s" totalImagesPullingTime="19.434568216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:17.790043757 +0000 UTC m=+23.656358564" watchObservedRunningTime="2026-06-09 11:55:17.790105766 +0000 UTC m=+23.656420562" Jun 09 11:55:17.815713 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.815666 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jb7mk" podStartSLOduration=4.361829834 podStartE2EDuration="23.815648466s" totalImagesPullingTime="19.453818632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:17.813935354 +0000 UTC m=+23.680250231" watchObservedRunningTime="2026-06-09 11:55:17.815648466 +0000 UTC m=+23.681963282" Jun 09 11:55:17.832341 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.832067 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-25spp" podStartSLOduration=4.400561977 podStartE2EDuration="23.832046293s" totalImagesPullingTime="19.431484316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:17.8314983 +0000 UTC m=+23.697813145" watchObservedRunningTime="2026-06-09 11:55:17.832046293 +0000 UTC m=+23.698361111" Jun 09 11:55:17.852203 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.852120 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lsbn5" podStartSLOduration=8.660411919 podStartE2EDuration="23.852098741s" totalImagesPullingTime="15.191686822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:17.848526733 +0000 UTC m=+23.714841541" watchObservedRunningTime="2026-06-09 11:55:17.852098741 +0000 UTC m=+23.718413541" Jun 09 11:55:17.869906 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:17.869846 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5dckx" podStartSLOduration=4.394337034 podStartE2EDuration="23.869831171s" totalImagesPullingTime="19.475494137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:17.869330267 +0000 UTC m=+23.735645106" watchObservedRunningTime="2026-06-09 11:55:17.869831171 +0000 UTC m=+23.736145990" Jun 09 11:55:18.014360 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.014311 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:55:18.357859 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.357834 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:55:18.611825 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.611795 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:18.612111 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.611836 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:18.612111 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:18.611929 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:18.612111 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:18.612020 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:18.612111 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.612088 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:18.612273 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:18.612203 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:18.612719 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.612633 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:55:18.357852316Z","UUID":"4e10139a-aeef-4a00-be20-a113fffd88cf","Handler":null,"Name":"","Endpoint":""} Jun 09 11:55:18.615698 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.615680 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:55:18.615828 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.615713 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:55:18.761103 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.761023 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" event={"ID":"acd8c5af-db17-461d-ac02-c5b3c56be1c9","Type":"ContainerStarted","Data":"fdb9aae5d82276099049e4f90dec2595775f4550903b48e6bc7715ba2a678062"} Jun 09 11:55:18.762983 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.762953 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-28csz" event={"ID":"59cd7e49-52d7-4bdd-888a-705d6cad340e","Type":"ContainerStarted","Data":"50cdfb592306e6b31383f059ab1e256290e9e26c762288a4a8636c03964839bd"} Jun 09 11:55:18.780530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:18.779961 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-28csz" podStartSLOduration=5.35805212 podStartE2EDuration="24.77994207s" totalImagesPullingTime="19.42188995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:18.779426557 +0000 UTC m=+24.645741364" watchObservedRunningTime="2026-06-09 11:55:18.77994207 +0000 UTC m=+24.646256877" Jun 09 11:55:19.767819 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:19.767701 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" event={"ID":"acd8c5af-db17-461d-ac02-c5b3c56be1c9","Type":"ContainerStarted","Data":"1580f544e351158b2b1087b9a01bc7efbe279126d9f107a9af4711fbc5a5fa73"} Jun 09 11:55:19.789084 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:19.789021 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gn9fb" podStartSLOduration=4.204106974 podStartE2EDuration="25.789003511s" totalImagesPullingTime="21.584896537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:19.788261936 +0000 UTC m=+25.654576741" watchObservedRunningTime="2026-06-09 11:55:19.789003511 +0000 UTC m=+25.655318346" Jun 09 11:55:20.611716 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:20.611689 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:20.611908 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:20.611735 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:20.611908 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:20.611783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:20.611908 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:20.611828 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:20.612335 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:20.612304 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:20.612478 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:20.611921 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:20.774751 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:20.774552 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"799c6a601d2e88484c601b29a8596b2956a68266fdc5adc08d32f7c959afe4d6"} Jun 09 11:55:21.372504 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:21.372471 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:55:21.373117 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:21.373097 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:55:21.777071 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:21.777044 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lsbn5" Jun 09 11:55:22.611975 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.611789 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:22.612135 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.611794 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:22.612135 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:22.612062 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:22.612135 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.611844 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:22.612247 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:22.612119 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:22.612247 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:22.612226 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:22.782031 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.781993 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" event={"ID":"6236bdba-fde6-4ab0-8571-6f36f4beed7a","Type":"ContainerStarted","Data":"98d03e2a0d4a3a5564bf7f884819b0635d94daf3ea5567cb0e3b1c29b29f9969"} Jun 09 11:55:22.782871 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.782202 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:55:22.782871 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.782264 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:55:22.784043 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.784023 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="d061c1bec172efa0dafd2f30cfde21028ac9c993c07438ef8e052ecc18f510b9" exitCode=0 Jun 09 11:55:22.784160 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.784111 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"d061c1bec172efa0dafd2f30cfde21028ac9c993c07438ef8e052ecc18f510b9"} Jun 09 11:55:22.799050 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.799027 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:55:22.811609 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:22.811569 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" podStartSLOduration=9.302858592 podStartE2EDuration="28.811556963s" totalImagesPullingTime="19.508698371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:22.811526815 +0000 UTC m=+28.677841639" watchObservedRunningTime="2026-06-09 11:55:22.811556963 +0000 UTC m=+28.677871765" Jun 09 11:55:23.786820 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:23.786790 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:55:23.801334 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:23.801306 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:55:24.211334 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.211248 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkntp"] Jun 09 11:55:24.211490 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.211378 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:24.211557 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:24.211483 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:24.214662 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.214599 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hn75f"] Jun 09 11:55:24.214810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.214712 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:24.214905 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:24.214838 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:24.215332 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.215309 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c8f48"] Jun 09 11:55:24.215435 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.215404 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:24.215534 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:24.215478 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:24.790223 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.790187 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="4fd23b014e6ba8f46f91c5699df7c1ea1caf61392bea1fab515ffe83b4935857" exitCode=0 Jun 09 11:55:24.790615 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:24.790265 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"4fd23b014e6ba8f46f91c5699df7c1ea1caf61392bea1fab515ffe83b4935857"} Jun 09 11:55:25.611156 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:25.611128 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:25.611282 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:25.611141 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:25.611282 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:25.611261 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:25.611362 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:25.611294 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:25.795516 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:25.795332 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="d7e57df6105995decbf1587e131d41027eac36e79a49be5d8bff36cf5c8114ef" exitCode=0 Jun 09 11:55:25.795516 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:25.795415 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"d7e57df6105995decbf1587e131d41027eac36e79a49be5d8bff36cf5c8114ef"} Jun 09 11:55:26.611327 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:26.611289 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:26.611482 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:26.611446 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:27.611670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:27.611639 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:27.611670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:27.611677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:27.612183 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:27.611756 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:27.612183 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:27.611887 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:28.297722 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:28.297682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:28.297909 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:28.297752 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:28.297909 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.297860 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:28.297909 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.297886 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:28.298048 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.297927 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret podName:49fb2c18-42d5-4c83-b3f6-aac5dbfd8083 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:00.297909282 +0000 UTC m=+66.164224066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret") pod "global-pull-secret-syncer-kkntp" (UID: "49fb2c18-42d5-4c83-b3f6-aac5dbfd8083") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:55:28.298048 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.297948 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:00.29793857 +0000 UTC m=+66.164253355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:55:28.398391 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:28.398345 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:28.398563 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.398501 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:55:28.398563 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.398523 2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:55:28.398563 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.398536 2567 projected.go:196] Error preparing data for projected volume kube-api-access-9fnpq for pod openshift-network-diagnostics/network-check-target-c8f48: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:28.398711 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.398598 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq podName:e6d3ec75-f871-4fe4-80b2-35de4290d6b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:56:00.398578559 +0000 UTC m=+66.264893343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9fnpq" (UniqueName: "kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq") pod "network-check-target-c8f48" (UID: "e6d3ec75-f871-4fe4-80b2-35de4290d6b8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:55:28.612215 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:28.612137 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:28.612648 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:28.612267 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:29.611980 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:29.611943 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:29.612166 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:29.612078 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:55:29.612166 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:29.612137 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:29.612267 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:29.612240 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c8f48" podUID="e6d3ec75-f871-4fe4-80b2-35de4290d6b8" Jun 09 11:55:30.611782 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.611718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:30.611932 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:30.611862 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkntp" podUID="49fb2c18-42d5-4c83-b3f6-aac5dbfd8083" Jun 09 11:55:30.809466 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.809431 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="9c6763f79386c22d65ee66f5b23aed7bca4c94a359bd2e3cbbe0012432087bea" exitCode=0 Jun 09 11:55:30.810046 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.809475 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"9c6763f79386c22d65ee66f5b23aed7bca4c94a359bd2e3cbbe0012432087bea"} Jun 09 11:55:30.937311 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.937286 2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-223.ec2.internal" event="NodeReady" Jun 09 11:55:30.937462 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.937405 2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:55:30.986667 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.986636 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c6779"] Jun 09 11:55:30.988210 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.988195 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:30.991091 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.991071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4tn98\"" Jun 09 11:55:30.991180 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.991071 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:55:30.991344 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.991331 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:55:30.991541 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.991528 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:55:30.997480 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.997454 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jdqnq"] Jun 09 11:55:30.999266 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.999061 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:30.999780 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:30.999737 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6779"] Jun 09 11:55:31.001899 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.001876 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:55:31.001998 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.001908 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g5s4\"" Jun 09 11:55:31.001998 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.001943 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:55:31.017730 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.017704 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdqnq"] Jun 09 11:55:31.118372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-config-volume\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.118372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.118372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118346 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-tmp-dir\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.118372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118364 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d2kj\" (UniqueName: \"kubernetes.io/projected/b29effef-3c90-429b-84d5-1cd7cd4b07ee-kube-api-access-6d2kj\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.118636 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118451 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29effef-3c90-429b-84d5-1cd7cd4b07ee-cert\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.118636 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.118498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4gb\" (UniqueName: \"kubernetes.io/projected/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-kube-api-access-cz4gb\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219129 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219089 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-config-volume\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219136 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219155 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-tmp-dir\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219179 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d2kj\" (UniqueName: \"kubernetes.io/projected/b29effef-3c90-429b-84d5-1cd7cd4b07ee-kube-api-access-6d2kj\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219216 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29effef-3c90-429b-84d5-1cd7cd4b07ee-cert\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:31.219244 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:31.219281 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219260 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4gb\" (UniqueName: \"kubernetes.io/projected/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-kube-api-access-cz4gb\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219531 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:31.219317 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:55:31.71929415 +0000 UTC m=+37.585608954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:31.219582 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-tmp-dir\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.219827 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.219811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-config-volume\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.223486 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.223467 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29effef-3c90-429b-84d5-1cd7cd4b07ee-cert\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.232243 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.232220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4gb\" (UniqueName: \"kubernetes.io/projected/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-kube-api-access-cz4gb\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.232359 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.232302 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d2kj\" (UniqueName: \"kubernetes.io/projected/b29effef-3c90-429b-84d5-1cd7cd4b07ee-kube-api-access-6d2kj\") pod \"ingress-canary-c6779\" (UID: \"b29effef-3c90-429b-84d5-1cd7cd4b07ee\") " pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.296302 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.296259 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6779" Jun 09 11:55:31.429962 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.429753 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6779"] Jun 09 11:55:31.433289 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:55:31.433253 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29effef_3c90_429b_84d5_1cd7cd4b07ee.slice/crio-4602405fb4856e51c0a7c44c08540b1923b7ccc864263dfd781f198eed7c06a0 WatchSource:0}: Error finding container 4602405fb4856e51c0a7c44c08540b1923b7ccc864263dfd781f198eed7c06a0: Status 404 returned error can't find the container with id 4602405fb4856e51c0a7c44c08540b1923b7ccc864263dfd781f198eed7c06a0 Jun 09 11:55:31.611353 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.611317 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:55:31.611518 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.611321 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:55:31.614715 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.614695 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzslx\"" Jun 09 11:55:31.614838 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.614694 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:55:31.615009 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.614990 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:55:31.615082 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.615068 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:55:31.615124 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.615068 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bkch\"" Jun 09 11:55:31.722482 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.722454 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:31.722643 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:31.722610 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:31.722695 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:31.722681 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:55:32.722662664 +0000 UTC m=+38.588977447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:31.816209 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.816170 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6779" event={"ID":"b29effef-3c90-429b-84d5-1cd7cd4b07ee","Type":"ContainerStarted","Data":"4602405fb4856e51c0a7c44c08540b1923b7ccc864263dfd781f198eed7c06a0"} Jun 09 11:55:31.819745 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.819712 2567 generic.go:356] "Generic (PLEG): container finished" podID="ba081705-3921-4c66-9c79-642330c65850" containerID="f96b3ae3fb3c075dea1e4d8ab5bf05be30c1613eddca587a600b7649cab143aa" exitCode=0 Jun 09 11:55:31.819905 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:31.819757 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerDied","Data":"f96b3ae3fb3c075dea1e4d8ab5bf05be30c1613eddca587a600b7649cab143aa"} Jun 09 11:55:32.611810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:32.611772 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:55:32.614801 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:32.614755 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:55:32.730907 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:32.730867 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:32.731076 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:32.731013 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:32.731076 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:32.731071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:55:34.731054994 +0000 UTC m=+40.597369789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:32.828040 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:32.828002 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbblh" event={"ID":"ba081705-3921-4c66-9c79-642330c65850","Type":"ContainerStarted","Data":"35e27e132f1717a945a3b4b28b6f7f025d31a093411d59bb98eef41c2fc92f6e"} Jun 09 11:55:32.856402 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:32.856349 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbblh" podStartSLOduration=9.008734181 podStartE2EDuration="38.856332942s" totalImagesPullingTime="29.847598761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:32.855741675 +0000 UTC m=+38.722056499" watchObservedRunningTime="2026-06-09 11:55:32.856332942 +0000 UTC m=+38.722647744" Jun 09 11:55:33.831777 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:33.831720 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6779" event={"ID":"b29effef-3c90-429b-84d5-1cd7cd4b07ee","Type":"ContainerStarted","Data":"2f1b243f23bde1293c2fbe40b256fc3c86d7bc5c750c898163d85b0dd06e8eed"} Jun 09 11:55:33.848218 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:33.848144 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c6779" podStartSLOduration=2.375601497 podStartE2EDuration="3.84812501s" totalImagesPullingTime="1.472523513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:33.84735308 +0000 UTC m=+39.713667886" watchObservedRunningTime="2026-06-09 11:55:33.84812501 +0000 UTC m=+39.714439818" Jun 09 11:55:34.746153 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:34.746091 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:34.746326 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:34.746239 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:34.746326 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:34.746312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:55:38.746296463 +0000 UTC m=+44.612611246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:38.775921 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:38.775834 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:38.776298 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:38.776000 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:38.776298 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:38.776069 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:55:46.776053198 +0000 UTC m=+52.642367982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:46.830703 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:46.830658 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:55:46.831245 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:46.830833 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:55:46.831245 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:55:46.830906 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:56:02.830890929 +0000 UTC m=+68.697205713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:55:55.810810 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:55:55.810776 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tsk8" Jun 09 11:56:00.326883 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.326829 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:56:00.327275 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.326906 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:56:00.330046 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.330022 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:56:00.330046 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.330037 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:56:00.337528 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:00.337505 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:56:00.337623 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:00.337587 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:57:04.337563026 +0000 UTC m=+130.203877814 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : secret "metrics-daemon-secret" not found Jun 09 11:56:00.341254 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.341235 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49fb2c18-42d5-4c83-b3f6-aac5dbfd8083-original-pull-secret\") pod \"global-pull-secret-syncer-kkntp\" (UID: \"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083\") " pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:56:00.427925 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.427874 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:56:00.430926 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.430907 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:56:00.441052 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.441034 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:56:00.451709 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.451681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnpq\" (UniqueName: \"kubernetes.io/projected/e6d3ec75-f871-4fe4-80b2-35de4290d6b8-kube-api-access-9fnpq\") pod \"network-check-target-c8f48\" (UID: \"e6d3ec75-f871-4fe4-80b2-35de4290d6b8\") " pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:56:00.522830 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.522791 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkntp" Jun 09 11:56:00.646201 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.646174 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkntp"] Jun 09 11:56:00.648964 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:56:00.648936 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fb2c18_42d5_4c83_b3f6_aac5dbfd8083.slice/crio-fa3e8c2bbf0f8d32d00a1324545777356e55b501ce01c50ebe18cecdb10a4be0 WatchSource:0}: Error finding container fa3e8c2bbf0f8d32d00a1324545777356e55b501ce01c50ebe18cecdb10a4be0: Status 404 returned error can't find the container with id fa3e8c2bbf0f8d32d00a1324545777356e55b501ce01c50ebe18cecdb10a4be0 Jun 09 11:56:00.729920 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.729892 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9bkch\"" Jun 09 11:56:00.737296 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.737260 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:56:00.857441 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.857349 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c8f48"] Jun 09 11:56:00.862046 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:56:00.862017 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d3ec75_f871_4fe4_80b2_35de4290d6b8.slice/crio-fe86e87aaae44c74493238216e9bc15ca7a6ef1381d4e88abe46779b5d36d5b7 WatchSource:0}: Error finding container fe86e87aaae44c74493238216e9bc15ca7a6ef1381d4e88abe46779b5d36d5b7: Status 404 returned error can't find the container with id fe86e87aaae44c74493238216e9bc15ca7a6ef1381d4e88abe46779b5d36d5b7 Jun 09 11:56:00.890583 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.890541 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c8f48" event={"ID":"e6d3ec75-f871-4fe4-80b2-35de4290d6b8","Type":"ContainerStarted","Data":"fe86e87aaae44c74493238216e9bc15ca7a6ef1381d4e88abe46779b5d36d5b7"} Jun 09 11:56:00.891555 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:00.891532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kkntp" event={"ID":"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083","Type":"ContainerStarted","Data":"fa3e8c2bbf0f8d32d00a1324545777356e55b501ce01c50ebe18cecdb10a4be0"} Jun 09 11:56:02.842738 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:02.842698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:56:02.843137 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:02.842902 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:02.843137 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:02.842978 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:56:34.842961447 +0000 UTC m=+100.709276232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:56:03.972588 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.972558 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc"] Jun 09 11:56:03.985119 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.985089 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:03.987436 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.987409 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc"] Jun 09 11:56:03.988580 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.988398 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 11:56:03.988580 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.988495 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 11:56:03.989918 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.989691 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 11:56:03.989918 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:03.989735 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 11:56:04.049632 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.049588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5342b49a-5ec7-41c5-a423-4bfb92fb0046-klusterlet-config\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.049632 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.049635 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5342b49a-5ec7-41c5-a423-4bfb92fb0046-tmp\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.049873 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.049743 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzx96\" (UniqueName: \"kubernetes.io/projected/5342b49a-5ec7-41c5-a423-4bfb92fb0046-kube-api-access-kzx96\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.150538 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.150507 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5342b49a-5ec7-41c5-a423-4bfb92fb0046-tmp\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.150731 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.150568 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzx96\" (UniqueName: \"kubernetes.io/projected/5342b49a-5ec7-41c5-a423-4bfb92fb0046-kube-api-access-kzx96\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.150731 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.150636 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5342b49a-5ec7-41c5-a423-4bfb92fb0046-klusterlet-config\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.151018 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.150979 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5342b49a-5ec7-41c5-a423-4bfb92fb0046-tmp\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.153587 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.153566 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5342b49a-5ec7-41c5-a423-4bfb92fb0046-klusterlet-config\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.159743 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.159718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzx96\" (UniqueName: \"kubernetes.io/projected/5342b49a-5ec7-41c5-a423-4bfb92fb0046-kube-api-access-kzx96\") pod \"klusterlet-addon-workmgr-b44975f6f-qzlbc\" (UID: \"5342b49a-5ec7-41c5-a423-4bfb92fb0046\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:04.296776 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:04.296681 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:05.394434 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.394408 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc"] Jun 09 11:56:05.398139 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:56:05.398112 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5342b49a_5ec7_41c5_a423_4bfb92fb0046.slice/crio-3309947aafe715ee50d1075fea79c1eedeebd71bb868edd958c82d4cc8e1ff7b WatchSource:0}: Error finding container 3309947aafe715ee50d1075fea79c1eedeebd71bb868edd958c82d4cc8e1ff7b: Status 404 returned error can't find the container with id 3309947aafe715ee50d1075fea79c1eedeebd71bb868edd958c82d4cc8e1ff7b Jun 09 11:56:05.907178 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.907136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kkntp" event={"ID":"49fb2c18-42d5-4c83-b3f6-aac5dbfd8083","Type":"ContainerStarted","Data":"acb46f1f87e1a375127f28d83fd7ed35d00ac50d428b587f4f9b9d695f642f63"} Jun 09 11:56:05.908177 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.908149 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" event={"ID":"5342b49a-5ec7-41c5-a423-4bfb92fb0046","Type":"ContainerStarted","Data":"3309947aafe715ee50d1075fea79c1eedeebd71bb868edd958c82d4cc8e1ff7b"} Jun 09 11:56:05.909326 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.909306 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c8f48" event={"ID":"e6d3ec75-f871-4fe4-80b2-35de4290d6b8","Type":"ContainerStarted","Data":"53a4d5d2d4b488b1f64dad46873a7fe658db5a23a8cb6ff91a24a325a2b97816"} Jun 09 11:56:05.909459 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.909448 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:56:05.923178 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.923131 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kkntp" podStartSLOduration=67.303582318 podStartE2EDuration="1m11.923114721s" totalImagesPullingTime="4.619532403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:05.922579847 +0000 UTC m=+71.788894652" watchObservedRunningTime="2026-06-09 11:56:05.923114721 +0000 UTC m=+71.789429528" Jun 09 11:56:05.939542 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:05.939501 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c8f48" podStartSLOduration=67.538337392 podStartE2EDuration="1m11.939490193s" totalImagesPullingTime="4.401152801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:05.93897241 +0000 UTC m=+71.805287215" watchObservedRunningTime="2026-06-09 11:56:05.939490193 +0000 UTC m=+71.805804999" Jun 09 11:56:14.933346 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:14.933308 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" event={"ID":"5342b49a-5ec7-41c5-a423-4bfb92fb0046","Type":"ContainerStarted","Data":"66190907d31daf97070cc9d1db147c4d8c537fd857ae0c6ecd935590b7dafaa1"} Jun 09 11:56:14.933665 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:14.933543 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:14.934794 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:14.934746 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" podUID="5342b49a-5ec7-41c5-a423-4bfb92fb0046" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 09 11:56:14.952128 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:14.952075 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" podStartSLOduration=2.488153702 podStartE2EDuration="11.952052803s" totalImagesPullingTime="9.463899101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:14.951234351 +0000 UTC m=+80.817549168" watchObservedRunningTime="2026-06-09 11:56:14.952052803 +0000 UTC m=+80.818367608" Jun 09 11:56:15.937308 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:15.937282 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:56:34.851623 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:34.851580 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:56:34.852057 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:34.851714 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:56:34.852057 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:56:34.851794 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:57:38.851778536 +0000 UTC m=+164.718093324 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:56:36.914881 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:56:36.914853 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c8f48" Jun 09 11:57:04.348827 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:57:04.348785 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:57:04.349316 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:04.348918 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:57:04.349316 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:04.348991 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.348975321 +0000 UTC m=+252.215290107 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : secret "metrics-daemon-secret" not found Jun 09 11:57:34.007963 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:34.007923 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jdqnq" podUID="f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a" Jun 09 11:57:34.124636 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:57:34.124601 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:57:34.621835 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:34.621797 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:57:38.872967 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:57:38.872918 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:57:38.873442 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:38.873090 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:57:38.873442 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:57:38.873178 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls podName:f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a nodeName:}" failed. No retries permitted until 2026-06-09 11:59:40.873162058 +0000 UTC m=+286.739476842 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls") pod "dns-default-jdqnq" (UID: "f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a") : secret "dns-default-metrics-tls" not found Jun 09 11:57:49.611925 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:57:49.611837 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:58:15.225297 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:15.225260 2567 generic.go:356] "Generic (PLEG): container finished" podID="5342b49a-5ec7-41c5-a423-4bfb92fb0046" containerID="66190907d31daf97070cc9d1db147c4d8c537fd857ae0c6ecd935590b7dafaa1" exitCode=1 Jun 09 11:58:15.225674 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:15.225327 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" event={"ID":"5342b49a-5ec7-41c5-a423-4bfb92fb0046","Type":"ContainerDied","Data":"66190907d31daf97070cc9d1db147c4d8c537fd857ae0c6ecd935590b7dafaa1"} Jun 09 11:58:15.225674 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:15.225645 2567 scope.go:117] "RemoveContainer" containerID="66190907d31daf97070cc9d1db147c4d8c537fd857ae0c6ecd935590b7dafaa1" Jun 09 11:58:15.937062 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:15.937023 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:58:16.229140 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:16.229109 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" event={"ID":"5342b49a-5ec7-41c5-a423-4bfb92fb0046","Type":"ContainerStarted","Data":"a0183edfffe5528448ec8c421a2bfc31d918d712cd0e9de82639fc64fee54e42"} Jun 09 11:58:16.229530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:16.229316 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:58:16.229909 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:58:16.229889 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b44975f6f-qzlbc" Jun 09 11:59:05.957566 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.957530 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n"] Jun 09 11:59:05.960716 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.960700 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" Jun 09 11:59:05.963753 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.963730 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:05.964949 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.964934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:05.965000 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.964965 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qhx7p\"" Jun 09 11:59:05.973227 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:05.973204 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n"] Jun 09 11:59:06.028694 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.028665 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8"] Jun 09 11:59:06.031294 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.031280 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.034439 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.034414 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:06.034545 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.034418 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:06.034638 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.034568 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 11:59:06.034693 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.034668 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6rsc5\"" Jun 09 11:59:06.035262 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.035242 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 11:59:06.038307 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.038288 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4"] Jun 09 11:59:06.040923 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.040907 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.042727 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.042706 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8"] Jun 09 11:59:06.046942 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.046922 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 09 11:59:06.047081 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.046952 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:06.047081 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.046966 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cfhz8\"" Jun 09 11:59:06.049677 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.049660 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 09 11:59:06.055187 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.055164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwntz\" (UniqueName: \"kubernetes.io/projected/d4c2e16c-7193-4f7f-953b-7d8e5b7bf621-kube-api-access-wwntz\") pod \"volume-data-source-validator-78dd696465-z6l8n\" (UID: \"d4c2e16c-7193-4f7f-953b-7d8e5b7bf621\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" Jun 09 11:59:06.060131 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.060110 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4"] Jun 09 11:59:06.132904 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.132876 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx"] Jun 09 11:59:06.135551 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.135533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.136870 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.136850 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 11:59:06.138573 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.138558 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 11:59:06.139043 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.139028 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 11:59:06.139043 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.139034 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7dwq8\"" Jun 09 11:59:06.139694 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.139678 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.143256 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.143235 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:59:06.143351 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.143288 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:59:06.143351 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.143297 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:59:06.143550 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.143531 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qdxx\"" Jun 09 11:59:06.148318 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.148300 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx"] Jun 09 11:59:06.150377 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.150360 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:59:06.152335 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.152315 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 11:59:06.155945 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.155924 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.156035 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.155976 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqgql\" (UniqueName: \"kubernetes.io/projected/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-kube-api-access-sqgql\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.156088 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.156043 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwntz\" (UniqueName: \"kubernetes.io/projected/d4c2e16c-7193-4f7f-953b-7d8e5b7bf621-kube-api-access-wwntz\") pod \"volume-data-source-validator-78dd696465-z6l8n\" (UID: \"d4c2e16c-7193-4f7f-953b-7d8e5b7bf621\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" Jun 09 11:59:06.156088 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.156074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.156200 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.156114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvfsz\" (UniqueName: \"kubernetes.io/projected/551a4a04-79d0-4eae-9b3d-4a045a538c6f-kube-api-access-vvfsz\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.156200 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.156134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-config\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.164253 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.164236 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwntz\" (UniqueName: \"kubernetes.io/projected/d4c2e16c-7193-4f7f-953b-7d8e5b7bf621-kube-api-access-wwntz\") pod \"volume-data-source-validator-78dd696465-z6l8n\" (UID: \"d4c2e16c-7193-4f7f-953b-7d8e5b7bf621\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" Jun 09 11:59:06.256891 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.256864 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.256897 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.256918 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6blm4\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.256939 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.257037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.256985 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqgql\" (UniqueName: \"kubernetes.io/projected/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-kube-api-access-sqgql\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.257037 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257000 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.257227 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.257079 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:06.257227 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.257143 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls podName:551a4a04-79d0-4eae-9b3d-4a045a538c6f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.757124339 +0000 UTC m=+252.623439123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-cxsk4" (UID: "551a4a04-79d0-4eae-9b3d-4a045a538c6f") : secret "samples-operator-tls" not found Jun 09 11:59:06.257227 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257187 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.257227 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257220 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257245 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54727fd7-e573-4d34-b317-1349a79e35b8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.257372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257355 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvfsz\" (UniqueName: \"kubernetes.io/projected/551a4a04-79d0-4eae-9b3d-4a045a538c6f-kube-api-access-vvfsz\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.257372 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257370 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257538 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257394 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-config\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.257538 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257498 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.257873 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.257858 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-config\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.259438 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.259420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.266636 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.266611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvfsz\" (UniqueName: \"kubernetes.io/projected/551a4a04-79d0-4eae-9b3d-4a045a538c6f-kube-api-access-vvfsz\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.266743 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.266688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqgql\" (UniqueName: \"kubernetes.io/projected/c35ac08c-44dc-4bee-b64e-c5fc18fd998d-kube-api-access-sqgql\") pod \"service-ca-operator-6bc5ff68f5-jc7g8\" (UID: \"c35ac08c-44dc-4bee-b64e-c5fc18fd998d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.269547 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.269522 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" Jun 09 11:59:06.339877 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.339845 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" Jun 09 11:59:06.357887 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.357859 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.358006 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.357905 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 11:59:06.358063 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358020 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:59:06.358063 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358023 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:06.358150 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358078 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs podName:6d4682ac-9b0f-41d2-b47f-561c4dee9522 nodeName:}" failed. No retries permitted until 2026-06-09 12:01:08.358058436 +0000 UTC m=+374.224373236 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs") pod "network-metrics-daemon-hn75f" (UID: "6d4682ac-9b0f-41d2-b47f-561c4dee9522") : secret "metrics-daemon-secret" not found Jun 09 11:59:06.358150 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358106 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.858084779 +0000 UTC m=+252.724399583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:06.358150 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358131 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358297 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358165 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358297 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358189 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358297 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358230 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54727fd7-e573-4d34-b317-1349a79e35b8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.358297 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358265 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358424 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358300 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358424 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358330 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358424 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358359 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358424 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358392 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6blm4\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.358573 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358495 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:06.358573 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358510 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76455ddf5f-wrnkw: secret "image-registry-tls" not found Jun 09 11:59:06.358573 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.358548 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls podName:d27b8808-5bde-4f22-8952-4e1fe7cab9be nodeName:}" failed. No retries permitted until 2026-06-09 11:59:06.858535603 +0000 UTC m=+252.724850390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls") pod "image-registry-76455ddf5f-wrnkw" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be") : secret "image-registry-tls" not found Jun 09 11:59:06.358573 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.358543 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.359468 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.359096 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.359468 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.359408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.359724 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.359694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/54727fd7-e573-4d34-b317-1349a79e35b8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.361753 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.361710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.361753 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.361727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.370274 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.370216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.370274 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.370229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6blm4\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.394670 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.394640 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n"] Jun 09 11:59:06.398411 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:06.398386 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c2e16c_7193_4f7f_953b_7d8e5b7bf621.slice/crio-3ae369b37932db2f5d092e082a32600e278c0272b8a3caf3b5456f4156288f3c WatchSource:0}: Error finding container 3ae369b37932db2f5d092e082a32600e278c0272b8a3caf3b5456f4156288f3c: Status 404 returned error can't find the container with id 3ae369b37932db2f5d092e082a32600e278c0272b8a3caf3b5456f4156288f3c Jun 09 11:59:06.465904 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.465877 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8"] Jun 09 11:59:06.468829 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:06.468804 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35ac08c_44dc_4bee_b64e_c5fc18fd998d.slice/crio-51ffffc35d065086adb166d63daae5d1c8fca4479ca8974c10eb7598c8131636 WatchSource:0}: Error finding container 51ffffc35d065086adb166d63daae5d1c8fca4479ca8974c10eb7598c8131636: Status 404 returned error can't find the container with id 51ffffc35d065086adb166d63daae5d1c8fca4479ca8974c10eb7598c8131636 Jun 09 11:59:06.761919 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.761891 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:06.762077 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.762029 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:06.762115 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.762088 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls podName:551a4a04-79d0-4eae-9b3d-4a045a538c6f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.762072717 +0000 UTC m=+253.628387505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-cxsk4" (UID: "551a4a04-79d0-4eae-9b3d-4a045a538c6f") : secret "samples-operator-tls" not found Jun 09 11:59:06.862315 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.862275 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:06.862509 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:06.862381 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:06.862509 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.862444 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:06.862509 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.862468 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76455ddf5f-wrnkw: secret "image-registry-tls" not found Jun 09 11:59:06.862509 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.862501 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:06.862690 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.862530 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls podName:d27b8808-5bde-4f22-8952-4e1fe7cab9be nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.86250665 +0000 UTC m=+253.728821441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls") pod "image-registry-76455ddf5f-wrnkw" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be") : secret "image-registry-tls" not found Jun 09 11:59:06.862690 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:06.862559 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:07.862541663 +0000 UTC m=+253.728856464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:07.362431 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:07.362394 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" event={"ID":"c35ac08c-44dc-4bee-b64e-c5fc18fd998d","Type":"ContainerStarted","Data":"51ffffc35d065086adb166d63daae5d1c8fca4479ca8974c10eb7598c8131636"} Jun 09 11:59:07.363579 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:07.363556 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" event={"ID":"d4c2e16c-7193-4f7f-953b-7d8e5b7bf621","Type":"ContainerStarted","Data":"3ae369b37932db2f5d092e082a32600e278c0272b8a3caf3b5456f4156288f3c"} Jun 09 11:59:07.772407 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:07.772367 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:07.772572 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.772550 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:07.772645 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.772633 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls podName:551a4a04-79d0-4eae-9b3d-4a045a538c6f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.772612571 +0000 UTC m=+255.638927361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-cxsk4" (UID: "551a4a04-79d0-4eae-9b3d-4a045a538c6f") : secret "samples-operator-tls" not found Jun 09 11:59:07.873035 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:07.872996 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:07.873226 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:07.873067 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:07.873226 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.873180 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:07.873226 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.873216 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:07.873385 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.873231 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76455ddf5f-wrnkw: secret "image-registry-tls" not found Jun 09 11:59:07.873385 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.873261 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.873237614 +0000 UTC m=+255.739552397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:07.873385 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:07.873282 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls podName:d27b8808-5bde-4f22-8952-4e1fe7cab9be nodeName:}" failed. No retries permitted until 2026-06-09 11:59:09.873271988 +0000 UTC m=+255.739586775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls") pod "image-registry-76455ddf5f-wrnkw" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be") : secret "image-registry-tls" not found Jun 09 11:59:08.368367 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:08.368328 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" event={"ID":"c35ac08c-44dc-4bee-b64e-c5fc18fd998d","Type":"ContainerStarted","Data":"e571ed12d1ff4b739199d02aa405b7263548f80f5c95c6456195e97a9b23b43a"} Jun 09 11:59:08.369743 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:08.369718 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" event={"ID":"d4c2e16c-7193-4f7f-953b-7d8e5b7bf621","Type":"ContainerStarted","Data":"7aade7a338c9b3f912337c63c2ce6d422eb96cd50e98fad74cc3e2a42d210b14"} Jun 09 11:59:08.385975 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:08.385718 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" podStartSLOduration=0.598819611 podStartE2EDuration="2.385703368s" totalImagesPullingTime="1.786883757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:08.385616985 +0000 UTC m=+254.251931804" watchObservedRunningTime="2026-06-09 11:59:08.385703368 +0000 UTC m=+254.252018175" Jun 09 11:59:08.404846 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:08.404798 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-z6l8n" podStartSLOduration=2.469164763 podStartE2EDuration="3.40478047s" totalImagesPullingTime="935.615707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:08.403913692 +0000 UTC m=+254.270228499" watchObservedRunningTime="2026-06-09 11:59:08.40478047 +0000 UTC m=+254.271095269" Jun 09 11:59:09.788070 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:09.788038 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:09.788421 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.788188 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:09.788421 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.788251 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls podName:551a4a04-79d0-4eae-9b3d-4a045a538c6f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.788233539 +0000 UTC m=+259.654548325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-cxsk4" (UID: "551a4a04-79d0-4eae-9b3d-4a045a538c6f") : secret "samples-operator-tls" not found Jun 09 11:59:09.889403 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:09.889372 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:09.889487 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:09.889456 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:09.889523 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.889497 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:09.889555 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.889548 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.889534768 +0000 UTC m=+259.755849552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:09.889598 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.889574 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:09.889598 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.889589 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76455ddf5f-wrnkw: secret "image-registry-tls" not found Jun 09 11:59:09.889655 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:09.889637 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls podName:d27b8808-5bde-4f22-8952-4e1fe7cab9be nodeName:}" failed. No retries permitted until 2026-06-09 11:59:13.889621851 +0000 UTC m=+259.755936639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls") pod "image-registry-76455ddf5f-wrnkw" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be") : secret "image-registry-tls" not found Jun 09 11:59:12.018687 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.018645 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf"] Jun 09 11:59:12.021456 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.021439 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" Jun 09 11:59:12.024251 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.024233 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 09 11:59:12.024251 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.024240 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 09 11:59:12.024397 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.024280 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dj7jh\"" Jun 09 11:59:12.032643 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.032619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf"] Jun 09 11:59:12.104862 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.104828 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvzm\" (UniqueName: \"kubernetes.io/projected/7ac6946e-d770-4c92-9fe2-feecf006a4d4-kube-api-access-hlvzm\") pod \"migrator-955ffdf5f-zzgnf\" (UID: \"7ac6946e-d770-4c92-9fe2-feecf006a4d4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" Jun 09 11:59:12.206118 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.206070 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvzm\" (UniqueName: \"kubernetes.io/projected/7ac6946e-d770-4c92-9fe2-feecf006a4d4-kube-api-access-hlvzm\") pod \"migrator-955ffdf5f-zzgnf\" (UID: \"7ac6946e-d770-4c92-9fe2-feecf006a4d4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" Jun 09 11:59:12.215987 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.215954 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvzm\" (UniqueName: \"kubernetes.io/projected/7ac6946e-d770-4c92-9fe2-feecf006a4d4-kube-api-access-hlvzm\") pod \"migrator-955ffdf5f-zzgnf\" (UID: \"7ac6946e-d770-4c92-9fe2-feecf006a4d4\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" Jun 09 11:59:12.329924 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.329815 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" Jun 09 11:59:12.451303 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:12.451272 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf"] Jun 09 11:59:12.454025 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:12.453988 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac6946e_d770_4c92_9fe2_feecf006a4d4.slice/crio-2495b11f6c527ee9de504a82ef372e1da8d6143adeea56c24d0222e8bb45017d WatchSource:0}: Error finding container 2495b11f6c527ee9de504a82ef372e1da8d6143adeea56c24d0222e8bb45017d: Status 404 returned error can't find the container with id 2495b11f6c527ee9de504a82ef372e1da8d6143adeea56c24d0222e8bb45017d Jun 09 11:59:13.385116 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:13.385077 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" event={"ID":"7ac6946e-d770-4c92-9fe2-feecf006a4d4","Type":"ContainerStarted","Data":"2495b11f6c527ee9de504a82ef372e1da8d6143adeea56c24d0222e8bb45017d"} Jun 09 11:59:13.455514 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:13.455488 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-75zr2_ede206f8-ecd6-4fc1-917e-1b6d7a86148c/dns-node-resolver/0.log" Jun 09 11:59:13.820830 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:13.820801 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:13.820977 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.820902 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 09 11:59:13.820977 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.820952 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls podName:551a4a04-79d0-4eae-9b3d-4a045a538c6f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.820937968 +0000 UTC m=+267.687252752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-cxsk4" (UID: "551a4a04-79d0-4eae-9b3d-4a045a538c6f") : secret "samples-operator-tls" not found Jun 09 11:59:13.921553 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:13.921523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:13.921709 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:13.921576 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:13.921709 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.921669 2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:59:13.921709 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.921679 2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76455ddf5f-wrnkw: secret "image-registry-tls" not found Jun 09 11:59:13.921709 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.921680 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:13.921896 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.921723 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls podName:d27b8808-5bde-4f22-8952-4e1fe7cab9be nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.921709789 +0000 UTC m=+267.788024575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls") pod "image-registry-76455ddf5f-wrnkw" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be") : secret "image-registry-tls" not found Jun 09 11:59:13.921896 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:13.921747 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:21.92172822 +0000 UTC m=+267.788043004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:14.390445 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:14.390408 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" event={"ID":"7ac6946e-d770-4c92-9fe2-feecf006a4d4","Type":"ContainerStarted","Data":"d30bb518b564db648ec5d107feb3a3c1ba4965f451ce161d34bcbc28e216e799"} Jun 09 11:59:14.390824 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:14.390456 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" event={"ID":"7ac6946e-d770-4c92-9fe2-feecf006a4d4","Type":"ContainerStarted","Data":"8ff5188431abf180bc967e3cddc97e46cec2128be8652ea663a90b2305e1602b"} Jun 09 11:59:14.409123 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:14.409076 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-zzgnf" podStartSLOduration=1.436425345 podStartE2EDuration="2.40906401s" totalImagesPullingTime="972.638665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:14.408119519 +0000 UTC m=+260.274434343" watchObservedRunningTime="2026-06-09 11:59:14.40906401 +0000 UTC m=+260.275378816" Jun 09 11:59:14.456737 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:14.456713 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-25spp_f0a7af62-383e-4c22-b8a8-e4649fed0be9/node-ca/0.log" Jun 09 11:59:15.254344 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:15.254316 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6779_b29effef-3c90-429b-84d5-1cd7cd4b07ee/serve-healthcheck-canary/0.log" Jun 09 11:59:21.883208 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.883171 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:21.885714 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.885693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/551a4a04-79d0-4eae-9b3d-4a045a538c6f-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-cxsk4\" (UID: \"551a4a04-79d0-4eae-9b3d-4a045a538c6f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:21.948662 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.948635 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" Jun 09 11:59:21.984008 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.983976 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:21.984164 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.984044 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:21.984164 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:21.984143 2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:59:21.984238 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:21.984205 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert podName:54727fd7-e573-4d34-b317-1349a79e35b8 nodeName:}" failed. No retries permitted until 2026-06-09 11:59:37.984189565 +0000 UTC m=+283.850504348 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-df6mx" (UID: "54727fd7-e573-4d34-b317-1349a79e35b8") : secret "networking-console-plugin-cert" not found Jun 09 11:59:21.986664 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:21.986615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"image-registry-76455ddf5f-wrnkw\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:22.052213 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.052182 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:22.074974 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.074945 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4"] Jun 09 11:59:22.180597 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.180493 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 11:59:22.183262 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:22.183231 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27b8808_5bde_4f22_8952_4e1fe7cab9be.slice/crio-29074b9829ce6f0c998f6d477c6138806fdae05b1ee817698465ccebc805d0c2 WatchSource:0}: Error finding container 29074b9829ce6f0c998f6d477c6138806fdae05b1ee817698465ccebc805d0c2: Status 404 returned error can't find the container with id 29074b9829ce6f0c998f6d477c6138806fdae05b1ee817698465ccebc805d0c2 Jun 09 11:59:22.416464 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.416430 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" event={"ID":"d27b8808-5bde-4f22-8952-4e1fe7cab9be","Type":"ContainerStarted","Data":"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d"} Jun 09 11:59:22.416693 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.416497 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:22.416693 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.416518 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" event={"ID":"d27b8808-5bde-4f22-8952-4e1fe7cab9be","Type":"ContainerStarted","Data":"29074b9829ce6f0c998f6d477c6138806fdae05b1ee817698465ccebc805d0c2"} Jun 09 11:59:22.417601 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.417569 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" event={"ID":"551a4a04-79d0-4eae-9b3d-4a045a538c6f","Type":"ContainerStarted","Data":"eeb603d0e88edaed87b7ff2733f2197c17a208c47f48ae1d5c6a5160f5fe3150"} Jun 09 11:59:22.436435 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:22.436343 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" podStartSLOduration=16.436322729 podStartE2EDuration="16.436322729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:22.435606565 +0000 UTC m=+268.301921401" watchObservedRunningTime="2026-06-09 11:59:22.436322729 +0000 UTC m=+268.302637538" Jun 09 11:59:24.425589 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:24.425553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" event={"ID":"551a4a04-79d0-4eae-9b3d-4a045a538c6f","Type":"ContainerStarted","Data":"d790f0412a827872c0b943a108daa55838f103bf340101010d3bf048ed28dcde"} Jun 09 11:59:24.425964 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:24.425617 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" event={"ID":"551a4a04-79d0-4eae-9b3d-4a045a538c6f","Type":"ContainerStarted","Data":"191e023762d73b49922487f68dfbd81f1cd1ee0bdbae36b5c1ae85590c79903d"} Jun 09 11:59:24.446781 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:24.444908 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-cxsk4" podStartSLOduration=16.835463726 podStartE2EDuration="18.444889312s" totalImagesPullingTime="1.609425586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:24.442957794 +0000 UTC m=+270.309272600" watchObservedRunningTime="2026-06-09 11:59:24.444889312 +0000 UTC m=+270.311204120" Jun 09 11:59:33.563600 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.563562 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h4bjz"] Jun 09 11:59:33.571772 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.571732 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.576737 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.576716 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:59:33.577910 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.577783 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:59:33.578212 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.578105 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fgjb4\"" Jun 09 11:59:33.578212 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.578144 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:59:33.578212 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.578156 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:59:33.605493 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.605468 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4bjz"] Jun 09 11:59:33.648468 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.648443 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 11:59:33.707497 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.707373 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fb7c8d6f-88gfs"] Jun 09 11:59:33.711194 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.711176 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.723910 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.723880 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb7c8d6f-88gfs"] Jun 09 11:59:33.765167 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.765141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-674l8\" (UniqueName: \"kubernetes.io/projected/0c65e2a6-7966-432f-acb5-539583bb6101-kube-api-access-674l8\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.765282 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.765172 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c65e2a6-7966-432f-acb5-539583bb6101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.765282 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.765207 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c65e2a6-7966-432f-acb5-539583bb6101-crio-socket\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.765375 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.765295 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c65e2a6-7966-432f-acb5-539583bb6101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.765416 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.765369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c65e2a6-7966-432f-acb5-539583bb6101-data-volume\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.865695 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-trusted-ca\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.865695 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865660 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-674l8\" (UniqueName: \"kubernetes.io/projected/0c65e2a6-7966-432f-acb5-539583bb6101-kube-api-access-674l8\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.865695 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865692 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c65e2a6-7966-432f-acb5-539583bb6101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.865948 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-image-registry-private-configuration\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.865948 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865845 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c65e2a6-7966-432f-acb5-539583bb6101-crio-socket\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.865948 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-installation-pull-secrets\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.865948 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865922 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c65e2a6-7966-432f-acb5-539583bb6101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.865948 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865938 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c65e2a6-7966-432f-acb5-539583bb6101-crio-socket\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865948 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-bound-sa-token\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.865983 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmlgf\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-kube-api-access-rmlgf\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-ca-trust-extracted\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866033 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-tls\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866068 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c65e2a6-7966-432f-acb5-539583bb6101-data-volume\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.866190 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866084 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-certificates\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.866436 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c65e2a6-7966-432f-acb5-539583bb6101-data-volume\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.866436 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.866297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c65e2a6-7966-432f-acb5-539583bb6101-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.868053 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.868035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c65e2a6-7966-432f-acb5-539583bb6101-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.877743 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.877710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-674l8\" (UniqueName: \"kubernetes.io/projected/0c65e2a6-7966-432f-acb5-539583bb6101-kube-api-access-674l8\") pod \"insights-runtime-extractor-h4bjz\" (UID: \"0c65e2a6-7966-432f-acb5-539583bb6101\") " pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.880548 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.880533 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4bjz" Jun 09 11:59:33.967467 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967433 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-bound-sa-token\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967467 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967464 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmlgf\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-kube-api-access-rmlgf\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967663 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967502 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-ca-trust-extracted\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967663 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-tls\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967663 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967545 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-certificates\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967663 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-trusted-ca\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967663 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967633 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-image-registry-private-configuration\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.967934 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967678 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-installation-pull-secrets\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.968002 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.967977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-ca-trust-extracted\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.968894 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.968742 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-certificates\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.969124 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.969102 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-trusted-ca\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.970530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.970504 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-installation-pull-secrets\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.970632 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.970593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-image-registry-private-configuration\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.970827 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.970796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-registry-tls\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.977005 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.976984 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-bound-sa-token\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:33.977215 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:33.977193 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmlgf\" (UniqueName: \"kubernetes.io/projected/5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53-kube-api-access-rmlgf\") pod \"image-registry-7fb7c8d6f-88gfs\" (UID: \"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53\") " pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:34.008115 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.008084 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4bjz"] Jun 09 11:59:34.010905 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:34.010884 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c65e2a6_7966_432f_acb5_539583bb6101.slice/crio-bbd83a3ff8ae1e3ed1527940483d7b1514111f91c55b7da1a3f77ffa651ff373 WatchSource:0}: Error finding container bbd83a3ff8ae1e3ed1527940483d7b1514111f91c55b7da1a3f77ffa651ff373: Status 404 returned error can't find the container with id bbd83a3ff8ae1e3ed1527940483d7b1514111f91c55b7da1a3f77ffa651ff373 Jun 09 11:59:34.020514 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.020495 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:34.156224 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.156149 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fb7c8d6f-88gfs"] Jun 09 11:59:34.158684 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:34.158651 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eaa90d1_ffa2_4d1f_92c1_3faa1a3c4d53.slice/crio-13f90221a6796718a9dd8b2006c8e8908a091377af67347b16e27665c2b86289 WatchSource:0}: Error finding container 13f90221a6796718a9dd8b2006c8e8908a091377af67347b16e27665c2b86289: Status 404 returned error can't find the container with id 13f90221a6796718a9dd8b2006c8e8908a091377af67347b16e27665c2b86289 Jun 09 11:59:34.455738 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.455660 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" event={"ID":"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53","Type":"ContainerStarted","Data":"e517b2f52dfcd8a024d63f3cae5ef9411732efce489adbe22cb07367ff28a652"} Jun 09 11:59:34.455738 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.455714 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" event={"ID":"5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53","Type":"ContainerStarted","Data":"13f90221a6796718a9dd8b2006c8e8908a091377af67347b16e27665c2b86289"} Jun 09 11:59:34.456140 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.455789 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:34.457339 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.457316 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4bjz" event={"ID":"0c65e2a6-7966-432f-acb5-539583bb6101","Type":"ContainerStarted","Data":"66338259100d0d35ae3dc9fc8ab00c0370b3d43e4371e806958192870ad6f92e"} Jun 09 11:59:34.457452 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.457354 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4bjz" event={"ID":"0c65e2a6-7966-432f-acb5-539583bb6101","Type":"ContainerStarted","Data":"bbd83a3ff8ae1e3ed1527940483d7b1514111f91c55b7da1a3f77ffa651ff373"} Jun 09 11:59:34.477752 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:34.477704 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" podStartSLOduration=1.4776907989999999 podStartE2EDuration="1.477690799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:34.4767128 +0000 UTC m=+280.343027631" watchObservedRunningTime="2026-06-09 11:59:34.477690799 +0000 UTC m=+280.344005604" Jun 09 11:59:35.463727 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:35.463690 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4bjz" event={"ID":"0c65e2a6-7966-432f-acb5-539583bb6101","Type":"ContainerStarted","Data":"413ea21f7ba5878be541ee0c163abc57d32d1eba493f2828253f3190de585a48"} Jun 09 11:59:36.471179 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:36.471140 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4bjz" event={"ID":"0c65e2a6-7966-432f-acb5-539583bb6101","Type":"ContainerStarted","Data":"e1406bf85922b79fe58d0fa661881c5227f772ebb6228260b1df348a7aa2f764"} Jun 09 11:59:36.492218 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:36.492145 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h4bjz" podStartSLOduration=1.387583757 podStartE2EDuration="3.492132487s" totalImagesPullingTime="2.10454873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:36.491299704 +0000 UTC m=+282.357614511" watchObservedRunningTime="2026-06-09 11:59:36.492132487 +0000 UTC m=+282.358447292" Jun 09 11:59:37.125803 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:37.125751 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jdqnq" podUID="f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a" Jun 09 11:59:37.474109 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:37.474082 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:37.999238 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:37.999209 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:38.001587 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:38.001567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/54727fd7-e573-4d34-b317-1349a79e35b8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-df6mx\" (UID: \"54727fd7-e573-4d34-b317-1349a79e35b8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:38.247133 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:38.247107 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" Jun 09 11:59:38.381026 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:38.381004 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx"] Jun 09 11:59:38.383285 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:38.383259 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54727fd7_e573_4d34_b317_1349a79e35b8.slice/crio-62e9915e0731603e4994725fe292c6e587f4845617f708f6ec35704b68c3acd3 WatchSource:0}: Error finding container 62e9915e0731603e4994725fe292c6e587f4845617f708f6ec35704b68c3acd3: Status 404 returned error can't find the container with id 62e9915e0731603e4994725fe292c6e587f4845617f708f6ec35704b68c3acd3 Jun 09 11:59:38.477824 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:38.477796 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" event={"ID":"54727fd7-e573-4d34-b317-1349a79e35b8","Type":"ContainerStarted","Data":"62e9915e0731603e4994725fe292c6e587f4845617f708f6ec35704b68c3acd3"} Jun 09 11:59:39.482016 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:39.481974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" event={"ID":"54727fd7-e573-4d34-b317-1349a79e35b8","Type":"ContainerStarted","Data":"709b9db7fb3059b01c18b719ca524174a1bd58a4ecdeaf7667609d6f7bd3a620"} Jun 09 11:59:40.920000 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:40.919959 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:40.922501 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:40.922465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a-metrics-tls\") pod \"dns-default-jdqnq\" (UID: \"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a\") " pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:41.077550 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:41.077519 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4g5s4\"" Jun 09 11:59:41.085967 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:41.085946 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:41.207293 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:41.207191 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-df6mx" podStartSLOduration=34.272771445 podStartE2EDuration="35.207172536s" totalImagesPullingTime="934.401091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:39.504865287 +0000 UTC m=+285.371180092" watchObservedRunningTime="2026-06-09 11:59:41.207172536 +0000 UTC m=+287.073487342" Jun 09 11:59:41.208275 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:41.208254 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jdqnq"] Jun 09 11:59:41.210749 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:41.210726 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8df7731_63e3_4d3e_b8a2_ce8f7f2eff6a.slice/crio-03352608f395f658e280035e2e78d7a683c6d8b5f60fa1cea302e7f7223dc543 WatchSource:0}: Error finding container 03352608f395f658e280035e2e78d7a683c6d8b5f60fa1cea302e7f7223dc543: Status 404 returned error can't find the container with id 03352608f395f658e280035e2e78d7a683c6d8b5f60fa1cea302e7f7223dc543 Jun 09 11:59:41.489280 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:41.489251 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdqnq" event={"ID":"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a","Type":"ContainerStarted","Data":"03352608f395f658e280035e2e78d7a683c6d8b5f60fa1cea302e7f7223dc543"} Jun 09 11:59:43.497449 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.497411 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdqnq" event={"ID":"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a","Type":"ContainerStarted","Data":"6086544374dbe4af8b30eabcd549d5fb908b12b5b8f190520b1ff93243c88c56"} Jun 09 11:59:43.497884 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.497473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jdqnq" event={"ID":"f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a","Type":"ContainerStarted","Data":"6694d07ecc5055a79b2a366505d54985173e76206545c6813cec61342dc2460d"} Jun 09 11:59:43.497884 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.497582 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:43.518567 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.518521 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jdqnq" podStartSLOduration=252.057653973 podStartE2EDuration="4m13.518509351s" totalImagesPullingTime="1.460855378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:43.516928397 +0000 UTC m=+289.383243213" watchObservedRunningTime="2026-06-09 11:59:43.518509351 +0000 UTC m=+289.384824149" Jun 09 11:59:43.653672 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.653632 2567 patch_prober.go:28] interesting pod/image-registry-76455ddf5f-wrnkw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:59:43.653903 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:43.653686 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:59:47.654482 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.652174 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-88xk2"] Jun 09 11:59:47.656868 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.656839 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.659641 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.659620 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:59:47.659747 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.659664 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:59:47.659747 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.659668 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:59:47.660784 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.660750 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:59:47.660877 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.660755 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g8g9h\"" Jun 09 11:59:47.660877 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.660825 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:59:47.660877 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.660869 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:59:47.668915 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.668896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-wtmp\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669012 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.668921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-root\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669012 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.668940 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-metrics-client-ca\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669012 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.668960 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669012 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.668979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-textfile\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669154 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.669013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669154 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.669036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpg9n\" (UniqueName: \"kubernetes.io/projected/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-kube-api-access-gpg9n\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669154 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.669072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-sys\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.669154 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.669093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769550 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769519 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-sys\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769550 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769556 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769596 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-wtmp\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-sys\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769694 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-root\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769715 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-wtmp\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.769735 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769728 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-metrics-client-ca\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769755 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-root\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769775 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769803 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-textfile\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769824 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.769838 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpg9n\" (UniqueName: \"kubernetes.io/projected/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-kube-api-access-gpg9n\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770020 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:47.769968 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:59:47.770267 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:47.770045 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls podName:475257bb-d9b8-4e88-86b5-08e7e24dbf5f nodeName:}" failed. No retries permitted until 2026-06-09 11:59:48.270018261 +0000 UTC m=+294.136333047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls") pod "node-exporter-88xk2" (UID: "475257bb-d9b8-4e88-86b5-08e7e24dbf5f") : secret "node-exporter-tls" not found Jun 09 11:59:47.770267 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.770180 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-textfile\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770344 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.770325 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-metrics-client-ca\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.770344 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.770332 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-accelerators-collector-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.771906 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.771887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:47.778551 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:47.778533 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpg9n\" (UniqueName: \"kubernetes.io/projected/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-kube-api-access-gpg9n\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:48.273716 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:48.273682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:48.276175 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:48.276155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/475257bb-d9b8-4e88-86b5-08e7e24dbf5f-node-exporter-tls\") pod \"node-exporter-88xk2\" (UID: \"475257bb-d9b8-4e88-86b5-08e7e24dbf5f\") " pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:48.566186 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:48.566110 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-88xk2" Jun 09 11:59:48.581204 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:48.581177 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475257bb_d9b8_4e88_86b5_08e7e24dbf5f.slice/crio-c338f34bf3d6684ae5f2a4a97b9d009d2b01e737278c7e068459c26d852d56cf WatchSource:0}: Error finding container c338f34bf3d6684ae5f2a4a97b9d009d2b01e737278c7e068459c26d852d56cf: Status 404 returned error can't find the container with id c338f34bf3d6684ae5f2a4a97b9d009d2b01e737278c7e068459c26d852d56cf Jun 09 11:59:49.518499 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:49.518467 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88xk2" event={"ID":"475257bb-d9b8-4e88-86b5-08e7e24dbf5f","Type":"ContainerStarted","Data":"80711a268a705666843abd0e9abb011e3bf4f14963af67eda3d9dc7562d14692"} Jun 09 11:59:49.518813 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:49.518542 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88xk2" event={"ID":"475257bb-d9b8-4e88-86b5-08e7e24dbf5f","Type":"ContainerStarted","Data":"c338f34bf3d6684ae5f2a4a97b9d009d2b01e737278c7e068459c26d852d56cf"} Jun 09 11:59:50.523530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:50.523498 2567 generic.go:356] "Generic (PLEG): container finished" podID="475257bb-d9b8-4e88-86b5-08e7e24dbf5f" containerID="80711a268a705666843abd0e9abb011e3bf4f14963af67eda3d9dc7562d14692" exitCode=0 Jun 09 11:59:50.523530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:50.523532 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88xk2" event={"ID":"475257bb-d9b8-4e88-86b5-08e7e24dbf5f","Type":"ContainerDied","Data":"80711a268a705666843abd0e9abb011e3bf4f14963af67eda3d9dc7562d14692"} Jun 09 11:59:51.529246 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:51.529212 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88xk2" event={"ID":"475257bb-d9b8-4e88-86b5-08e7e24dbf5f","Type":"ContainerStarted","Data":"b7963009073154ce810faad42a5b44d7d221459a0386a8e931d9fd83f4151287"} Jun 09 11:59:51.529621 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:51.529275 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-88xk2" event={"ID":"475257bb-d9b8-4e88-86b5-08e7e24dbf5f","Type":"ContainerStarted","Data":"ee772f1610b5be4041025e868f8bddcb467c826162b05695c8c50ffea9f0a8d8"} Jun 09 11:59:51.551516 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:51.551474 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-88xk2" podStartSLOduration=3.642832731 podStartE2EDuration="4.551461286s" totalImagesPullingTime="837.289428ms" totalInitContainerRuntime="71.339127ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:51.549743146 +0000 UTC m=+297.416057951" watchObservedRunningTime="2026-06-09 11:59:51.551461286 +0000 UTC m=+297.417776091" Jun 09 11:59:52.455109 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.455077 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-j6hwg"] Jun 09 11:59:52.458210 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.458194 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 11:59:52.461819 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.461798 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 11:59:52.461935 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.461838 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 11:59:52.462090 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.462077 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fxh8l\"" Jun 09 11:59:52.471316 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.471271 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-j6hwg"] Jun 09 11:59:52.500806 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.500773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8lk\" (UniqueName: \"kubernetes.io/projected/db7fec50-f838-4b99-a0d7-47c6b2560f82-kube-api-access-gz8lk\") pod \"downloads-6657875f97-j6hwg\" (UID: \"db7fec50-f838-4b99-a0d7-47c6b2560f82\") " pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 11:59:52.601966 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.601933 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8lk\" (UniqueName: \"kubernetes.io/projected/db7fec50-f838-4b99-a0d7-47c6b2560f82-kube-api-access-gz8lk\") pod \"downloads-6657875f97-j6hwg\" (UID: \"db7fec50-f838-4b99-a0d7-47c6b2560f82\") " pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 11:59:52.610615 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.610589 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8lk\" (UniqueName: \"kubernetes.io/projected/db7fec50-f838-4b99-a0d7-47c6b2560f82-kube-api-access-gz8lk\") pod \"downloads-6657875f97-j6hwg\" (UID: \"db7fec50-f838-4b99-a0d7-47c6b2560f82\") " pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 11:59:52.612587 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:52.612549 2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hn75f" podUID="6d4682ac-9b0f-41d2-b47f-561c4dee9522" Jun 09 11:59:52.766806 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.766751 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 11:59:52.896602 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:52.896569 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-j6hwg"] Jun 09 11:59:52.900503 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:52.900473 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7fec50_f838_4b99_a0d7_47c6b2560f82.slice/crio-30d4b87e940fbfe6bdbade7f269290192a52336a1ace37613b9933dc2493ef55 WatchSource:0}: Error finding container 30d4b87e940fbfe6bdbade7f269290192a52336a1ace37613b9933dc2493ef55: Status 404 returned error can't find the container with id 30d4b87e940fbfe6bdbade7f269290192a52336a1ace37613b9933dc2493ef55 Jun 09 11:59:53.502145 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:53.502116 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jdqnq" Jun 09 11:59:53.538916 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:53.538879 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-j6hwg" event={"ID":"db7fec50-f838-4b99-a0d7-47c6b2560f82","Type":"ContainerStarted","Data":"30d4b87e940fbfe6bdbade7f269290192a52336a1ace37613b9933dc2493ef55"} Jun 09 11:59:53.653484 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:53.653457 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:54.025181 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:54.025149 2567 patch_prober.go:28] interesting pod/image-registry-7fb7c8d6f-88gfs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:59:54.025340 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:54.025203 2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" podUID="5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:59:54.563802 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:54.563778 2567 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 11:59:55.469408 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:55.469377 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fb7c8d6f-88gfs" Jun 09 11:59:58.668081 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.668040 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerName="registry" containerID="cri-o://4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d" gracePeriod=30 Jun 09 11:59:58.745800 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.745755 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 11:59:58.748954 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.748929 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.753078 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.753046 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 11:59:58.753411 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.753390 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 11:59:58.753698 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.753676 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 11:59:58.753951 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.753934 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 11:59:58.754068 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.754049 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xqm8j\"" Jun 09 11:59:58.754193 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.754169 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 11:59:58.759344 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.759317 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 11:59:58.855517 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2kcj\" (UniqueName: \"kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.855517 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855484 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.855720 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.855720 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855551 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.855720 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855586 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.855720 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.855616 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.923789 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.923705 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:58.956188 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956164 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956320 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956217 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956320 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956268 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956320 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956294 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956477 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956317 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6blm4\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956477 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956354 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956477 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956396 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956477 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956448 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates\") pod \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\" (UID: \"d27b8808-5bde-4f22-8952-4e1fe7cab9be\") " Jun 09 11:59:58.956665 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956555 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956665 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956599 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956665 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956623 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956839 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956664 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956839 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956698 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956839 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956755 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2kcj\" (UniqueName: \"kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.956839 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956786 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:59:58.957022 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.956876 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-trusted-ca\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:58.959300 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.958122 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.959300 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.958728 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.959530 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959484 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:59:58.959654 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.959807 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959740 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4" (OuterVolumeSpecName: "kube-api-access-6blm4") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "kube-api-access-6blm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:59:58.959915 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959856 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:59:58.959915 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959903 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.960027 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.959991 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.960816 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.960792 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:59:58.960914 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.960842 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:59:58.961615 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.961588 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:59:58.964648 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.964629 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2kcj\" (UniqueName: \"kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj\") pod \"console-74fcb449f9-tn2hj\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:58.966455 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:58.966410 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d27b8808-5bde-4f22-8952-4e1fe7cab9be" (UID: "d27b8808-5bde-4f22-8952-4e1fe7cab9be"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:59:59.058027 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.057999 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-tls\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058028 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-image-registry-private-configuration\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058043 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d27b8808-5bde-4f22-8952-4e1fe7cab9be-registry-certificates\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058056 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-bound-sa-token\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058067 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d27b8808-5bde-4f22-8952-4e1fe7cab9be-ca-trust-extracted\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058079 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d27b8808-5bde-4f22-8952-4e1fe7cab9be-installation-pull-secrets\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.058134 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.058091 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6blm4\" (UniqueName: \"kubernetes.io/projected/d27b8808-5bde-4f22-8952-4e1fe7cab9be-kube-api-access-6blm4\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 11:59:59.064975 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.064949 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 11:59:59.208755 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.208606 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 11:59:59.211581 ip-10-0-129-223 kubenswrapper[2567]: W0609 11:59:59.211552 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f53500_0f40_4dae_bb2f_4d339d819cb7.slice/crio-5713dbc568c491398d82bfd3f75a05b07d3a9771f734d44b3c5b7055608918f1 WatchSource:0}: Error finding container 5713dbc568c491398d82bfd3f75a05b07d3a9771f734d44b3c5b7055608918f1: Status 404 returned error can't find the container with id 5713dbc568c491398d82bfd3f75a05b07d3a9771f734d44b3c5b7055608918f1 Jun 09 11:59:59.214209 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.214190 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:59:59.563716 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.563681 2567 generic.go:356] "Generic (PLEG): container finished" podID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerID="4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d" exitCode=0 Jun 09 11:59:59.563920 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.563743 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" Jun 09 11:59:59.563920 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.563786 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" event={"ID":"d27b8808-5bde-4f22-8952-4e1fe7cab9be","Type":"ContainerDied","Data":"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d"} Jun 09 11:59:59.563920 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.563844 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76455ddf5f-wrnkw" event={"ID":"d27b8808-5bde-4f22-8952-4e1fe7cab9be","Type":"ContainerDied","Data":"29074b9829ce6f0c998f6d477c6138806fdae05b1ee817698465ccebc805d0c2"} Jun 09 11:59:59.564813 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.564775 2567 scope.go:117] "RemoveContainer" containerID="4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d" Jun 09 11:59:59.565289 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.565256 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcb449f9-tn2hj" event={"ID":"f0f53500-0f40-4dae-bb2f-4d339d819cb7","Type":"ContainerStarted","Data":"5713dbc568c491398d82bfd3f75a05b07d3a9771f734d44b3c5b7055608918f1"} Jun 09 11:59:59.574751 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.574732 2567 scope.go:117] "RemoveContainer" containerID="4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d" Jun 09 11:59:59.575130 ip-10-0-129-223 kubenswrapper[2567]: E0609 11:59:59.575109 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d\": container with ID starting with 4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d not found: ID does not exist" containerID="4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d" Jun 09 11:59:59.575205 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.575137 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d"} err="failed to get container status \"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d\": rpc error: code = NotFound desc = could not find container \"4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d\": container with ID starting with 4896c2874261ee8b5645e011acfd5f3f09e60fd7f29f8563acfddf0dc033c56d not found: ID does not exist" Jun 09 11:59:59.586547 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.586526 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 11:59:59.591936 ip-10-0-129-223 kubenswrapper[2567]: I0609 11:59:59.591916 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76455ddf5f-wrnkw"] Jun 09 12:00:00.617673 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:00.617638 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" path="/var/lib/kubelet/pods/d27b8808-5bde-4f22-8952-4e1fe7cab9be/volumes" Jun 09 12:00:02.581652 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:02.581575 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcb449f9-tn2hj" event={"ID":"f0f53500-0f40-4dae-bb2f-4d339d819cb7","Type":"ContainerStarted","Data":"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8"} Jun 09 12:00:02.600867 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:02.600817 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74fcb449f9-tn2hj" podStartSLOduration=1.564786837 podStartE2EDuration="4.600802267s" totalImagesPullingTime="3.03601543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:02.598935041 +0000 UTC m=+308.465249867" watchObservedRunningTime="2026-06-09 12:00:02.600802267 +0000 UTC m=+308.467117050" Jun 09 12:00:05.612019 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:05.611980 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 12:00:09.066111 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.066071 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:09.066568 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.066153 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:09.071913 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.071890 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:09.536090 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.536053 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:00:09.536500 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.536471 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerName="registry" Jun 09 12:00:09.536500 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.536498 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerName="registry" Jun 09 12:00:09.536632 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.536584 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d27b8808-5bde-4f22-8952-4e1fe7cab9be" containerName="registry" Jun 09 12:00:09.542067 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.542049 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.551010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.550987 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 12:00:09.551493 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.551471 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:00:09.614158 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.614126 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-j6hwg" event={"ID":"db7fec50-f838-4b99-a0d7-47c6b2560f82","Type":"ContainerStarted","Data":"8498d78ebfd397aae3c71c5bf3f7f330739ccc99699fc93824d69e6be1d2effa"} Jun 09 12:00:09.618439 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.618412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:09.633290 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.633209 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-j6hwg" podStartSLOduration=1.16362733 podStartE2EDuration="17.633194469s" totalImagesPullingTime="16.469567139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:09.631924997 +0000 UTC m=+315.498239827" watchObservedRunningTime="2026-06-09 12:00:09.633194469 +0000 UTC m=+315.499509274" Jun 09 12:00:09.648857 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.648830 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.648964 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.648907 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.648964 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.648956 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.649041 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.649024 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.649075 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.649057 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npsfj\" (UniqueName: \"kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.649108 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.649089 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.649161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.649145 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750254 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750211 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npsfj\" (UniqueName: \"kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750297 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750382 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750423 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750465 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750508 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.750611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.750593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.751248 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.751219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.751363 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.751299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.751363 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.751318 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.751837 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.751811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.754171 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.754125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.754920 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.754898 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.760966 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.760944 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npsfj\" (UniqueName: \"kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj\") pod \"console-6c7bb87674-9lrxz\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:09.854398 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:09.854358 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:10.016268 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.016161 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:00:10.020232 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:00:10.020208 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cf3905_2d8d_46a4_9312_80bd8c6c69bc.slice/crio-31142059c447eecfbad044a62877aee5d6ab1b82c63b76b2f68cc29c9f053a5e WatchSource:0}: Error finding container 31142059c447eecfbad044a62877aee5d6ab1b82c63b76b2f68cc29c9f053a5e: Status 404 returned error can't find the container with id 31142059c447eecfbad044a62877aee5d6ab1b82c63b76b2f68cc29c9f053a5e Jun 09 12:00:10.620158 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.620088 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7bb87674-9lrxz" event={"ID":"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc","Type":"ContainerStarted","Data":"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8"} Jun 09 12:00:10.620158 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.620157 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7bb87674-9lrxz" event={"ID":"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc","Type":"ContainerStarted","Data":"31142059c447eecfbad044a62877aee5d6ab1b82c63b76b2f68cc29c9f053a5e"} Jun 09 12:00:10.621207 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.620984 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 12:00:10.634412 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.634386 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-j6hwg" Jun 09 12:00:10.641561 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:10.641512 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c7bb87674-9lrxz" podStartSLOduration=1.64149746 podStartE2EDuration="1.64149746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:10.640388271 +0000 UTC m=+316.506703107" watchObservedRunningTime="2026-06-09 12:00:10.64149746 +0000 UTC m=+316.507812265" Jun 09 12:00:19.855013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:19.854970 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:19.855699 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:19.855047 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:19.859750 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:19.859726 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:20.662753 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:20.662727 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:00:20.711315 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:20.711282 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 12:00:44.741526 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:44.741489 2567 generic.go:356] "Generic (PLEG): container finished" podID="c35ac08c-44dc-4bee-b64e-c5fc18fd998d" containerID="e571ed12d1ff4b739199d02aa405b7263548f80f5c95c6456195e97a9b23b43a" exitCode=0 Jun 09 12:00:44.741945 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:44.741562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" event={"ID":"c35ac08c-44dc-4bee-b64e-c5fc18fd998d","Type":"ContainerDied","Data":"e571ed12d1ff4b739199d02aa405b7263548f80f5c95c6456195e97a9b23b43a"} Jun 09 12:00:44.741945 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:44.741870 2567 scope.go:117] "RemoveContainer" containerID="e571ed12d1ff4b739199d02aa405b7263548f80f5c95c6456195e97a9b23b43a" Jun 09 12:00:45.737540 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:45.737470 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74fcb449f9-tn2hj" podUID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" containerName="console" containerID="cri-o://6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8" gracePeriod=15 Jun 09 12:00:45.746914 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:45.746875 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-jc7g8" event={"ID":"c35ac08c-44dc-4bee-b64e-c5fc18fd998d","Type":"ContainerStarted","Data":"8e28b95455a2f2599995b2bdc32898ad1a71fb667c2770f964fd092c29bc9a22"} Jun 09 12:00:46.027316 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.027284 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:46.055272 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055241 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055435 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055304 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055435 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055347 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055435 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055369 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2kcj\" (UniqueName: \"kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055435 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055387 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055435 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055420 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config\") pod \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\" (UID: \"f0f53500-0f40-4dae-bb2f-4d339d819cb7\") " Jun 09 12:00:46.055874 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055831 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:46.056005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055919 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:46.056005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.055957 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config" (OuterVolumeSpecName: "console-config") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:00:46.057969 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.057939 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:46.058101 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.058057 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj" (OuterVolumeSpecName: "kube-api-access-x2kcj") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "kube-api-access-x2kcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:46.058146 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.058118 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f0f53500-0f40-4dae-bb2f-4d339d819cb7" (UID: "f0f53500-0f40-4dae-bb2f-4d339d819cb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:00:46.156852 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156809 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-oauth-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.156852 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156843 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-service-ca\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.156852 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156852 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-oauth-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.156852 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156861 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2kcj\" (UniqueName: \"kubernetes.io/projected/f0f53500-0f40-4dae-bb2f-4d339d819cb7-kube-api-access-x2kcj\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.157101 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156872 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.157101 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.156880 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0f53500-0f40-4dae-bb2f-4d339d819cb7-console-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:00:46.752103 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.752062 2567 generic.go:356] "Generic (PLEG): container finished" podID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" containerID="6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8" exitCode=0 Jun 09 12:00:46.752103 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.752103 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcb449f9-tn2hj" Jun 09 12:00:46.752616 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.752128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcb449f9-tn2hj" event={"ID":"f0f53500-0f40-4dae-bb2f-4d339d819cb7","Type":"ContainerDied","Data":"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8"} Jun 09 12:00:46.752616 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.752174 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcb449f9-tn2hj" event={"ID":"f0f53500-0f40-4dae-bb2f-4d339d819cb7","Type":"ContainerDied","Data":"5713dbc568c491398d82bfd3f75a05b07d3a9771f734d44b3c5b7055608918f1"} Jun 09 12:00:46.752616 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.752197 2567 scope.go:117] "RemoveContainer" containerID="6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8" Jun 09 12:00:46.760314 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.760289 2567 scope.go:117] "RemoveContainer" containerID="6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8" Jun 09 12:00:46.760546 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:00:46.760530 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8\": container with ID starting with 6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8 not found: ID does not exist" containerID="6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8" Jun 09 12:00:46.760611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.760557 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8"} err="failed to get container status \"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8\": rpc error: code = NotFound desc = could not find container \"6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8\": container with ID starting with 6739a6417fae7828d150ffb1aa15a855566725685b88b0c2d544ebe3e89e93a8 not found: ID does not exist" Jun 09 12:00:46.768273 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.768247 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 12:00:46.770747 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:46.770727 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74fcb449f9-tn2hj"] Jun 09 12:00:48.616511 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:00:48.616482 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" path="/var/lib/kubelet/pods/f0f53500-0f40-4dae-bb2f-4d339d819cb7/volumes" Jun 09 12:01:08.428296 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.428258 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 12:01:08.430730 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.430705 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4682ac-9b0f-41d2-b47f-561c4dee9522-metrics-certs\") pod \"network-metrics-daemon-hn75f\" (UID: \"6d4682ac-9b0f-41d2-b47f-561c4dee9522\") " pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 12:01:08.615899 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.615869 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vzslx\"" Jun 09 12:01:08.623145 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.623118 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hn75f" Jun 09 12:01:08.752926 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.752877 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hn75f"] Jun 09 12:01:08.755456 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:01:08.755431 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4682ac_9b0f_41d2_b47f_561c4dee9522.slice/crio-c001d92045b0d4f97fe389f6c68da1941b91e886974a31c6a1ed22f0385f2e0b WatchSource:0}: Error finding container c001d92045b0d4f97fe389f6c68da1941b91e886974a31c6a1ed22f0385f2e0b: Status 404 returned error can't find the container with id c001d92045b0d4f97fe389f6c68da1941b91e886974a31c6a1ed22f0385f2e0b Jun 09 12:01:08.831664 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:08.831626 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn75f" event={"ID":"6d4682ac-9b0f-41d2-b47f-561c4dee9522","Type":"ContainerStarted","Data":"c001d92045b0d4f97fe389f6c68da1941b91e886974a31c6a1ed22f0385f2e0b"} Jun 09 12:01:09.836968 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:09.836890 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn75f" event={"ID":"6d4682ac-9b0f-41d2-b47f-561c4dee9522","Type":"ContainerStarted","Data":"6adea270ec6854a41edc4b1106dede7e76a7917e817cf903c70a33e8a6d02a5c"} Jun 09 12:01:09.836968 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:09.836952 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hn75f" event={"ID":"6d4682ac-9b0f-41d2-b47f-561c4dee9522","Type":"ContainerStarted","Data":"41fe30dad1d31703299258fdc6220f126923ff772f84517df8d81af086da00dd"} Jun 09 12:01:09.853889 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:09.853845 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hn75f" podStartSLOduration=375.026582379 podStartE2EDuration="6m15.853831949s" totalImagesPullingTime="827.24957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:09.853604768 +0000 UTC m=+375.719919574" watchObservedRunningTime="2026-06-09 12:01:09.853831949 +0000 UTC m=+375.720146755" Jun 09 12:01:15.538524 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.538490 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:01:15.539013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.538740 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" containerName="console" Jun 09 12:01:15.539013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.538750 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" containerName="console" Jun 09 12:01:15.539013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.538833 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f53500-0f40-4dae-bb2f-4d339d819cb7" containerName="console" Jun 09 12:01:15.540459 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.540442 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.558756 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.558731 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:01:15.680418 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680425 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680492 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlhst\" (UniqueName: \"kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680542 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680588 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680753 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.680753 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.680625 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781665 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781631 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781665 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781667 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781891 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781685 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781891 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781708 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781891 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781727 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781891 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781792 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlhst\" (UniqueName: \"kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.781891 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.781822 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.782455 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.782425 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.782671 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.782535 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.782671 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.782550 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.783017 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.782988 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.784379 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.784361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.784485 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.784469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.791190 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.791141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlhst\" (UniqueName: \"kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst\") pod \"console-6d4d65f84d-kw7xd\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.848808 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.848783 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:15.976707 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:15.976682 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:01:15.979203 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:01:15.979176 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42653cb3_2c54_45b1_96dd_c1710f517466.slice/crio-5bbb8589c03d0443482b848e0c4c93c1cfb791ec3a2501eb0fb657a5b842a786 WatchSource:0}: Error finding container 5bbb8589c03d0443482b848e0c4c93c1cfb791ec3a2501eb0fb657a5b842a786: Status 404 returned error can't find the container with id 5bbb8589c03d0443482b848e0c4c93c1cfb791ec3a2501eb0fb657a5b842a786 Jun 09 12:01:16.865633 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:16.865597 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4d65f84d-kw7xd" event={"ID":"42653cb3-2c54-45b1-96dd-c1710f517466","Type":"ContainerStarted","Data":"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28"} Jun 09 12:01:16.866048 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:16.865646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4d65f84d-kw7xd" event={"ID":"42653cb3-2c54-45b1-96dd-c1710f517466","Type":"ContainerStarted","Data":"5bbb8589c03d0443482b848e0c4c93c1cfb791ec3a2501eb0fb657a5b842a786"} Jun 09 12:01:16.887303 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:16.887249 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4d65f84d-kw7xd" podStartSLOduration=1.887231568 podStartE2EDuration="1.887231568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:01:16.886629886 +0000 UTC m=+382.752944692" watchObservedRunningTime="2026-06-09 12:01:16.887231568 +0000 UTC m=+382.753546375" Jun 09 12:01:25.849216 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:25.849180 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:25.849733 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:25.849236 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:25.853976 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:25.853956 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:25.901930 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:25.901904 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:01:25.950177 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:25.950139 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:01:50.975942 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:50.975876 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c7bb87674-9lrxz" podUID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" containerName="console" containerID="cri-o://4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8" gracePeriod=15 Jun 09 12:01:51.207975 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.207946 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:01:51.257744 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257655 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.257744 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257713 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.257744 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257739 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.258030 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257848 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.258030 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257898 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.258030 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257942 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npsfj\" (UniqueName: \"kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.258030 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.257968 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config\") pod \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\" (UID: \"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc\") " Jun 09 12:01:51.258222 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.258154 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:51.258222 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.258174 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:51.258222 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.258192 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:51.258358 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.258288 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config" (OuterVolumeSpecName: "console-config") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:01:51.260208 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.260181 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:51.260314 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.260216 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:01:51.260314 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.260227 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj" (OuterVolumeSpecName: "kube-api-access-npsfj") pod "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" (UID: "d2cf3905-2d8d-46a4-9312-80bd8c6c69bc"). InnerVolumeSpecName "kube-api-access-npsfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:01:51.359010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.358968 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-service-ca\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.358999 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-trusted-ca-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.359008 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.359017 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359262 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.359025 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npsfj\" (UniqueName: \"kubernetes.io/projected/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-kube-api-access-npsfj\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359262 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.359034 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-console-oauth-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.359262 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.359043 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc-oauth-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:01:51.990133 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.990092 2567 generic.go:356] "Generic (PLEG): container finished" podID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" containerID="4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8" exitCode=0 Jun 09 12:01:51.990570 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.990150 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7bb87674-9lrxz" Jun 09 12:01:51.990570 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.990152 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7bb87674-9lrxz" event={"ID":"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc","Type":"ContainerDied","Data":"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8"} Jun 09 12:01:51.990570 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.990322 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7bb87674-9lrxz" event={"ID":"d2cf3905-2d8d-46a4-9312-80bd8c6c69bc","Type":"ContainerDied","Data":"31142059c447eecfbad044a62877aee5d6ab1b82c63b76b2f68cc29c9f053a5e"} Jun 09 12:01:51.990570 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.990362 2567 scope.go:117] "RemoveContainer" containerID="4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8" Jun 09 12:01:51.998824 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.998808 2567 scope.go:117] "RemoveContainer" containerID="4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8" Jun 09 12:01:51.999067 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:01:51.999050 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8\": container with ID starting with 4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8 not found: ID does not exist" containerID="4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8" Jun 09 12:01:51.999127 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:51.999074 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8"} err="failed to get container status \"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8\": rpc error: code = NotFound desc = could not find container \"4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8\": container with ID starting with 4a9f576aac8360cc54d7ef9859e71f8eb5405743cb99a82e7cf5e50a9dbeecd8 not found: ID does not exist" Jun 09 12:01:52.012053 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:52.012021 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:01:52.017199 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:52.017175 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c7bb87674-9lrxz"] Jun 09 12:01:52.616895 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:01:52.616858 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" path="/var/lib/kubelet/pods/d2cf3905-2d8d-46a4-9312-80bd8c6c69bc/volumes" Jun 09 12:02:24.793043 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.793008 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:02:24.793509 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.793260 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" containerName="console" Jun 09 12:02:24.793509 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.793271 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" containerName="console" Jun 09 12:02:24.793509 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.793320 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2cf3905-2d8d-46a4-9312-80bd8c6c69bc" containerName="console" Jun 09 12:02:24.796158 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.796131 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.808636 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.808613 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:02:24.921107 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921271 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921114 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921271 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921132 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921271 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921271 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921471 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921315 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:24.921471 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:24.921359 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlphs\" (UniqueName: \"kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022448 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022409 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022448 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022447 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlphs\" (UniqueName: \"kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022684 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022587 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022684 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022634 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022684 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022661 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022868 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022689 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.022868 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.022715 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.023298 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.023269 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.023545 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.023375 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.023545 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.023421 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.023545 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.023420 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.025218 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.025190 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.025345 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.025327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.031196 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.031178 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlphs\" (UniqueName: \"kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs\") pod \"console-58756b976f-vkhpw\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.105522 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.105440 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:25.235978 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:25.235798 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:02:25.238845 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:02:25.238814 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb612ab_a0c3_4f6f_a6ff_a15306c2b9d7.slice/crio-8c5d2139cda2c52e0380e93af0b3d274a51840198ec39ba4aefff052ca4e60a6 WatchSource:0}: Error finding container 8c5d2139cda2c52e0380e93af0b3d274a51840198ec39ba4aefff052ca4e60a6: Status 404 returned error can't find the container with id 8c5d2139cda2c52e0380e93af0b3d274a51840198ec39ba4aefff052ca4e60a6 Jun 09 12:02:26.108816 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:26.108779 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58756b976f-vkhpw" event={"ID":"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7","Type":"ContainerStarted","Data":"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900"} Jun 09 12:02:26.109184 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:26.108831 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58756b976f-vkhpw" event={"ID":"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7","Type":"ContainerStarted","Data":"8c5d2139cda2c52e0380e93af0b3d274a51840198ec39ba4aefff052ca4e60a6"} Jun 09 12:02:26.128153 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:26.128099 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58756b976f-vkhpw" podStartSLOduration=2.128085893 podStartE2EDuration="2.128085893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:02:26.127355385 +0000 UTC m=+451.993670192" watchObservedRunningTime="2026-06-09 12:02:26.128085893 +0000 UTC m=+451.994400773" Jun 09 12:02:35.106275 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:35.106239 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:35.106720 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:35.106296 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:35.110949 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:35.110924 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:35.144844 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:35.144823 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:02:35.218219 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:02:35.218189 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:03:00.237389 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.237321 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d4d65f84d-kw7xd" podUID="42653cb3-2c54-45b1-96dd-c1710f517466" containerName="console" containerID="cri-o://d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28" gracePeriod=15 Jun 09 12:03:00.476851 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.476829 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:03:00.589423 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589326 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589423 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589376 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589435 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589480 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589516 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589546 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589581 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlhst\" (UniqueName: \"kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst\") pod \"42653cb3-2c54-45b1-96dd-c1710f517466\" (UID: \"42653cb3-2c54-45b1-96dd-c1710f517466\") " Jun 09 12:03:00.589993 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589960 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:00.590114 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589995 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca" (OuterVolumeSpecName: "service-ca") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:00.590114 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.589883 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:00.590114 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.590042 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config" (OuterVolumeSpecName: "console-config") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:00.591626 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.591603 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:03:00.591827 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.591804 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst" (OuterVolumeSpecName: "kube-api-access-xlhst") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "kube-api-access-xlhst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:03:00.591929 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.591910 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42653cb3-2c54-45b1-96dd-c1710f517466" (UID: "42653cb3-2c54-45b1-96dd-c1710f517466"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:03:00.690867 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690828 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-console-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.690867 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690857 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.691073 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690880 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlhst\" (UniqueName: \"kubernetes.io/projected/42653cb3-2c54-45b1-96dd-c1710f517466-kube-api-access-xlhst\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.691073 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690889 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42653cb3-2c54-45b1-96dd-c1710f517466-console-oauth-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.691073 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690898 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-trusted-ca-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.691073 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690906 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-oauth-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:00.691073 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:00.690913 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42653cb3-2c54-45b1-96dd-c1710f517466-service-ca\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:01.238214 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.238178 2567 generic.go:356] "Generic (PLEG): container finished" podID="42653cb3-2c54-45b1-96dd-c1710f517466" containerID="d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28" exitCode=0 Jun 09 12:03:01.238611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.238223 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4d65f84d-kw7xd" Jun 09 12:03:01.238611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.238264 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4d65f84d-kw7xd" event={"ID":"42653cb3-2c54-45b1-96dd-c1710f517466","Type":"ContainerDied","Data":"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28"} Jun 09 12:03:01.238611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.238312 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4d65f84d-kw7xd" event={"ID":"42653cb3-2c54-45b1-96dd-c1710f517466","Type":"ContainerDied","Data":"5bbb8589c03d0443482b848e0c4c93c1cfb791ec3a2501eb0fb657a5b842a786"} Jun 09 12:03:01.238611 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.238331 2567 scope.go:117] "RemoveContainer" containerID="d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28" Jun 09 12:03:01.246412 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.246395 2567 scope.go:117] "RemoveContainer" containerID="d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28" Jun 09 12:03:01.246659 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:03:01.246641 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28\": container with ID starting with d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28 not found: ID does not exist" containerID="d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28" Jun 09 12:03:01.246729 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.246671 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28"} err="failed to get container status \"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28\": rpc error: code = NotFound desc = could not find container \"d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28\": container with ID starting with d09f8a0f10df77de4d8ebcce2380490bbb78c1d0342cf426169274760315df28 not found: ID does not exist" Jun 09 12:03:01.259573 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.259545 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:03:01.269798 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:01.269754 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d4d65f84d-kw7xd"] Jun 09 12:03:02.616206 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:02.616173 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42653cb3-2c54-45b1-96dd-c1710f517466" path="/var/lib/kubelet/pods/42653cb3-2c54-45b1-96dd-c1710f517466/volumes" Jun 09 12:03:27.574014 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.573980 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48"] Jun 09 12:03:27.574476 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.574231 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42653cb3-2c54-45b1-96dd-c1710f517466" containerName="console" Jun 09 12:03:27.574476 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.574242 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42653cb3-2c54-45b1-96dd-c1710f517466" containerName="console" Jun 09 12:03:27.574476 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.574297 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42653cb3-2c54-45b1-96dd-c1710f517466" containerName="console" Jun 09 12:03:27.577201 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.577183 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.579860 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.579840 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:03:27.581138 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.581119 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:03:27.581222 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.581147 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l8kz9\"" Jun 09 12:03:27.585631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.585608 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48"] Jun 09 12:03:27.701606 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.701571 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.701809 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.701620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwkng\" (UniqueName: \"kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.701809 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.701684 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.802480 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.802443 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.802644 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.802487 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwkng\" (UniqueName: \"kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.802644 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.802522 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.802832 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.802812 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.802902 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.802888 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.812228 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.812210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwkng\" (UniqueName: \"kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:27.886289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:27.886230 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:28.014072 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:28.014047 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48"] Jun 09 12:03:28.016182 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:03:28.016155 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ad379b_b1b5_434e_9e35_bea1da611d9d.slice/crio-a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033 WatchSource:0}: Error finding container a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033: Status 404 returned error can't find the container with id a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033 Jun 09 12:03:28.335870 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:28.335839 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerStarted","Data":"a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033"} Jun 09 12:03:37.369924 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:37.369892 2567 generic.go:356] "Generic (PLEG): container finished" podID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerID="5cdba82a665bf9c2ac7c1816c47ef13d99afccbc5159896d3b7e7a94adb6457b" exitCode=0 Jun 09 12:03:37.370338 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:37.369974 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerDied","Data":"5cdba82a665bf9c2ac7c1816c47ef13d99afccbc5159896d3b7e7a94adb6457b"} Jun 09 12:03:39.380775 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:39.380716 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerStarted","Data":"b45be25a7845f90b04b726dbe026c39d76cdce12416b0b7190f7bcfb7e4e0a3b"} Jun 09 12:03:40.386333 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:40.386295 2567 generic.go:356] "Generic (PLEG): container finished" podID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerID="b45be25a7845f90b04b726dbe026c39d76cdce12416b0b7190f7bcfb7e4e0a3b" exitCode=0 Jun 09 12:03:40.386793 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:40.386380 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerDied","Data":"b45be25a7845f90b04b726dbe026c39d76cdce12416b0b7190f7bcfb7e4e0a3b"} Jun 09 12:03:50.431464 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:50.431390 2567 generic.go:356] "Generic (PLEG): container finished" podID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerID="7acec11693c3862a1359e73d60f891ba926a3f0e008ae49f24099301c1c5cd9f" exitCode=0 Jun 09 12:03:50.431464 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:50.431435 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerDied","Data":"7acec11693c3862a1359e73d60f891ba926a3f0e008ae49f24099301c1c5cd9f"} Jun 09 12:03:51.580325 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.580295 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:51.588430 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.588410 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle\") pod \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " Jun 09 12:03:51.588513 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.588440 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util\") pod \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " Jun 09 12:03:51.588513 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.588474 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwkng\" (UniqueName: \"kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng\") pod \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\" (UID: \"f5ad379b-b1b5-434e-9e35-bea1da611d9d\") " Jun 09 12:03:51.589035 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.589012 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle" (OuterVolumeSpecName: "bundle") pod "f5ad379b-b1b5-434e-9e35-bea1da611d9d" (UID: "f5ad379b-b1b5-434e-9e35-bea1da611d9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:03:51.590726 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.590701 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng" (OuterVolumeSpecName: "kube-api-access-kwkng") pod "f5ad379b-b1b5-434e-9e35-bea1da611d9d" (UID: "f5ad379b-b1b5-434e-9e35-bea1da611d9d"). InnerVolumeSpecName "kube-api-access-kwkng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:03:51.593966 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.593942 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util" (OuterVolumeSpecName: "util") pod "f5ad379b-b1b5-434e-9e35-bea1da611d9d" (UID: "f5ad379b-b1b5-434e-9e35-bea1da611d9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:03:51.689591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.689507 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:51.689591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.689539 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f5ad379b-b1b5-434e-9e35-bea1da611d9d-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:51.689591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:51.689549 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwkng\" (UniqueName: \"kubernetes.io/projected/f5ad379b-b1b5-434e-9e35-bea1da611d9d-kube-api-access-kwkng\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:03:52.439725 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:52.439693 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" event={"ID":"f5ad379b-b1b5-434e-9e35-bea1da611d9d","Type":"ContainerDied","Data":"a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033"} Jun 09 12:03:52.439901 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:52.439741 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a628269c85afeff0ea66c75f73720ec4e6eb7605f094a3ac42dd89d600f10033" Jun 09 12:03:52.439901 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:52.439742 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d5nw48" Jun 09 12:03:55.581310 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581276 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq"] Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581531 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="util" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581541 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="util" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581551 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="pull" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581556 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="pull" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581567 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="extract" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581573 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="extract" Jun 09 12:03:55.581780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.581620 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ad379b-b1b5-434e-9e35-bea1da611d9d" containerName="extract" Jun 09 12:03:55.584018 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.584001 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.587194 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.587173 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 12:03:55.587517 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.587501 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-64w7q\"" Jun 09 12:03:55.588138 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.588114 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 12:03:55.606822 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.606793 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq"] Jun 09 12:03:55.615315 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.615293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5prgr\" (UniqueName: \"kubernetes.io/projected/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-kube-api-access-5prgr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.615412 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.615331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.716583 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.716546 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5prgr\" (UniqueName: \"kubernetes.io/projected/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-kube-api-access-5prgr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.716738 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.716591 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.716949 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.716934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.726467 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.726450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5prgr\" (UniqueName: \"kubernetes.io/projected/ae2a12bd-6b6c-448c-9d1f-94844a3751dc-kube-api-access-5prgr\") pod \"cert-manager-operator-controller-manager-57757f7cfc-czqwq\" (UID: \"ae2a12bd-6b6c-448c-9d1f-94844a3751dc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:55.893683 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:55.893594 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" Jun 09 12:03:56.029782 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:56.029741 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq"] Jun 09 12:03:56.032125 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:03:56.032093 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2a12bd_6b6c_448c_9d1f_94844a3751dc.slice/crio-228c0ebea818e39496eb90966daf4fe6df657a6fc771c21ca9934813f95e05f1 WatchSource:0}: Error finding container 228c0ebea818e39496eb90966daf4fe6df657a6fc771c21ca9934813f95e05f1: Status 404 returned error can't find the container with id 228c0ebea818e39496eb90966daf4fe6df657a6fc771c21ca9934813f95e05f1 Jun 09 12:03:56.456521 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:56.456486 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" event={"ID":"ae2a12bd-6b6c-448c-9d1f-94844a3751dc","Type":"ContainerStarted","Data":"228c0ebea818e39496eb90966daf4fe6df657a6fc771c21ca9934813f95e05f1"} Jun 09 12:03:58.465655 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:58.465615 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" event={"ID":"ae2a12bd-6b6c-448c-9d1f-94844a3751dc","Type":"ContainerStarted","Data":"b0a3f69385bd4b3b84c46f07501e9335f8e3d3eec71aaa9644abd4b650566716"} Jun 09 12:03:59.877486 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.877427 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-czqwq" podStartSLOduration=3.432870529 podStartE2EDuration="4.877412383s" totalImagesPullingTime="1.444541854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:03:58.502305491 +0000 UTC m=+544.368620296" watchObservedRunningTime="2026-06-09 12:03:59.877412383 +0000 UTC m=+545.743727189" Jun 09 12:03:59.877903 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.877690 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82"] Jun 09 12:03:59.880500 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.880484 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:03:59.884855 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.884831 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l8kz9\"" Jun 09 12:03:59.884991 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.884973 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:03:59.886162 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.886145 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:03:59.899867 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.899841 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82"] Jun 09 12:03:59.951828 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.951792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:03:59.951996 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.951852 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6flk\" (UniqueName: \"kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:03:59.951996 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:03:59.951878 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.025942 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.025904 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nszb6"] Jun 09 12:04:00.027985 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.027967 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.032195 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.032163 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hvpt8\"" Jun 09 12:04:00.032195 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.032188 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 12:04:00.032328 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.032188 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 12:04:00.043397 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.043370 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nszb6"] Jun 09 12:04:00.052804 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.052776 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kls22\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-kube-api-access-kls22\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.052930 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.052819 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.052930 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.052844 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.052930 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.052890 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6flk\" (UniqueName: \"kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.053027 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.052926 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.053288 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.053264 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.053327 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.053270 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.069712 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.069677 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6flk\" (UniqueName: \"kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.153844 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.153712 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kls22\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-kube-api-access-kls22\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.153844 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.153783 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.163399 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.163371 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kls22\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-kube-api-access-kls22\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.164109 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.164089 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0c4d52e1-7898-492a-b003-437d5970dc42-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-nszb6\" (UID: \"0c4d52e1-7898-492a-b003-437d5970dc42\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.189036 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.189012 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:00.333683 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.333653 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82"] Jun 09 12:04:00.336876 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:04:00.336849 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd896f4d_3a67_473b_82d6_f53a1616a9bf.slice/crio-b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474 WatchSource:0}: Error finding container b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474: Status 404 returned error can't find the container with id b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474 Jun 09 12:04:00.347735 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.347716 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:00.476035 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.476000 2567 generic.go:356] "Generic (PLEG): container finished" podID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerID="4e8eb907f5e61eba1382df408196b623853fa273eabd9de24c286c708f5b447f" exitCode=0 Jun 09 12:04:00.476166 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.476040 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" event={"ID":"cd896f4d-3a67-473b-82d6-f53a1616a9bf","Type":"ContainerDied","Data":"4e8eb907f5e61eba1382df408196b623853fa273eabd9de24c286c708f5b447f"} Jun 09 12:04:00.476166 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.476093 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" event={"ID":"cd896f4d-3a67-473b-82d6-f53a1616a9bf","Type":"ContainerStarted","Data":"b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474"} Jun 09 12:04:00.480211 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:00.480192 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-nszb6"] Jun 09 12:04:00.483639 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:04:00.483616 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c4d52e1_7898_492a_b003_437d5970dc42.slice/crio-d62c37bf27babbac7736321af0ba576a51df6f439af7c09d2da11ad15f845ecb WatchSource:0}: Error finding container d62c37bf27babbac7736321af0ba576a51df6f439af7c09d2da11ad15f845ecb: Status 404 returned error can't find the container with id d62c37bf27babbac7736321af0ba576a51df6f439af7c09d2da11ad15f845ecb Jun 09 12:04:01.482535 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:01.482496 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" event={"ID":"0c4d52e1-7898-492a-b003-437d5970dc42","Type":"ContainerStarted","Data":"d62c37bf27babbac7736321af0ba576a51df6f439af7c09d2da11ad15f845ecb"} Jun 09 12:04:04.496173 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:04.496140 2567 generic.go:356] "Generic (PLEG): container finished" podID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerID="b0f1142003be28c56f7d5b347f8d030a48f989459a84b856e481172d960cd57b" exitCode=0 Jun 09 12:04:04.496646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:04.496216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" event={"ID":"cd896f4d-3a67-473b-82d6-f53a1616a9bf","Type":"ContainerDied","Data":"b0f1142003be28c56f7d5b347f8d030a48f989459a84b856e481172d960cd57b"} Jun 09 12:04:04.498060 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:04.498033 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" event={"ID":"0c4d52e1-7898-492a-b003-437d5970dc42","Type":"ContainerStarted","Data":"575f4143e806d427b2c7e1e49e34d9e4cdd2a72a101ca3749adbf536d0f234c8"} Jun 09 12:04:04.498160 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:04.498142 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:04.545596 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:04.545473 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" podStartSLOduration=2.464416567 podStartE2EDuration="5.545457422s" totalImagesPullingTime="3.081040855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:04.543486416 +0000 UTC m=+550.409801222" watchObservedRunningTime="2026-06-09 12:04:04.545457422 +0000 UTC m=+550.411772227" Jun 09 12:04:05.504405 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:05.504369 2567 generic.go:356] "Generic (PLEG): container finished" podID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerID="826e80e069a763e5ee8f112b333579e025e3ba6ba94467c6eae5553c828ea5e8" exitCode=0 Jun 09 12:04:05.504783 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:05.504428 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" event={"ID":"cd896f4d-3a67-473b-82d6-f53a1616a9bf","Type":"ContainerDied","Data":"826e80e069a763e5ee8f112b333579e025e3ba6ba94467c6eae5553c828ea5e8"} Jun 09 12:04:06.632437 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.632414 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:06.711788 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.711735 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util\") pod \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " Jun 09 12:04:06.711975 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.711810 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle\") pod \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " Jun 09 12:04:06.711975 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.711878 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6flk\" (UniqueName: \"kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk\") pod \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\" (UID: \"cd896f4d-3a67-473b-82d6-f53a1616a9bf\") " Jun 09 12:04:06.712256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.712223 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle" (OuterVolumeSpecName: "bundle") pod "cd896f4d-3a67-473b-82d6-f53a1616a9bf" (UID: "cd896f4d-3a67-473b-82d6-f53a1616a9bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:06.714092 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.714069 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk" (OuterVolumeSpecName: "kube-api-access-b6flk") pod "cd896f4d-3a67-473b-82d6-f53a1616a9bf" (UID: "cd896f4d-3a67-473b-82d6-f53a1616a9bf"). InnerVolumeSpecName "kube-api-access-b6flk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:04:06.718203 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.718162 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util" (OuterVolumeSpecName: "util") pod "cd896f4d-3a67-473b-82d6-f53a1616a9bf" (UID: "cd896f4d-3a67-473b-82d6-f53a1616a9bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:06.812775 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.812673 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6flk\" (UniqueName: \"kubernetes.io/projected/cd896f4d-3a67-473b-82d6-f53a1616a9bf-kube-api-access-b6flk\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:06.812775 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.812706 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:06.812775 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:06.812715 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd896f4d-3a67-473b-82d6-f53a1616a9bf-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:07.515175 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:07.515136 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" event={"ID":"cd896f4d-3a67-473b-82d6-f53a1616a9bf","Type":"ContainerDied","Data":"b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474"} Jun 09 12:04:07.515377 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:07.515199 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9cf11fcdd8fc24a8d0fea53ee9e4fb394e53faa9806fb987b3cc7655b693474" Jun 09 12:04:07.515377 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:07.515149 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8sx82" Jun 09 12:04:10.506443 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.506412 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-nszb6" Jun 09 12:04:10.991205 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991169 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-l5dzf"] Jun 09 12:04:10.991452 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991441 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="pull" Jun 09 12:04:10.991497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991454 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="pull" Jun 09 12:04:10.991497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991474 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="util" Jun 09 12:04:10.991497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991481 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="util" Jun 09 12:04:10.991497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991489 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="extract" Jun 09 12:04:10.991497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991495 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="extract" Jun 09 12:04:10.991643 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.991542 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd896f4d-3a67-473b-82d6-f53a1616a9bf" containerName="extract" Jun 09 12:04:10.995497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.995478 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:10.998206 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:10.998181 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qq5sj\"" Jun 09 12:04:11.003725 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.003701 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-l5dzf"] Jun 09 12:04:11.044862 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.044827 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-bound-sa-token\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.045017 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.044874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ghjz\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-kube-api-access-7ghjz\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.145503 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.145466 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ghjz\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-kube-api-access-7ghjz\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.145706 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.145529 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-bound-sa-token\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.155810 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.155785 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-bound-sa-token\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.155942 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.155925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ghjz\" (UniqueName: \"kubernetes.io/projected/6a162dbb-08f4-453e-a053-1a87da5aa400-kube-api-access-7ghjz\") pod \"cert-manager-59c77684cc-l5dzf\" (UID: \"6a162dbb-08f4-453e-a053-1a87da5aa400\") " pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.305701 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.305590 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-l5dzf" Jun 09 12:04:11.432592 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.432560 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-l5dzf"] Jun 09 12:04:11.435590 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:04:11.435564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a162dbb_08f4_453e_a053_1a87da5aa400.slice/crio-c30ffff36e8b4d5910024029d3f4c74a4af24db31ec1a9baeb025e11c8ce5f7e WatchSource:0}: Error finding container c30ffff36e8b4d5910024029d3f4c74a4af24db31ec1a9baeb025e11c8ce5f7e: Status 404 returned error can't find the container with id c30ffff36e8b4d5910024029d3f4c74a4af24db31ec1a9baeb025e11c8ce5f7e Jun 09 12:04:11.534687 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.534654 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-l5dzf" event={"ID":"6a162dbb-08f4-453e-a053-1a87da5aa400","Type":"ContainerStarted","Data":"ccb8e0da4c0b4619fdb520e4d048ab3909f56e72368ace72d2347ee9de5a0fd2"} Jun 09 12:04:11.534687 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.534695 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-l5dzf" event={"ID":"6a162dbb-08f4-453e-a053-1a87da5aa400","Type":"ContainerStarted","Data":"c30ffff36e8b4d5910024029d3f4c74a4af24db31ec1a9baeb025e11c8ce5f7e"} Jun 09 12:04:11.561244 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:11.561154 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-l5dzf" podStartSLOduration=1.5611404169999998 podStartE2EDuration="1.561140417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:11.559956804 +0000 UTC m=+557.426271610" watchObservedRunningTime="2026-06-09 12:04:11.561140417 +0000 UTC m=+557.427455222" Jun 09 12:04:34.683262 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.683228 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l"] Jun 09 12:04:34.687663 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.687645 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.690309 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.690283 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:04:34.691495 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.691473 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:04:34.691582 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.691473 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l8kz9\"" Jun 09 12:04:34.695722 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.695699 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l"] Jun 09 12:04:34.834673 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.834629 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpmc\" (UniqueName: \"kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.834880 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.834683 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.834880 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.834710 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.935999 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.935912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.935999 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.935947 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.936187 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.936000 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpmc\" (UniqueName: \"kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.936395 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.936369 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.936430 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.936377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.950120 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.950090 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpmc\" (UniqueName: \"kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:34.997332 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:34.997298 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:35.132537 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:35.132512 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l"] Jun 09 12:04:35.134966 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:04:35.134933 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b091d8_d763_4f69_8e2a_aa9aea511d31.slice/crio-80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da WatchSource:0}: Error finding container 80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da: Status 404 returned error can't find the container with id 80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da Jun 09 12:04:35.635230 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:35.635194 2567 generic.go:356] "Generic (PLEG): container finished" podID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerID="7b177bb0cd3f2fca3fd6084e56965c0bd39f76ca60fdb8afc0e0506833946a0c" exitCode=0 Jun 09 12:04:35.635422 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:35.635243 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" event={"ID":"79b091d8-d763-4f69-8e2a-aa9aea511d31","Type":"ContainerDied","Data":"7b177bb0cd3f2fca3fd6084e56965c0bd39f76ca60fdb8afc0e0506833946a0c"} Jun 09 12:04:35.635422 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:35.635277 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" event={"ID":"79b091d8-d763-4f69-8e2a-aa9aea511d31","Type":"ContainerStarted","Data":"80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da"} Jun 09 12:04:36.641051 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:36.641012 2567 generic.go:356] "Generic (PLEG): container finished" podID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerID="809f49caf2c6d8b911feb9f514a2671832802e4de03f845476463ab4397ff457" exitCode=0 Jun 09 12:04:36.641420 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:36.641091 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" event={"ID":"79b091d8-d763-4f69-8e2a-aa9aea511d31","Type":"ContainerDied","Data":"809f49caf2c6d8b911feb9f514a2671832802e4de03f845476463ab4397ff457"} Jun 09 12:04:37.647634 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:37.647603 2567 generic.go:356] "Generic (PLEG): container finished" podID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerID="94c5153217807ff756adf4dfbaa71a3b590c78749a10f4184e335a225d3b44f9" exitCode=0 Jun 09 12:04:37.648051 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:37.647641 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" event={"ID":"79b091d8-d763-4f69-8e2a-aa9aea511d31","Type":"ContainerDied","Data":"94c5153217807ff756adf4dfbaa71a3b590c78749a10f4184e335a225d3b44f9"} Jun 09 12:04:38.776444 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.776415 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:38.865454 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.865417 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util\") pod \"79b091d8-d763-4f69-8e2a-aa9aea511d31\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " Jun 09 12:04:38.865613 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.865464 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle\") pod \"79b091d8-d763-4f69-8e2a-aa9aea511d31\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " Jun 09 12:04:38.865613 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.865565 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgpmc\" (UniqueName: \"kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc\") pod \"79b091d8-d763-4f69-8e2a-aa9aea511d31\" (UID: \"79b091d8-d763-4f69-8e2a-aa9aea511d31\") " Jun 09 12:04:38.866202 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.866166 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle" (OuterVolumeSpecName: "bundle") pod "79b091d8-d763-4f69-8e2a-aa9aea511d31" (UID: "79b091d8-d763-4f69-8e2a-aa9aea511d31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:38.867799 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.867752 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc" (OuterVolumeSpecName: "kube-api-access-xgpmc") pod "79b091d8-d763-4f69-8e2a-aa9aea511d31" (UID: "79b091d8-d763-4f69-8e2a-aa9aea511d31"). InnerVolumeSpecName "kube-api-access-xgpmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:04:38.871208 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.871172 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util" (OuterVolumeSpecName: "util") pod "79b091d8-d763-4f69-8e2a-aa9aea511d31" (UID: "79b091d8-d763-4f69-8e2a-aa9aea511d31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:04:38.966818 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.966706 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgpmc\" (UniqueName: \"kubernetes.io/projected/79b091d8-d763-4f69-8e2a-aa9aea511d31-kube-api-access-xgpmc\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:38.966818 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.966740 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:38.966818 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:38.966754 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79b091d8-d763-4f69-8e2a-aa9aea511d31-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:04:39.657746 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:39.657713 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" event={"ID":"79b091d8-d763-4f69-8e2a-aa9aea511d31","Type":"ContainerDied","Data":"80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da"} Jun 09 12:04:39.657746 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:39.657736 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdfwb7l" Jun 09 12:04:39.657957 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:39.657781 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80a4c66da98cd02a71a49997239146908373b1831ba870a7d823938f0bd148da" Jun 09 12:04:48.041778 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.041725 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs"] Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042019 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="pull" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042032 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="pull" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042048 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="extract" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042056 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="extract" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042066 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="util" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042071 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="util" Jun 09 12:04:48.042161 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.042113 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b091d8-d763-4f69-8e2a-aa9aea511d31" containerName="extract" Jun 09 12:04:48.044063 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.044046 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.048564 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.048543 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 12:04:48.048690 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.048619 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 12:04:48.048690 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.048673 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 12:04:48.048915 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.048897 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w9q64\"" Jun 09 12:04:48.049001 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.048905 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 12:04:48.078110 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.078086 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs"] Jun 09 12:04:48.139305 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.139278 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxzn\" (UniqueName: \"kubernetes.io/projected/9e39a88a-aced-498e-a58d-594d96458e83-kube-api-access-vjxzn\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.139431 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.139333 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.139508 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.139423 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.139508 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.139487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.139605 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.139525 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.240627 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.240573 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.240627 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.240630 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.240918 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.240653 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxzn\" (UniqueName: \"kubernetes.io/projected/9e39a88a-aced-498e-a58d-594d96458e83-kube-api-access-vjxzn\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.240918 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.240682 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.240918 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.240717 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.241111 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.241078 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-manifests\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.243068 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.243035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e39a88a-aced-498e-a58d-594d96458e83-tmp\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.243207 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.243188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-apiservice-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.243309 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.243291 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e39a88a-aced-498e-a58d-594d96458e83-webhook-cert\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.267389 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.267367 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxzn\" (UniqueName: \"kubernetes.io/projected/9e39a88a-aced-498e-a58d-594d96458e83-kube-api-access-vjxzn\") pod \"opendatahub-operator-controller-manager-656cd88b4c-8fkvs\" (UID: \"9e39a88a-aced-498e-a58d-594d96458e83\") " pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.354609 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.354513 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:48.492831 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.492797 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs"] Jun 09 12:04:48.496204 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:04:48.496176 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e39a88a_aced_498e_a58d_594d96458e83.slice/crio-bf3dfc3c80d1ba2326b7fc22efb9c8599bb6418b07bd44941508bc4cc5919487 WatchSource:0}: Error finding container bf3dfc3c80d1ba2326b7fc22efb9c8599bb6418b07bd44941508bc4cc5919487: Status 404 returned error can't find the container with id bf3dfc3c80d1ba2326b7fc22efb9c8599bb6418b07bd44941508bc4cc5919487 Jun 09 12:04:48.701370 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:48.701280 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" event={"ID":"9e39a88a-aced-498e-a58d-594d96458e83","Type":"ContainerStarted","Data":"bf3dfc3c80d1ba2326b7fc22efb9c8599bb6418b07bd44941508bc4cc5919487"} Jun 09 12:04:51.721013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:51.720972 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" event={"ID":"9e39a88a-aced-498e-a58d-594d96458e83","Type":"ContainerStarted","Data":"d785f72f0870ac6e872499fa5654efddd06f662c99a21c20698476ca3a18262c"} Jun 09 12:04:52.726153 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:52.726111 2567 generic.go:356] "Generic (PLEG): container finished" podID="9e39a88a-aced-498e-a58d-594d96458e83" containerID="d785f72f0870ac6e872499fa5654efddd06f662c99a21c20698476ca3a18262c" exitCode=0 Jun 09 12:04:52.726593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:52.726199 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" event={"ID":"9e39a88a-aced-498e-a58d-594d96458e83","Type":"ContainerDied","Data":"d785f72f0870ac6e872499fa5654efddd06f662c99a21c20698476ca3a18262c"} Jun 09 12:04:53.732074 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:53.732037 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" event={"ID":"9e39a88a-aced-498e-a58d-594d96458e83","Type":"ContainerStarted","Data":"9ad07620a6716a3ba29a61bbab175dca7d17f1ab0d90f0fa62caa66de8b3d159"} Jun 09 12:04:53.732545 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:53.732162 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:04:53.797154 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:04:53.797097 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" podStartSLOduration=1.667029604 podStartE2EDuration="5.797076943s" totalImagesPullingTime="3.13267429s" totalInitContainerRuntime="997.373049ms" isStatefulPod=false podCreationTimestamp="2026-06-09 12:04:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:04:53.791812782 +0000 UTC m=+599.658127619" watchObservedRunningTime="2026-06-09 12:04:53.797076943 +0000 UTC m=+599.663391750" Jun 09 12:05:04.738481 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:04.738454 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-656cd88b4c-8fkvs" Jun 09 12:05:07.456515 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.456476 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kpm6z"] Jun 09 12:05:07.462684 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.462664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:07.468247 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.468220 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-p26tk\"" Jun 09 12:05:07.470336 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.470319 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 12:05:07.478652 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.478629 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kpm6z"] Jun 09 12:05:07.487365 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.487336 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzg6g\" (UniqueName: \"kubernetes.io/projected/e6a48bf9-056a-4852-9879-4b6a5577c13e-kube-api-access-vzg6g\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:07.487480 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.487373 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:07.587801 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.587751 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzg6g\" (UniqueName: \"kubernetes.io/projected/e6a48bf9-056a-4852-9879-4b6a5577c13e-kube-api-access-vzg6g\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:07.587979 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.587807 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:07.587979 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:07.587920 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 12:05:07.587979 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:07.587974 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert podName:e6a48bf9-056a-4852-9879-4b6a5577c13e nodeName:}" failed. No retries permitted until 2026-06-09 12:05:08.087958801 +0000 UTC m=+613.954273585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert") pod "odh-model-controller-6dc94f689f-kpm6z" (UID: "e6a48bf9-056a-4852-9879-4b6a5577c13e") : secret "odh-model-controller-webhook-cert" not found Jun 09 12:05:07.614409 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:07.614374 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzg6g\" (UniqueName: \"kubernetes.io/projected/e6a48bf9-056a-4852-9879-4b6a5577c13e-kube-api-access-vzg6g\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:08.093263 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.093222 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:08.095732 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.095711 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6a48bf9-056a-4852-9879-4b6a5577c13e-cert\") pod \"odh-model-controller-6dc94f689f-kpm6z\" (UID: \"e6a48bf9-056a-4852-9879-4b6a5577c13e\") " pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:08.372918 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.372826 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:08.422235 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.422195 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sfscc"] Jun 09 12:05:08.425700 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.425677 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.428728 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.428706 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 12:05:08.428920 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.428865 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bswsv\"" Jun 09 12:05:08.442912 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.442852 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sfscc"] Jun 09 12:05:08.496854 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.496820 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/e019ab16-ba69-4bb2-9737-3de4cc9ff999-kube-api-access-mhgxc\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.497209 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.496859 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e019ab16-ba69-4bb2-9737-3de4cc9ff999-tls-certs\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.532065 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.532030 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-kpm6z"] Jun 09 12:05:08.536496 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:08.536462 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a48bf9_056a_4852_9879_4b6a5577c13e.slice/crio-a06147de55b4fa23cf82704bc839dd4c1958cc1e3003f303bec4e05a391cb7d4 WatchSource:0}: Error finding container a06147de55b4fa23cf82704bc839dd4c1958cc1e3003f303bec4e05a391cb7d4: Status 404 returned error can't find the container with id a06147de55b4fa23cf82704bc839dd4c1958cc1e3003f303bec4e05a391cb7d4 Jun 09 12:05:08.537981 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.537960 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:05:08.597720 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.597691 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/e019ab16-ba69-4bb2-9737-3de4cc9ff999-kube-api-access-mhgxc\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.597875 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.597732 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e019ab16-ba69-4bb2-9737-3de4cc9ff999-tls-certs\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.600261 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.600233 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e019ab16-ba69-4bb2-9737-3de4cc9ff999-tls-certs\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.619459 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.619427 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/e019ab16-ba69-4bb2-9737-3de4cc9ff999-kube-api-access-mhgxc\") pod \"model-serving-api-5dd488fc48-sfscc\" (UID: \"e019ab16-ba69-4bb2-9737-3de4cc9ff999\") " pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.739430 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.739396 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:08.799591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.799562 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" event={"ID":"e6a48bf9-056a-4852-9879-4b6a5577c13e","Type":"ContainerStarted","Data":"a06147de55b4fa23cf82704bc839dd4c1958cc1e3003f303bec4e05a391cb7d4"} Jun 09 12:05:08.898134 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:08.898107 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sfscc"] Jun 09 12:05:08.900645 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:08.900616 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode019ab16_ba69_4bb2_9737_3de4cc9ff999.slice/crio-1da7d74741c810cd89c7737ef61c3c1a1bcd0682674fb6b8c5abfa1942ba1116 WatchSource:0}: Error finding container 1da7d74741c810cd89c7737ef61c3c1a1bcd0682674fb6b8c5abfa1942ba1116: Status 404 returned error can't find the container with id 1da7d74741c810cd89c7737ef61c3c1a1bcd0682674fb6b8c5abfa1942ba1116 Jun 09 12:05:09.807219 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:09.807166 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" event={"ID":"e019ab16-ba69-4bb2-9737-3de4cc9ff999","Type":"ContainerStarted","Data":"1da7d74741c810cd89c7737ef61c3c1a1bcd0682674fb6b8c5abfa1942ba1116"} Jun 09 12:05:12.823602 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.823566 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" event={"ID":"e019ab16-ba69-4bb2-9737-3de4cc9ff999","Type":"ContainerStarted","Data":"9cbd1af1ba8f0a32efd5751dfe9671ec215b16c3c03d4a0daaa7eb33bbd6cc00"} Jun 09 12:05:12.824071 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.823662 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:12.825151 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.825128 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" event={"ID":"e6a48bf9-056a-4852-9879-4b6a5577c13e","Type":"ContainerStarted","Data":"d131d9ad748f38885659a92d24735f983ce9b6ab1c8203cebe08268be5ed6cec"} Jun 09 12:05:12.825264 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.825177 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:12.845362 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.845334 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p"] Jun 09 12:05:12.847950 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.847934 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:12.850830 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.850809 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 12:05:12.850952 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.850845 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 12:05:12.851242 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.851227 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 12:05:12.851509 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.851492 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 12:05:12.873690 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.873656 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p"] Jun 09 12:05:12.875948 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.875900 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" podStartSLOduration=1.6342319600000002 podStartE2EDuration="4.875885071s" totalImagesPullingTime="3.241653111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:12.869346516 +0000 UTC m=+618.735661343" watchObservedRunningTime="2026-06-09 12:05:12.875885071 +0000 UTC m=+618.742199876" Jun 09 12:05:12.935859 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.935821 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtz7f\" (UniqueName: \"kubernetes.io/projected/20ed3983-232c-4cc8-a8d3-933ca4d8966d-kube-api-access-dtz7f\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:12.936034 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.935881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:12.936034 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.935974 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tmp\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:12.963256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:12.963206 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" podStartSLOduration=2.365926049 podStartE2EDuration="5.963188655s" totalImagesPullingTime="3.597262606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:12.955092736 +0000 UTC m=+618.821407542" watchObservedRunningTime="2026-06-09 12:05:12.963188655 +0000 UTC m=+618.829503525" Jun 09 12:05:13.026323 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.026289 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464"] Jun 09 12:05:13.028680 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.028664 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.037037 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.037012 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.037136 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.037071 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tmp\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.037205 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:13.037184 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 12:05:13.037255 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:13.037247 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs podName:20ed3983-232c-4cc8-a8d3-933ca4d8966d nodeName:}" failed. No retries permitted until 2026-06-09 12:05:13.537227693 +0000 UTC m=+619.403542488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs") pod "kube-auth-proxy-68d7c54df5-5vr9p" (UID: "20ed3983-232c-4cc8-a8d3-933ca4d8966d") : secret "kube-auth-proxy-tls" not found Jun 09 12:05:13.037320 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.037270 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtz7f\" (UniqueName: \"kubernetes.io/projected/20ed3983-232c-4cc8-a8d3-933ca4d8966d-kube-api-access-dtz7f\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.039486 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.039465 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tmp\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.055106 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.055075 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l8kz9\"" Jun 09 12:05:13.055507 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.055490 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:05:13.066036 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.066011 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:05:13.085822 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.085724 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464"] Jun 09 12:05:13.088369 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.088343 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtz7f\" (UniqueName: \"kubernetes.io/projected/20ed3983-232c-4cc8-a8d3-933ca4d8966d-kube-api-access-dtz7f\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.137879 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.137840 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmd4c\" (UniqueName: \"kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.137879 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.137880 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.138179 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.137996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.238947 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.238898 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.239143 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.238995 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmd4c\" (UniqueName: \"kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.239143 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.239025 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.239324 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.239299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.239394 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.239376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.250724 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.250697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmd4c\" (UniqueName: \"kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.337515 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.337425 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:13.481250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.481224 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464"] Jun 09 12:05:13.483739 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:13.483711 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50d92bb_dbcc_438d_8417_1d3b6ba32d10.slice/crio-765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80 WatchSource:0}: Error finding container 765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80: Status 404 returned error can't find the container with id 765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80 Jun 09 12:05:13.541228 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.541201 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.543510 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.543488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ed3983-232c-4cc8-a8d3-933ca4d8966d-tls-certs\") pod \"kube-auth-proxy-68d7c54df5-5vr9p\" (UID: \"20ed3983-232c-4cc8-a8d3-933ca4d8966d\") " pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.757868 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.757835 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" Jun 09 12:05:13.831244 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.831210 2567 generic.go:356] "Generic (PLEG): container finished" podID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerID="81ea3890ff115a6e7f645c1489fbcb7554501d921c4c0d62fe6012ff76e39ed5" exitCode=0 Jun 09 12:05:13.831653 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.831288 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" event={"ID":"e50d92bb-dbcc-438d-8417-1d3b6ba32d10","Type":"ContainerDied","Data":"81ea3890ff115a6e7f645c1489fbcb7554501d921c4c0d62fe6012ff76e39ed5"} Jun 09 12:05:13.831653 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.831339 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" event={"ID":"e50d92bb-dbcc-438d-8417-1d3b6ba32d10","Type":"ContainerStarted","Data":"765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80"} Jun 09 12:05:13.907726 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:13.907694 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p"] Jun 09 12:05:13.909569 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:13.909547 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ed3983_232c_4cc8_a8d3_933ca4d8966d.slice/crio-568ceba2f1cc56c93c9fcaefa01b4a9ab10b1573bbddaa53d960f23bf73c41b3 WatchSource:0}: Error finding container 568ceba2f1cc56c93c9fcaefa01b4a9ab10b1573bbddaa53d960f23bf73c41b3: Status 404 returned error can't find the container with id 568ceba2f1cc56c93c9fcaefa01b4a9ab10b1573bbddaa53d960f23bf73c41b3 Jun 09 12:05:14.838531 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:14.838473 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" event={"ID":"20ed3983-232c-4cc8-a8d3-933ca4d8966d","Type":"ContainerStarted","Data":"568ceba2f1cc56c93c9fcaefa01b4a9ab10b1573bbddaa53d960f23bf73c41b3"} Jun 09 12:05:14.840656 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:14.840625 2567 generic.go:356] "Generic (PLEG): container finished" podID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerID="4b813bbac1bd0aaab8edaa0dd8d58ce3281f44f7a81144b67ea3c9de6429d2e9" exitCode=0 Jun 09 12:05:14.840815 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:14.840664 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" event={"ID":"e50d92bb-dbcc-438d-8417-1d3b6ba32d10","Type":"ContainerDied","Data":"4b813bbac1bd0aaab8edaa0dd8d58ce3281f44f7a81144b67ea3c9de6429d2e9"} Jun 09 12:05:15.847597 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:15.847563 2567 generic.go:356] "Generic (PLEG): container finished" podID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerID="7486dcf7cef38e0209beeb2c4eeff7663480c8bd2a55680a2dc35808a8170383" exitCode=0 Jun 09 12:05:15.848037 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:15.847646 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" event={"ID":"e50d92bb-dbcc-438d-8417-1d3b6ba32d10","Type":"ContainerDied","Data":"7486dcf7cef38e0209beeb2c4eeff7663480c8bd2a55680a2dc35808a8170383"} Jun 09 12:05:15.849109 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:15.849081 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" event={"ID":"20ed3983-232c-4cc8-a8d3-933ca4d8966d","Type":"ContainerStarted","Data":"b56b98ca764f123f1be4924b5e851ef0bddf8a2920e12491d07cde5c3e004f3a"} Jun 09 12:05:15.973502 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:15.973439 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68d7c54df5-5vr9p" podStartSLOduration=2.121898887 podStartE2EDuration="3.973423152s" totalImagesPullingTime="1.851524265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:15.97183937 +0000 UTC m=+621.838154176" watchObservedRunningTime="2026-06-09 12:05:15.973423152 +0000 UTC m=+621.839737986" Jun 09 12:05:16.982375 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:16.982346 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:17.074013 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.073984 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmd4c\" (UniqueName: \"kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c\") pod \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " Jun 09 12:05:17.074149 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.074041 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util\") pod \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " Jun 09 12:05:17.074149 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.074064 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle\") pod \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\" (UID: \"e50d92bb-dbcc-438d-8417-1d3b6ba32d10\") " Jun 09 12:05:17.074982 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.074947 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle" (OuterVolumeSpecName: "bundle") pod "e50d92bb-dbcc-438d-8417-1d3b6ba32d10" (UID: "e50d92bb-dbcc-438d-8417-1d3b6ba32d10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:17.076250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.076224 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c" (OuterVolumeSpecName: "kube-api-access-mmd4c") pod "e50d92bb-dbcc-438d-8417-1d3b6ba32d10" (UID: "e50d92bb-dbcc-438d-8417-1d3b6ba32d10"). InnerVolumeSpecName "kube-api-access-mmd4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:05:17.082622 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.082593 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util" (OuterVolumeSpecName: "util") pod "e50d92bb-dbcc-438d-8417-1d3b6ba32d10" (UID: "e50d92bb-dbcc-438d-8417-1d3b6ba32d10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:17.174749 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.174665 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmd4c\" (UniqueName: \"kubernetes.io/projected/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-kube-api-access-mmd4c\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:17.174749 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.174696 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:17.174749 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.174706 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e50d92bb-dbcc-438d-8417-1d3b6ba32d10-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:17.860503 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.860472 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" event={"ID":"e50d92bb-dbcc-438d-8417-1d3b6ba32d10","Type":"ContainerDied","Data":"765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80"} Jun 09 12:05:17.860503 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.860501 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fg464" Jun 09 12:05:17.860721 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:17.860520 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="765c4a7d9a80289bd8f19dc7eb261557e0a4ff1d31a25247e60a521835008e80" Jun 09 12:05:19.479735 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.479699 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bwtc7"] Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480155 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="util" Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480175 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="util" Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480192 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="extract" Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480200 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="extract" Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480221 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="pull" Jun 09 12:05:19.480256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480229 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="pull" Jun 09 12:05:19.480539 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.480305 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50d92bb-dbcc-438d-8417-1d3b6ba32d10" containerName="extract" Jun 09 12:05:19.482342 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.482322 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.499179 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.499154 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 12:05:19.500497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.500480 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-k7rd5\"" Jun 09 12:05:19.523975 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.523931 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bwtc7"] Jun 09 12:05:19.584944 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.584913 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh"] Jun 09 12:05:19.587059 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.587039 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.592986 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.592959 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8196fac-7ab6-4155-b4fa-3dfef72dea58-cert\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.593107 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.593086 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzsbh\" (UniqueName: \"kubernetes.io/projected/d8196fac-7ab6-4155-b4fa-3dfef72dea58-kube-api-access-rzsbh\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.651785 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:19.651719 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-129-223.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-223.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" Jun 09 12:05:19.652063 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:19.652038 2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" is forbidden: User \"system:node:ip-10-0-129-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-223.ec2.internal' and this object" podUID="c5a6bdb6-7abc-46e4-8545-3535e6fd1d09" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.656194 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:05:19.656173 2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-controller-manager-dockercfg-7gtbv\" is forbidden: User \"system:node:ip-10-0-129-223.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-223.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7gtbv\"" type="*v1.Secret" Jun 09 12:05:19.666843 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.666809 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh"] Jun 09 12:05:19.694192 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.694156 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzsbh\" (UniqueName: \"kubernetes.io/projected/d8196fac-7ab6-4155-b4fa-3dfef72dea58-kube-api-access-rzsbh\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.694351 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.694208 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdsls\" (UniqueName: \"kubernetes.io/projected/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-kube-api-access-bdsls\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.694351 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.694242 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.694496 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.694369 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8196fac-7ab6-4155-b4fa-3dfef72dea58-cert\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.696952 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.696927 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8196fac-7ab6-4155-b4fa-3dfef72dea58-cert\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.712520 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.712487 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzsbh\" (UniqueName: \"kubernetes.io/projected/d8196fac-7ab6-4155-b4fa-3dfef72dea58-kube-api-access-rzsbh\") pod \"kserve-controller-manager-69fc866d76-bwtc7\" (UID: \"d8196fac-7ab6-4155-b4fa-3dfef72dea58\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.792632 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.792537 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:19.795774 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.795744 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdsls\" (UniqueName: \"kubernetes.io/projected/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-kube-api-access-bdsls\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.795843 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.795820 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.815343 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.815308 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdsls\" (UniqueName: \"kubernetes.io/projected/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-kube-api-access-bdsls\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:19.958558 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:19.958523 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bwtc7"] Jun 09 12:05:19.964186 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:19.964152 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8196fac_7ab6_4155_b4fa_3dfef72dea58.slice/crio-83a3ce6a220923228c5c632652bf671bf10eecc745388b31e91d5802a998315d WatchSource:0}: Error finding container 83a3ce6a220923228c5c632652bf671bf10eecc745388b31e91d5802a998315d: Status 404 returned error can't find the container with id 83a3ce6a220923228c5c632652bf671bf10eecc745388b31e91d5802a998315d Jun 09 12:05:20.703151 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:20.703118 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 12:05:20.709005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:20.708977 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5a6bdb6-7abc-46e4-8545-3535e6fd1d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rq6mh\" (UID: \"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:20.880258 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:20.880216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" event={"ID":"d8196fac-7ab6-4155-b4fa-3dfef72dea58","Type":"ContainerStarted","Data":"83a3ce6a220923228c5c632652bf671bf10eecc745388b31e91d5802a998315d"} Jun 09 12:05:21.022523 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:21.022485 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7gtbv\"" Jun 09 12:05:21.027486 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:21.027454 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:21.206680 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:21.206648 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh"] Jun 09 12:05:21.209196 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:21.209155 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5a6bdb6_7abc_46e4_8545_3535e6fd1d09.slice/crio-f6f8659274e607ec28feb4422830c740861282f0322d5602ec8c15996d68a23e WatchSource:0}: Error finding container f6f8659274e607ec28feb4422830c740861282f0322d5602ec8c15996d68a23e: Status 404 returned error can't find the container with id f6f8659274e607ec28feb4422830c740861282f0322d5602ec8c15996d68a23e Jun 09 12:05:21.886553 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:21.886513 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" event={"ID":"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09","Type":"ContainerStarted","Data":"f6f8659274e607ec28feb4422830c740861282f0322d5602ec8c15996d68a23e"} Jun 09 12:05:22.893679 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:22.893641 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" event={"ID":"d8196fac-7ab6-4155-b4fa-3dfef72dea58","Type":"ContainerStarted","Data":"df5d4ddd2b5e829fde0856c854f4457f806149e6474ed992c7e2b1c8c7f03867"} Jun 09 12:05:22.894092 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:22.893872 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:22.947557 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:22.947375 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" podStartSLOduration=1.707296467 podStartE2EDuration="3.947353275s" totalImagesPullingTime="2.240056808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:22.943189401 +0000 UTC m=+628.809504211" watchObservedRunningTime="2026-06-09 12:05:22.947353275 +0000 UTC m=+628.813668082" Jun 09 12:05:23.833887 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:23.833851 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-kpm6z" Jun 09 12:05:23.836418 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:23.836395 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sfscc" Jun 09 12:05:24.905286 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:24.905243 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" event={"ID":"c5a6bdb6-7abc-46e4-8545-3535e6fd1d09","Type":"ContainerStarted","Data":"c3761526a219a32b34afef40c9b7eb8a6ea52d85997882d17f59ace231b1c01f"} Jun 09 12:05:24.905649 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:24.905367 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:05:24.946618 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:24.946564 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" podStartSLOduration=3.1320090130000002 podStartE2EDuration="5.946545646s" totalImagesPullingTime="2.814536633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:24.943352561 +0000 UTC m=+630.809667366" watchObservedRunningTime="2026-06-09 12:05:24.946545646 +0000 UTC m=+630.812860452" Jun 09 12:05:27.704521 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.704480 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7"] Jun 09 12:05:27.707097 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.707079 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.710333 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.710309 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 12:05:27.711536 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.711518 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 12:05:27.711591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.711531 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-l8kz9\"" Jun 09 12:05:27.735472 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.735440 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7"] Jun 09 12:05:27.769261 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.769235 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47np7\" (UniqueName: \"kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.769365 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.769280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.769365 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.769341 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.870415 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.870373 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.870584 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.870435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47np7\" (UniqueName: \"kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.870584 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.870476 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.870848 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.870826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.870916 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.870854 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:27.890064 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:27.890035 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47np7\" (UniqueName: \"kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:28.016595 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:28.016566 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:28.199588 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:28.199557 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7"] Jun 09 12:05:28.202022 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:28.201993 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7729689_1e21_4a55_92bd_74538efc3481.slice/crio-0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb WatchSource:0}: Error finding container 0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb: Status 404 returned error can't find the container with id 0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb Jun 09 12:05:28.924801 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:28.924741 2567 generic.go:356] "Generic (PLEG): container finished" podID="f7729689-1e21-4a55-92bd-74538efc3481" containerID="d62478318b702e29a19a63d723a20c11f3f5b52efce080d4539218e5c424a986" exitCode=0 Jun 09 12:05:28.925184 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:28.924847 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" event={"ID":"f7729689-1e21-4a55-92bd-74538efc3481","Type":"ContainerDied","Data":"d62478318b702e29a19a63d723a20c11f3f5b52efce080d4539218e5c424a986"} Jun 09 12:05:28.925184 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:28.924908 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" event={"ID":"f7729689-1e21-4a55-92bd-74538efc3481","Type":"ContainerStarted","Data":"0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb"} Jun 09 12:05:29.931925 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.931885 2567 generic.go:356] "Generic (PLEG): container finished" podID="f7729689-1e21-4a55-92bd-74538efc3481" containerID="18ac65eb92e1754d69316c6bb88c794926b3250e6c90e3b9f22e947cb9f0259f" exitCode=0 Jun 09 12:05:29.932314 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.931971 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" event={"ID":"f7729689-1e21-4a55-92bd-74538efc3481","Type":"ContainerDied","Data":"18ac65eb92e1754d69316c6bb88c794926b3250e6c90e3b9f22e947cb9f0259f"} Jun 09 12:05:29.979078 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.979044 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-cc45d96b7-9bf66"] Jun 09 12:05:29.989299 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.989264 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:29.992417 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.992395 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9r49m\"" Jun 09 12:05:29.993415 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:29.993394 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 12:05:30.006577 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.006548 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-cc45d96b7-9bf66"] Jun 09 12:05:30.088249 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.088210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-redirect-config\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.088447 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.088275 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2q7k\" (UniqueName: \"kubernetes.io/projected/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-kube-api-access-s2q7k\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.189473 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.189407 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-redirect-config\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.189473 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.189451 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2q7k\" (UniqueName: \"kubernetes.io/projected/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-kube-api-access-s2q7k\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.190193 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.190174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-redirect-config\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.203546 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.203507 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2q7k\" (UniqueName: \"kubernetes.io/projected/12414066-9cd4-41f4-9eb3-4f9606ef9cfb-kube-api-access-s2q7k\") pod \"dashboard-redirect-cc45d96b7-9bf66\" (UID: \"12414066-9cd4-41f4-9eb3-4f9606ef9cfb\") " pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.290049 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.290009 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm"] Jun 09 12:05:30.292612 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.292596 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.297142 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.297124 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-6l6vs\"" Jun 09 12:05:30.297499 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.297485 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 12:05:30.299151 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.299114 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" Jun 09 12:05:30.301682 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.301662 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 12:05:30.321981 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.321956 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm"] Jun 09 12:05:30.391056 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.390978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k5xt\" (UniqueName: \"kubernetes.io/projected/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-kube-api-access-2k5xt\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.391586 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.391093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.445086 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.445061 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-cc45d96b7-9bf66"] Jun 09 12:05:30.446941 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:30.446910 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12414066_9cd4_41f4_9eb3_4f9606ef9cfb.slice/crio-6776218d977f9a3d9650a612a3d2f5ceb3e22fb8cbf001562fff252b9e2171d0 WatchSource:0}: Error finding container 6776218d977f9a3d9650a612a3d2f5ceb3e22fb8cbf001562fff252b9e2171d0: Status 404 returned error can't find the container with id 6776218d977f9a3d9650a612a3d2f5ceb3e22fb8cbf001562fff252b9e2171d0 Jun 09 12:05:30.492566 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.492518 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.492723 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.492594 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k5xt\" (UniqueName: \"kubernetes.io/projected/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-kube-api-access-2k5xt\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.495317 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.495299 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.510798 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.510750 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k5xt\" (UniqueName: \"kubernetes.io/projected/16c5a5c1-dedf-496d-b64a-8a01c10fa54e-kube-api-access-2k5xt\") pod \"servicemesh-operator3-57f65f65fb-kqlbm\" (UID: \"16c5a5c1-dedf-496d-b64a-8a01c10fa54e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.601927 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.601891 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:30.772394 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:30.772360 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c5a5c1_dedf_496d_b64a_8a01c10fa54e.slice/crio-561d92858aa17cb798bcca6ba519ce7c7f557a1bc666b8e15823e04e09852888 WatchSource:0}: Error finding container 561d92858aa17cb798bcca6ba519ce7c7f557a1bc666b8e15823e04e09852888: Status 404 returned error can't find the container with id 561d92858aa17cb798bcca6ba519ce7c7f557a1bc666b8e15823e04e09852888 Jun 09 12:05:30.772746 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.772723 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm"] Jun 09 12:05:30.939288 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.939252 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" event={"ID":"16c5a5c1-dedf-496d-b64a-8a01c10fa54e","Type":"ContainerStarted","Data":"561d92858aa17cb798bcca6ba519ce7c7f557a1bc666b8e15823e04e09852888"} Jun 09 12:05:30.940489 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.940466 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" event={"ID":"12414066-9cd4-41f4-9eb3-4f9606ef9cfb","Type":"ContainerStarted","Data":"6776218d977f9a3d9650a612a3d2f5ceb3e22fb8cbf001562fff252b9e2171d0"} Jun 09 12:05:30.942579 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.942548 2567 generic.go:356] "Generic (PLEG): container finished" podID="f7729689-1e21-4a55-92bd-74538efc3481" containerID="9be846ab1c1cfe8eb876d774d4e1b840bfd7679b942b44eb40b8f0e1ad37f633" exitCode=0 Jun 09 12:05:30.942683 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:30.942625 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" event={"ID":"f7729689-1e21-4a55-92bd-74538efc3481","Type":"ContainerDied","Data":"9be846ab1c1cfe8eb876d774d4e1b840bfd7679b942b44eb40b8f0e1ad37f633"} Jun 09 12:05:32.105756 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.105726 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:32.210382 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.210284 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47np7\" (UniqueName: \"kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7\") pod \"f7729689-1e21-4a55-92bd-74538efc3481\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " Jun 09 12:05:32.210382 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.210333 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util\") pod \"f7729689-1e21-4a55-92bd-74538efc3481\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " Jun 09 12:05:32.210608 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.210400 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle\") pod \"f7729689-1e21-4a55-92bd-74538efc3481\" (UID: \"f7729689-1e21-4a55-92bd-74538efc3481\") " Jun 09 12:05:32.211432 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.211400 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle" (OuterVolumeSpecName: "bundle") pod "f7729689-1e21-4a55-92bd-74538efc3481" (UID: "f7729689-1e21-4a55-92bd-74538efc3481"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:32.212876 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.212840 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7" (OuterVolumeSpecName: "kube-api-access-47np7") pod "f7729689-1e21-4a55-92bd-74538efc3481" (UID: "f7729689-1e21-4a55-92bd-74538efc3481"). InnerVolumeSpecName "kube-api-access-47np7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:05:32.217186 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.217145 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util" (OuterVolumeSpecName: "util") pod "f7729689-1e21-4a55-92bd-74538efc3481" (UID: "f7729689-1e21-4a55-92bd-74538efc3481"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:05:32.311163 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.311120 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47np7\" (UniqueName: \"kubernetes.io/projected/f7729689-1e21-4a55-92bd-74538efc3481-kube-api-access-47np7\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:32.311163 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.311162 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:32.311342 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.311179 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7729689-1e21-4a55-92bd-74538efc3481-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:05:32.961958 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.961871 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" event={"ID":"f7729689-1e21-4a55-92bd-74538efc3481","Type":"ContainerDied","Data":"0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb"} Jun 09 12:05:32.961958 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.961929 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asf6h7" Jun 09 12:05:32.962137 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:32.961927 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f140c5ddb1fac25482f749874b472e4c05ec615a051760c3346a8ff06cf3abb" Jun 09 12:05:33.970379 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:33.970340 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" event={"ID":"16c5a5c1-dedf-496d-b64a-8a01c10fa54e","Type":"ContainerStarted","Data":"7459ccb51d706b67035dc8effcc68eceaa42b2c8d1143aadfe23e9617b29f225"} Jun 09 12:05:33.970785 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:33.970517 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:33.995692 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:33.995641 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" podStartSLOduration=1.5763595590000001 podStartE2EDuration="3.995625961s" totalImagesPullingTime="2.419266402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:33.992843086 +0000 UTC m=+639.859157911" watchObservedRunningTime="2026-06-09 12:05:33.995625961 +0000 UTC m=+639.861940767" Jun 09 12:05:37.991595 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:37.991553 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" event={"ID":"12414066-9cd4-41f4-9eb3-4f9606ef9cfb","Type":"ContainerStarted","Data":"5f5c722412538d99a05b31c098133e33e0e722ab9469c0ba760cbda7bc1ff5ef"} Jun 09 12:05:38.014894 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:38.014844 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-cc45d96b7-9bf66" podStartSLOduration=2.256781365 podStartE2EDuration="9.014827806s" totalImagesPullingTime="6.758046441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:38.012375125 +0000 UTC m=+643.878689930" watchObservedRunningTime="2026-06-09 12:05:38.014827806 +0000 UTC m=+643.881142611" Jun 09 12:05:44.365671 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.365631 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng"] Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.365958 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="extract" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.365970 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="extract" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.365983 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="pull" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.365989 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="pull" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.366005 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="util" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.366010 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="util" Jun 09 12:05:44.366289 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.366063 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7729689-1e21-4a55-92bd-74538efc3481" containerName="extract" Jun 09 12:05:44.368033 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.368009 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.372287 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.372262 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 12:05:44.372488 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.372267 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 12:05:44.372736 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.372721 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 12:05:44.372995 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.372978 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b9ksn\"" Jun 09 12:05:44.373066 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.373015 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 12:05:44.390602 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.390531 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng"] Jun 09 12:05:44.516434 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516399 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516434 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516437 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5lbd\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-kube-api-access-k5lbd\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516535 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70713f5f-a7b7-45ab-a935-e466fb596314-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516558 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516577 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.516631 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.516597 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.617610 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617523 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70713f5f-a7b7-45ab-a935-e466fb596314-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.617610 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617552 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.617610 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617569 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.617610 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617589 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.617610 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617613 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.618010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617642 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.618010 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.617697 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5lbd\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-kube-api-access-k5lbd\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.618373 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.618344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.620249 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.620221 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.620418 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.620365 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.620556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.620532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/70713f5f-a7b7-45ab-a935-e466fb596314-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.620718 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.620695 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/70713f5f-a7b7-45ab-a935-e466fb596314-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.625847 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.625825 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.626061 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.626040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5lbd\" (UniqueName: \"kubernetes.io/projected/70713f5f-a7b7-45ab-a935-e466fb596314-kube-api-access-k5lbd\") pod \"istiod-openshift-gateway-75c67f8887-gmnng\" (UID: \"70713f5f-a7b7-45ab-a935-e466fb596314\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.677576 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.677538 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:44.832084 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.832050 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng"] Jun 09 12:05:44.833186 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:05:44.833146 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70713f5f_a7b7_45ab_a935_e466fb596314.slice/crio-6b00c514c35fc9a41eb3e49f17a086d3ea02fd3cc7ab0821132007c092eb2df2 WatchSource:0}: Error finding container 6b00c514c35fc9a41eb3e49f17a086d3ea02fd3cc7ab0821132007c092eb2df2: Status 404 returned error can't find the container with id 6b00c514c35fc9a41eb3e49f17a086d3ea02fd3cc7ab0821132007c092eb2df2 Jun 09 12:05:44.977914 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:44.977879 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-kqlbm" Jun 09 12:05:45.026312 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:45.026279 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" event={"ID":"70713f5f-a7b7-45ab-a935-e466fb596314","Type":"ContainerStarted","Data":"6b00c514c35fc9a41eb3e49f17a086d3ea02fd3cc7ab0821132007c092eb2df2"} Jun 09 12:05:48.064651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:48.064608 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 12:05:48.064954 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:48.064687 2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 12:05:49.050198 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:49.050162 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" event={"ID":"70713f5f-a7b7-45ab-a935-e466fb596314","Type":"ContainerStarted","Data":"e90a6fc7fc18232c93989bcb077f25bd9a9b2ddf25cb1f637b0e730af7e02051"} Jun 09 12:05:49.050385 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:49.050332 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:49.052390 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:49.052361 2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-gmnng container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 12:05:49.052522 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:49.052414 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" podUID="70713f5f-a7b7-45ab-a935-e466fb596314" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 12:05:49.095376 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:49.095320 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" podStartSLOduration=1.866896926 podStartE2EDuration="5.09530337s" totalImagesPullingTime="3.228406444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:05:49.09346327 +0000 UTC m=+654.959778098" watchObservedRunningTime="2026-06-09 12:05:49.09530337 +0000 UTC m=+654.961618176" Jun 09 12:05:50.056335 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:50.056305 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-gmnng" Jun 09 12:05:53.905688 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:53.905660 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bwtc7" Jun 09 12:05:55.912734 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:05:55.912698 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rq6mh" Jun 09 12:06:19.011128 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.011092 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c7d696d89-chgn5"] Jun 09 12:06:19.014678 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.014656 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.024818 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.024786 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7d696d89-chgn5"] Jun 09 12:06:19.105475 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gclp\" (UniqueName: \"kubernetes.io/projected/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-kube-api-access-4gclp\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105678 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105524 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-service-ca\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105678 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105593 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105678 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-oauth-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105881 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105697 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-trusted-ca-bundle\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105881 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105735 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.105881 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.105794 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-oauth-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207101 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207062 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-oauth-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207101 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207099 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-trusted-ca-bundle\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207128 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207147 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-oauth-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207174 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gclp\" (UniqueName: \"kubernetes.io/projected/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-kube-api-access-4gclp\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207232 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-service-ca\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.207359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.207271 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.208070 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.208047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.208235 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.208216 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-trusted-ca-bundle\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.208276 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.208219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-oauth-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.208354 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.208330 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-service-ca\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.209814 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.209786 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-oauth-config\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.209926 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.209909 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-console-serving-cert\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.216127 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.216098 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gclp\" (UniqueName: \"kubernetes.io/projected/dcdc8174-0667-4143-b9f1-adcd9c47f3c3-kube-api-access-4gclp\") pod \"console-c7d696d89-chgn5\" (UID: \"dcdc8174-0667-4143-b9f1-adcd9c47f3c3\") " pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.324629 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.324530 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:19.469335 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:19.469305 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7d696d89-chgn5"] Jun 09 12:06:19.471220 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:19.471193 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdc8174_0667_4143_b9f1_adcd9c47f3c3.slice/crio-80b5612479e117c29dae85648f658ae1177f28c2d58fa00ed5173df75828231b WatchSource:0}: Error finding container 80b5612479e117c29dae85648f658ae1177f28c2d58fa00ed5173df75828231b: Status 404 returned error can't find the container with id 80b5612479e117c29dae85648f658ae1177f28c2d58fa00ed5173df75828231b Jun 09 12:06:20.208979 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:20.208947 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7d696d89-chgn5" event={"ID":"dcdc8174-0667-4143-b9f1-adcd9c47f3c3","Type":"ContainerStarted","Data":"82236d1e3944108fa7c5e5bce659acad8af6d91cd29d0eb17909fd3444a2a423"} Jun 09 12:06:20.208979 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:20.208996 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7d696d89-chgn5" event={"ID":"dcdc8174-0667-4143-b9f1-adcd9c47f3c3","Type":"ContainerStarted","Data":"80b5612479e117c29dae85648f658ae1177f28c2d58fa00ed5173df75828231b"} Jun 09 12:06:20.231392 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:20.231335 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c7d696d89-chgn5" podStartSLOduration=2.231316011 podStartE2EDuration="2.231316011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:20.229034151 +0000 UTC m=+686.095348978" watchObservedRunningTime="2026-06-09 12:06:20.231316011 +0000 UTC m=+686.097630816" Jun 09 12:06:25.993973 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:25.993939 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr"] Jun 09 12:06:26.002468 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.002443 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.006255 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.006209 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:26.006255 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.006227 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:26.006255 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.006241 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pbsjp\"" Jun 09 12:06:26.007337 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.007311 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr"] Jun 09 12:06:26.176245 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.176199 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.176417 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.176263 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrbv8\" (UniqueName: \"kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.176417 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.176334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.277420 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.277327 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.277420 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.277370 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrbv8\" (UniqueName: \"kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.277420 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.277405 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.277711 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.277690 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.277822 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.277746 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.287224 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.287188 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrbv8\" (UniqueName: \"kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.313060 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.313024 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:26.459646 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.459619 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr"] Jun 09 12:06:26.461519 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:26.461492 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b80681_1491_441e_9e04_6aa1bfcd0503.slice/crio-1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc WatchSource:0}: Error finding container 1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc: Status 404 returned error can't find the container with id 1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc Jun 09 12:06:26.603578 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.603537 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc"] Jun 09 12:06:26.607139 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.607120 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.620250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.620225 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc"] Jun 09 12:06:26.782059 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.782019 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.782269 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.782131 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z7w4\" (UniqueName: \"kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.782269 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.782190 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.883528 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.883435 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z7w4\" (UniqueName: \"kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.883528 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.883477 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.883728 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.883537 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.883925 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.883907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.883966 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.883943 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.893040 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.893013 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z7w4\" (UniqueName: \"kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:26.937751 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:26.937718 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:27.000952 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.000911 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d"] Jun 09 12:06:27.005080 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.005053 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.016049 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.016021 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d"] Jun 09 12:06:27.083929 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.083900 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc"] Jun 09 12:06:27.085343 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:27.085314 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b0b036_bb34_412d_97d4_b63f10784603.slice/crio-cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147 WatchSource:0}: Error finding container cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147: Status 404 returned error can't find the container with id cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147 Jun 09 12:06:27.185700 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.185673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78c6\" (UniqueName: \"kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.185824 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.185778 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.185875 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.185834 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.249175 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.249134 2567 generic.go:356] "Generic (PLEG): container finished" podID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerID="38b839883f01d1b93f7b95b72e2b6b2c3693fdc7f1c44c8e877c3ce0eb17e923" exitCode=0 Jun 09 12:06:27.249393 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.249235 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" event={"ID":"59b80681-1491-441e-9e04-6aa1bfcd0503","Type":"ContainerDied","Data":"38b839883f01d1b93f7b95b72e2b6b2c3693fdc7f1c44c8e877c3ce0eb17e923"} Jun 09 12:06:27.249393 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.249295 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" event={"ID":"59b80681-1491-441e-9e04-6aa1bfcd0503","Type":"ContainerStarted","Data":"1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc"} Jun 09 12:06:27.250963 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.250942 2567 generic.go:356] "Generic (PLEG): container finished" podID="45b0b036-bb34-412d-97d4-b63f10784603" containerID="421725a3a9ac46c2d2d5218cff37377b4d3f05ed22a31527578a63fd8c9061ff" exitCode=0 Jun 09 12:06:27.251061 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.250996 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" event={"ID":"45b0b036-bb34-412d-97d4-b63f10784603","Type":"ContainerDied","Data":"421725a3a9ac46c2d2d5218cff37377b4d3f05ed22a31527578a63fd8c9061ff"} Jun 09 12:06:27.251061 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.251024 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" event={"ID":"45b0b036-bb34-412d-97d4-b63f10784603","Type":"ContainerStarted","Data":"cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147"} Jun 09 12:06:27.286949 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.286908 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.287124 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.286974 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.287124 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.287046 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78c6\" (UniqueName: \"kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.287307 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.287286 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.287358 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.287337 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.296989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.296965 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78c6\" (UniqueName: \"kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.315413 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.315383 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:27.393458 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.393386 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d"] Jun 09 12:06:27.397114 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.397087 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.409495 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.409460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d"] Jun 09 12:06:27.463485 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.463460 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d"] Jun 09 12:06:27.464939 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:27.464914 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f3003f_8aab_43ea_967a_5d3d0f31d320.slice/crio-e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46 WatchSource:0}: Error finding container e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46: Status 404 returned error can't find the container with id e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46 Jun 09 12:06:27.488429 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.488404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgwbp\" (UniqueName: \"kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.488541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.488476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.488541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.488532 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.589920 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.589885 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.590076 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.589941 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgwbp\" (UniqueName: \"kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.590076 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.590017 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.590275 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.590258 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.590341 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.590321 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.599586 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.599562 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgwbp\" (UniqueName: \"kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.707625 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.707547 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:27.889088 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:27.889057 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d"] Jun 09 12:06:27.937446 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:27.937410 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63405be0_7c79_4ad2_a85e_8b8026fed1d5.slice/crio-4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca WatchSource:0}: Error finding container 4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca: Status 404 returned error can't find the container with id 4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca Jun 09 12:06:28.261504 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.261404 2567 generic.go:356] "Generic (PLEG): container finished" podID="45b0b036-bb34-412d-97d4-b63f10784603" containerID="f8321489fe1666452644d2392dd86d8645a42a1df486a47b8332da4ccfa31f4d" exitCode=0 Jun 09 12:06:28.261984 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.261505 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" event={"ID":"45b0b036-bb34-412d-97d4-b63f10784603","Type":"ContainerDied","Data":"f8321489fe1666452644d2392dd86d8645a42a1df486a47b8332da4ccfa31f4d"} Jun 09 12:06:28.263098 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.263051 2567 generic.go:356] "Generic (PLEG): container finished" podID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerID="00e241f090ad32ada7fe1b4a39a28ea0a6fda9e552aeb9417d8db3d2acedacc2" exitCode=0 Jun 09 12:06:28.263196 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.263156 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" event={"ID":"63405be0-7c79-4ad2-a85e-8b8026fed1d5","Type":"ContainerDied","Data":"00e241f090ad32ada7fe1b4a39a28ea0a6fda9e552aeb9417d8db3d2acedacc2"} Jun 09 12:06:28.263196 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.263193 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" event={"ID":"63405be0-7c79-4ad2-a85e-8b8026fed1d5","Type":"ContainerStarted","Data":"4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca"} Jun 09 12:06:28.265188 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.265163 2567 generic.go:356] "Generic (PLEG): container finished" podID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerID="3cce95371fe9e3eec6376fdbd16a1b6a818ed454f2d7e596daa8c3fd4f0aadf1" exitCode=0 Jun 09 12:06:28.265292 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.265254 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" event={"ID":"59b80681-1491-441e-9e04-6aa1bfcd0503","Type":"ContainerDied","Data":"3cce95371fe9e3eec6376fdbd16a1b6a818ed454f2d7e596daa8c3fd4f0aadf1"} Jun 09 12:06:28.267051 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.267027 2567 generic.go:356] "Generic (PLEG): container finished" podID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerID="156340485fde1ec4461699195c1005f1efe4c0eb9c8c565201e25b26e6d30d05" exitCode=0 Jun 09 12:06:28.267175 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.267151 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" event={"ID":"47f3003f-8aab-43ea-967a-5d3d0f31d320","Type":"ContainerDied","Data":"156340485fde1ec4461699195c1005f1efe4c0eb9c8c565201e25b26e6d30d05"} Jun 09 12:06:28.267243 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:28.267198 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" event={"ID":"47f3003f-8aab-43ea-967a-5d3d0f31d320","Type":"ContainerStarted","Data":"e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46"} Jun 09 12:06:29.275018 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.274982 2567 generic.go:356] "Generic (PLEG): container finished" podID="45b0b036-bb34-412d-97d4-b63f10784603" containerID="bffddf7a2344760ef098365905aa7238cefba55beb6cec35671681f1cdeba7d1" exitCode=0 Jun 09 12:06:29.275465 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.275028 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" event={"ID":"45b0b036-bb34-412d-97d4-b63f10784603","Type":"ContainerDied","Data":"bffddf7a2344760ef098365905aa7238cefba55beb6cec35671681f1cdeba7d1"} Jun 09 12:06:29.276886 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.276863 2567 generic.go:356] "Generic (PLEG): container finished" podID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerID="e798465f245750609dd623f479623fcd0888b65b67b09d9542831ea778d2ae13" exitCode=0 Jun 09 12:06:29.277014 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.276936 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" event={"ID":"63405be0-7c79-4ad2-a85e-8b8026fed1d5","Type":"ContainerDied","Data":"e798465f245750609dd623f479623fcd0888b65b67b09d9542831ea778d2ae13"} Jun 09 12:06:29.279046 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.279026 2567 generic.go:356] "Generic (PLEG): container finished" podID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerID="6c3ab8c081dbc0476322e13143191400000ccc2c3ec3a7862b6021bb5200ca8b" exitCode=0 Jun 09 12:06:29.279146 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.279102 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" event={"ID":"59b80681-1491-441e-9e04-6aa1bfcd0503","Type":"ContainerDied","Data":"6c3ab8c081dbc0476322e13143191400000ccc2c3ec3a7862b6021bb5200ca8b"} Jun 09 12:06:29.280885 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.280865 2567 generic.go:356] "Generic (PLEG): container finished" podID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerID="4999e726c100118ac5ab12590d15458626b2fd1c0f062f34da6d5fa4e6440c90" exitCode=0 Jun 09 12:06:29.280978 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.280940 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" event={"ID":"47f3003f-8aab-43ea-967a-5d3d0f31d320","Type":"ContainerDied","Data":"4999e726c100118ac5ab12590d15458626b2fd1c0f062f34da6d5fa4e6440c90"} Jun 09 12:06:29.324849 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.324821 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:29.324955 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.324914 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:29.329969 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:29.329942 2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:30.289119 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.289080 2567 generic.go:356] "Generic (PLEG): container finished" podID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerID="f8fa18a9122a873f2280c6efc82d38bf78af84f1c778040c488b329955ecce17" exitCode=0 Jun 09 12:06:30.289593 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.289159 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" event={"ID":"63405be0-7c79-4ad2-a85e-8b8026fed1d5","Type":"ContainerDied","Data":"f8fa18a9122a873f2280c6efc82d38bf78af84f1c778040c488b329955ecce17"} Jun 09 12:06:30.291037 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.291019 2567 generic.go:356] "Generic (PLEG): container finished" podID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerID="38b9b96df6a5231afd0f4d1a482dfa43ae1ff6d0b49968e9049dbbce4f8a4163" exitCode=0 Jun 09 12:06:30.291149 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.291047 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" event={"ID":"47f3003f-8aab-43ea-967a-5d3d0f31d320","Type":"ContainerDied","Data":"38b9b96df6a5231afd0f4d1a482dfa43ae1ff6d0b49968e9049dbbce4f8a4163"} Jun 09 12:06:30.295471 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.295446 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c7d696d89-chgn5" Jun 09 12:06:30.362223 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.362192 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:06:30.469259 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.469233 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:30.472342 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.472316 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:30.617481 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.617372 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util\") pod \"45b0b036-bb34-412d-97d4-b63f10784603\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " Jun 09 12:06:30.617481 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.617467 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle\") pod \"45b0b036-bb34-412d-97d4-b63f10784603\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " Jun 09 12:06:30.617720 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.617505 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z7w4\" (UniqueName: \"kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4\") pod \"45b0b036-bb34-412d-97d4-b63f10784603\" (UID: \"45b0b036-bb34-412d-97d4-b63f10784603\") " Jun 09 12:06:30.617720 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.617536 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle\") pod \"59b80681-1491-441e-9e04-6aa1bfcd0503\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " Jun 09 12:06:30.617720 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.617580 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util\") pod \"59b80681-1491-441e-9e04-6aa1bfcd0503\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " Jun 09 12:06:30.618144 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.618115 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrbv8\" (UniqueName: \"kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8\") pod \"59b80681-1491-441e-9e04-6aa1bfcd0503\" (UID: \"59b80681-1491-441e-9e04-6aa1bfcd0503\") " Jun 09 12:06:30.618257 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.618120 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle" (OuterVolumeSpecName: "bundle") pod "45b0b036-bb34-412d-97d4-b63f10784603" (UID: "45b0b036-bb34-412d-97d4-b63f10784603"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:30.618257 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.618125 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle" (OuterVolumeSpecName: "bundle") pod "59b80681-1491-441e-9e04-6aa1bfcd0503" (UID: "59b80681-1491-441e-9e04-6aa1bfcd0503"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:30.618374 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.618356 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:30.618374 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.618375 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:30.620656 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.620617 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4" (OuterVolumeSpecName: "kube-api-access-4z7w4") pod "45b0b036-bb34-412d-97d4-b63f10784603" (UID: "45b0b036-bb34-412d-97d4-b63f10784603"). InnerVolumeSpecName "kube-api-access-4z7w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:30.620780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.620687 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8" (OuterVolumeSpecName: "kube-api-access-lrbv8") pod "59b80681-1491-441e-9e04-6aa1bfcd0503" (UID: "59b80681-1491-441e-9e04-6aa1bfcd0503"). InnerVolumeSpecName "kube-api-access-lrbv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:30.623818 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.623793 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util" (OuterVolumeSpecName: "util") pod "59b80681-1491-441e-9e04-6aa1bfcd0503" (UID: "59b80681-1491-441e-9e04-6aa1bfcd0503"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:30.623923 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.623903 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util" (OuterVolumeSpecName: "util") pod "45b0b036-bb34-412d-97d4-b63f10784603" (UID: "45b0b036-bb34-412d-97d4-b63f10784603"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:30.719442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.719394 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z7w4\" (UniqueName: \"kubernetes.io/projected/45b0b036-bb34-412d-97d4-b63f10784603-kube-api-access-4z7w4\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:30.719442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.719434 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59b80681-1491-441e-9e04-6aa1bfcd0503-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:30.719442 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.719447 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrbv8\" (UniqueName: \"kubernetes.io/projected/59b80681-1491-441e-9e04-6aa1bfcd0503-kube-api-access-lrbv8\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:30.719681 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:30.719460 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45b0b036-bb34-412d-97d4-b63f10784603-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.298636 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.298602 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" Jun 09 12:06:31.298636 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.298624 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr" event={"ID":"59b80681-1491-441e-9e04-6aa1bfcd0503","Type":"ContainerDied","Data":"1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc"} Jun 09 12:06:31.299187 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.298672 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e61a080d3a33d579be8c47c73901e6ea1062cc72cb7fb711e48e12302d12fcc" Jun 09 12:06:31.300524 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.300497 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" Jun 09 12:06:31.300623 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.300546 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc" event={"ID":"45b0b036-bb34-412d-97d4-b63f10784603","Type":"ContainerDied","Data":"cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147"} Jun 09 12:06:31.300623 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.300582 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbdc708332c7a3ef6c01159e1c6297a1a8eb4d6478ab34806099e1bffbd51147" Jun 09 12:06:31.453787 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.453746 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:31.455960 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.455944 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:31.628005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.627915 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r78c6\" (UniqueName: \"kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6\") pod \"47f3003f-8aab-43ea-967a-5d3d0f31d320\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " Jun 09 12:06:31.628005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.627989 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle\") pod \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " Jun 09 12:06:31.628250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628044 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util\") pod \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " Jun 09 12:06:31.628250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628072 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgwbp\" (UniqueName: \"kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp\") pod \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\" (UID: \"63405be0-7c79-4ad2-a85e-8b8026fed1d5\") " Jun 09 12:06:31.628250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628092 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle\") pod \"47f3003f-8aab-43ea-967a-5d3d0f31d320\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " Jun 09 12:06:31.628250 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628130 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util\") pod \"47f3003f-8aab-43ea-967a-5d3d0f31d320\" (UID: \"47f3003f-8aab-43ea-967a-5d3d0f31d320\") " Jun 09 12:06:31.628736 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628704 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle" (OuterVolumeSpecName: "bundle") pod "63405be0-7c79-4ad2-a85e-8b8026fed1d5" (UID: "63405be0-7c79-4ad2-a85e-8b8026fed1d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:31.628971 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.628946 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle" (OuterVolumeSpecName: "bundle") pod "47f3003f-8aab-43ea-967a-5d3d0f31d320" (UID: "47f3003f-8aab-43ea-967a-5d3d0f31d320"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:31.630304 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.630284 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6" (OuterVolumeSpecName: "kube-api-access-r78c6") pod "47f3003f-8aab-43ea-967a-5d3d0f31d320" (UID: "47f3003f-8aab-43ea-967a-5d3d0f31d320"). InnerVolumeSpecName "kube-api-access-r78c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:31.630582 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.630566 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp" (OuterVolumeSpecName: "kube-api-access-rgwbp") pod "63405be0-7c79-4ad2-a85e-8b8026fed1d5" (UID: "63405be0-7c79-4ad2-a85e-8b8026fed1d5"). InnerVolumeSpecName "kube-api-access-rgwbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:31.634175 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.634140 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util" (OuterVolumeSpecName: "util") pod "47f3003f-8aab-43ea-967a-5d3d0f31d320" (UID: "47f3003f-8aab-43ea-967a-5d3d0f31d320"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:31.636294 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.636271 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util" (OuterVolumeSpecName: "util") pod "63405be0-7c79-4ad2-a85e-8b8026fed1d5" (UID: "63405be0-7c79-4ad2-a85e-8b8026fed1d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 12:06:31.729651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729596 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.729651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729643 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgwbp\" (UniqueName: \"kubernetes.io/projected/63405be0-7c79-4ad2-a85e-8b8026fed1d5-kube-api-access-rgwbp\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.729651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729655 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.729651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729663 2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47f3003f-8aab-43ea-967a-5d3d0f31d320-util\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.729651 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729672 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r78c6\" (UniqueName: \"kubernetes.io/projected/47f3003f-8aab-43ea-967a-5d3d0f31d320-kube-api-access-r78c6\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:31.730000 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:31.729679 2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63405be0-7c79-4ad2-a85e-8b8026fed1d5-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:32.307932 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.307897 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" Jun 09 12:06:32.308330 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.307891 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d" event={"ID":"63405be0-7c79-4ad2-a85e-8b8026fed1d5","Type":"ContainerDied","Data":"4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca"} Jun 09 12:06:32.308330 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.307999 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c29d12b77f30fca038143e72e708337c41c70cc5733add1b0bac3d35adc17ca" Jun 09 12:06:32.310016 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.309990 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" Jun 09 12:06:32.310112 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.310017 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d" event={"ID":"47f3003f-8aab-43ea-967a-5d3d0f31d320","Type":"ContainerDied","Data":"e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46"} Jun 09 12:06:32.310112 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:32.310052 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e728689d01dfa4d0c5c81ef51a68699d9a35f502a90085653fd5ec1c8adfaf46" Jun 09 12:06:46.900624 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.900536 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-74brn"] Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901008 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901023 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901038 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="extract" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901044 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="extract" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901052 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="util" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901057 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="util" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901065 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="extract" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901071 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="extract" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901078 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901083 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901089 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="util" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901094 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="util" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901099 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901104 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="pull" Jun 09 12:06:46.901102 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901109 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901114 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901121 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="pull" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901126 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="pull" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901134 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="util" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901139 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="util" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901144 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="util" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901149 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="util" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901154 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901159 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901210 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="63405be0-7c79-4ad2-a85e-8b8026fed1d5" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901216 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b0b036-bb34-412d-97d4-b63f10784603" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901223 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f3003f-8aab-43ea-967a-5d3d0f31d320" containerName="extract" Jun 09 12:06:46.901541 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.901229 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="59b80681-1491-441e-9e04-6aa1bfcd0503" containerName="extract" Jun 09 12:06:46.903977 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.903961 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:46.908794 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.908747 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 12:06:46.908951 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.908930 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 12:06:46.909020 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.909006 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f42ss\"" Jun 09 12:06:46.924645 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.924615 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-74brn"] Jun 09 12:06:46.945125 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:46.945085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk4dz\" (UniqueName: \"kubernetes.io/projected/108f8991-459e-499c-bb0a-4d85e38df2d8-kube-api-access-mk4dz\") pod \"authorino-operator-75cc8d5cb7-74brn\" (UID: \"108f8991-459e-499c-bb0a-4d85e38df2d8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:47.046256 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:47.046220 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk4dz\" (UniqueName: \"kubernetes.io/projected/108f8991-459e-499c-bb0a-4d85e38df2d8-kube-api-access-mk4dz\") pod \"authorino-operator-75cc8d5cb7-74brn\" (UID: \"108f8991-459e-499c-bb0a-4d85e38df2d8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:47.060506 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:47.060471 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk4dz\" (UniqueName: \"kubernetes.io/projected/108f8991-459e-499c-bb0a-4d85e38df2d8-kube-api-access-mk4dz\") pod \"authorino-operator-75cc8d5cb7-74brn\" (UID: \"108f8991-459e-499c-bb0a-4d85e38df2d8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:47.214017 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:47.213923 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:47.378185 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:47.378159 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-74brn"] Jun 09 12:06:47.379469 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:06:47.379443 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108f8991_459e_499c_bb0a_4d85e38df2d8.slice/crio-2b7759fd5b6ad409ef1b73e98c648db53e982bc9d9d04bbe1fe6e60b4095fd61 WatchSource:0}: Error finding container 2b7759fd5b6ad409ef1b73e98c648db53e982bc9d9d04bbe1fe6e60b4095fd61: Status 404 returned error can't find the container with id 2b7759fd5b6ad409ef1b73e98c648db53e982bc9d9d04bbe1fe6e60b4095fd61 Jun 09 12:06:47.391158 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:47.391127 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" event={"ID":"108f8991-459e-499c-bb0a-4d85e38df2d8","Type":"ContainerStarted","Data":"2b7759fd5b6ad409ef1b73e98c648db53e982bc9d9d04bbe1fe6e60b4095fd61"} Jun 09 12:06:50.413562 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:50.413524 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" event={"ID":"108f8991-459e-499c-bb0a-4d85e38df2d8","Type":"ContainerStarted","Data":"99b8113fc64a5406f9cce246e3781f5f916176b501e291eefd70e5a04c24f23e"} Jun 09 12:06:50.413998 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:50.413592 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:06:50.455756 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:50.455690 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" podStartSLOduration=2.311259923 podStartE2EDuration="4.4556699s" totalImagesPullingTime="2.144409977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:06:50.454516396 +0000 UTC m=+716.320831202" watchObservedRunningTime="2026-06-09 12:06:50.4556699 +0000 UTC m=+716.321984707" Jun 09 12:06:55.386655 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.386593 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58756b976f-vkhpw" podUID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" containerName="console" containerID="cri-o://a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900" gracePeriod=15 Jun 09 12:06:55.635624 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.635594 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:06:55.720294 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720270 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720474 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720308 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720474 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720349 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720588 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720468 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlphs\" (UniqueName: \"kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720588 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720508 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720588 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720535 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720588 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720565 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config\") pod \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\" (UID: \"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7\") " Jun 09 12:06:55.720898 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720854 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca" (OuterVolumeSpecName: "service-ca") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:55.721068 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.720957 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:55.721134 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.721111 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:55.721337 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.721313 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config" (OuterVolumeSpecName: "console-config") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:06:55.722912 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.722868 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:06:55.722912 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.722890 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs" (OuterVolumeSpecName: "kube-api-access-zlphs") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "kube-api-access-zlphs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:06:55.723117 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.723054 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" (UID: "afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:06:55.822005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.821972 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlphs\" (UniqueName: \"kubernetes.io/projected/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-kube-api-access-zlphs\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822001 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-oauth-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822005 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822011 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-trusted-ca-bundle\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822230 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822021 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822230 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822030 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-serving-cert\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822230 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822038 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-service-ca\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:55.822230 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:55.822046 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7-console-oauth-config\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:06:56.449128 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.449088 2567 generic.go:356] "Generic (PLEG): container finished" podID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" containerID="a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900" exitCode=0 Jun 09 12:06:56.449556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.449136 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58756b976f-vkhpw" Jun 09 12:06:56.449556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.449164 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58756b976f-vkhpw" event={"ID":"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7","Type":"ContainerDied","Data":"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900"} Jun 09 12:06:56.449556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.449216 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58756b976f-vkhpw" event={"ID":"afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7","Type":"ContainerDied","Data":"8c5d2139cda2c52e0380e93af0b3d274a51840198ec39ba4aefff052ca4e60a6"} Jun 09 12:06:56.449556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.449242 2567 scope.go:117] "RemoveContainer" containerID="a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900" Jun 09 12:06:56.465475 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.465450 2567 scope.go:117] "RemoveContainer" containerID="a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900" Jun 09 12:06:56.465741 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:06:56.465719 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900\": container with ID starting with a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900 not found: ID does not exist" containerID="a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900" Jun 09 12:06:56.465811 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.465751 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900"} err="failed to get container status \"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900\": rpc error: code = NotFound desc = could not find container \"a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900\": container with ID starting with a6876f5544c58b6f2d3e9bd6adcdad8eb7a2e8970b7446c9a4ae471c3ba37900 not found: ID does not exist" Jun 09 12:06:56.483105 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.483072 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:06:56.488598 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.488571 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58756b976f-vkhpw"] Jun 09 12:06:56.617677 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:06:56.617642 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" path="/var/lib/kubelet/pods/afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7/volumes" Jun 09 12:07:01.421343 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:01.421305 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-74brn" Jun 09 12:07:48.502310 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.502253 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:07:48.503092 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.503068 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" containerName="console" Jun 09 12:07:48.503092 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.503095 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" containerName="console" Jun 09 12:07:48.503292 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.503279 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="afb612ab-a0c3-4f6f-a6ff-a15306c2b9d7" containerName="console" Jun 09 12:07:48.507129 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.507103 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.515007 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.514979 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pbsjp\"" Jun 09 12:07:48.515129 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.515065 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 12:07:48.523575 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.523549 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:07:48.573184 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.573150 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:07:48.573571 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.573545 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.573637 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.573622 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88gz\" (UniqueName: \"kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.674627 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.674593 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.674844 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.674650 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h88gz\" (UniqueName: \"kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.675305 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.675283 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.684302 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.684280 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h88gz\" (UniqueName: \"kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz\") pod \"limitador-limitador-64c94fd64f-dz5kz\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.817549 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.817455 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:48.968781 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:48.968736 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:07:48.971168 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:07:48.971138 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0538ed9f_6823_4f3c_8a0c_da7c9e684415.slice/crio-8f09db358159ae51d83bf9105f11ecd52d65c0050880d98c2a39c53c2d57aff4 WatchSource:0}: Error finding container 8f09db358159ae51d83bf9105f11ecd52d65c0050880d98c2a39c53c2d57aff4: Status 404 returned error can't find the container with id 8f09db358159ae51d83bf9105f11ecd52d65c0050880d98c2a39c53c2d57aff4 Jun 09 12:07:49.743069 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:49.743031 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" event={"ID":"0538ed9f-6823-4f3c-8a0c-da7c9e684415","Type":"ContainerStarted","Data":"8f09db358159ae51d83bf9105f11ecd52d65c0050880d98c2a39c53c2d57aff4"} Jun 09 12:07:51.757283 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:51.757245 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" event={"ID":"0538ed9f-6823-4f3c-8a0c-da7c9e684415","Type":"ContainerStarted","Data":"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30"} Jun 09 12:07:51.757687 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:51.757318 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:07:51.775604 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:07:51.775552 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" podStartSLOduration=1.140216335 podStartE2EDuration="3.775535853s" totalImagesPullingTime="2.635319518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:07:51.774328314 +0000 UTC m=+777.640643143" watchObservedRunningTime="2026-06-09 12:07:51.775535853 +0000 UTC m=+777.641850668" Jun 09 12:08:02.764359 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:02.764327 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:08:03.557476 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:03.557440 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:08:03.557670 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:03.557622 2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" podUID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" containerName="limitador" containerID="cri-o://52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30" gracePeriod=30 Jun 09 12:08:04.116518 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.116491 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:08:04.217548 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.217516 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file\") pod \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " Jun 09 12:08:04.217708 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.217561 2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h88gz\" (UniqueName: \"kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz\") pod \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\" (UID: \"0538ed9f-6823-4f3c-8a0c-da7c9e684415\") " Jun 09 12:08:04.217978 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.217953 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file" (OuterVolumeSpecName: "config-file") pod "0538ed9f-6823-4f3c-8a0c-da7c9e684415" (UID: "0538ed9f-6823-4f3c-8a0c-da7c9e684415"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:08:04.219940 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.219913 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz" (OuterVolumeSpecName: "kube-api-access-h88gz") pod "0538ed9f-6823-4f3c-8a0c-da7c9e684415" (UID: "0538ed9f-6823-4f3c-8a0c-da7c9e684415"). InnerVolumeSpecName "kube-api-access-h88gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:08:04.318438 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.318391 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0538ed9f-6823-4f3c-8a0c-da7c9e684415-config-file\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:08:04.318438 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.318429 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h88gz\" (UniqueName: \"kubernetes.io/projected/0538ed9f-6823-4f3c-8a0c-da7c9e684415-kube-api-access-h88gz\") on node \"ip-10-0-129-223.ec2.internal\" DevicePath \"\"" Jun 09 12:08:04.834127 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.834089 2567 generic.go:356] "Generic (PLEG): container finished" podID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" containerID="52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30" exitCode=0 Jun 09 12:08:04.834313 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.834147 2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" Jun 09 12:08:04.834313 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.834172 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" event={"ID":"0538ed9f-6823-4f3c-8a0c-da7c9e684415","Type":"ContainerDied","Data":"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30"} Jun 09 12:08:04.834313 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.834257 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-dz5kz" event={"ID":"0538ed9f-6823-4f3c-8a0c-da7c9e684415","Type":"ContainerDied","Data":"8f09db358159ae51d83bf9105f11ecd52d65c0050880d98c2a39c53c2d57aff4"} Jun 09 12:08:04.834313 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.834285 2567 scope.go:117] "RemoveContainer" containerID="52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30" Jun 09 12:08:04.843466 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.843444 2567 scope.go:117] "RemoveContainer" containerID="52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30" Jun 09 12:08:04.843785 ip-10-0-129-223 kubenswrapper[2567]: E0609 12:08:04.843742 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30\": container with ID starting with 52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30 not found: ID does not exist" containerID="52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30" Jun 09 12:08:04.843859 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.843792 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30"} err="failed to get container status \"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30\": rpc error: code = NotFound desc = could not find container \"52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30\": container with ID starting with 52cac3d62ee8177a0c10687726a9574b0fa71722c8d149fe47f88857531b2d30 not found: ID does not exist" Jun 09 12:08:04.852124 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.852088 2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:08:04.858212 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:04.858183 2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-dz5kz"] Jun 09 12:08:06.617752 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:06.617719 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" path="/var/lib/kubelet/pods/0538ed9f-6823-4f3c-8a0c-da7c9e684415/volumes" Jun 09 12:08:07.356174 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:07.356138 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-cc45d96b7-9bf66_12414066-9cd4-41f4-9eb3-4f9606ef9cfb/nginx/0.log" Jun 09 12:08:07.585139 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:07.585108 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bwtc7_d8196fac-7ab6-4155-b4fa-3dfef72dea58/manager/0.log" Jun 09 12:08:07.700778 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:07.700677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rq6mh_c5a6bdb6-7abc-46e4-8545-3535e6fd1d09/manager/0.log" Jun 09 12:08:07.819966 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:07.819939 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sfscc_e019ab16-ba69-4bb2-9737-3de4cc9ff999/server/0.log" Jun 09 12:08:07.933502 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:07.933468 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kpm6z_e6a48bf9-056a-4852-9879-4b6a5577c13e/manager/0.log" Jun 09 12:08:08.048112 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:08.048081 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-8fkvs_9e39a88a-aced-498e-a58d-594d96458e83/manager/0.log" Jun 09 12:08:08.054639 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:08.054607 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-8fkvs_9e39a88a-aced-498e-a58d-594d96458e83/copy-manifests/0.log" Jun 09 12:08:08.980736 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:08.980705 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/util/0.log" Jun 09 12:08:08.987497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:08.987475 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/pull/0.log" Jun 09 12:08:08.994875 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:08.994846 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/extract/0.log" Jun 09 12:08:09.104933 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.104902 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/util/0.log" Jun 09 12:08:09.111717 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.111686 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/pull/0.log" Jun 09 12:08:09.118303 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.118281 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/extract/0.log" Jun 09 12:08:09.226982 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.226950 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/util/0.log" Jun 09 12:08:09.234684 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.234614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/pull/0.log" Jun 09 12:08:09.242054 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.242032 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/extract/0.log" Jun 09 12:08:09.352335 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.352302 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/util/0.log" Jun 09 12:08:09.358517 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.358497 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/pull/0.log" Jun 09 12:08:09.364710 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.364689 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/extract/0.log" Jun 09 12:08:09.594349 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:09.594272 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-74brn_108f8991-459e-499c-bb0a-4d85e38df2d8/manager/0.log" Jun 09 12:08:10.748245 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:10.748206 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gmnng_70713f5f-a7b7-45ab-a935-e466fb596314/discovery/0.log" Jun 09 12:08:10.857873 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:10.857841 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-5vr9p_20ed3983-232c-4cc8-a8d3-933ca4d8966d/kube-auth-proxy/0.log" Jun 09 12:08:18.601595 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:18.601561 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kkntp_49fb2c18-42d5-4c83-b3f6-aac5dbfd8083/global-pull-secret-syncer/0.log" Jun 09 12:08:18.703441 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:18.703408 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lsbn5_d083a496-f29b-4b6c-b323-25c2f663dc27/konnectivity-agent/0.log" Jun 09 12:08:18.723371 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:18.723340 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-223.ec2.internal_696c8cfe943a182a33032adecd257449/haproxy/0.log" Jun 09 12:08:22.337179 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:22.337145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-kqlbm_16c5a5c1-dedf-496d-b64a-8a01c10fa54e/sail-operator/0.log" Jun 09 12:08:23.680647 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.680614 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/extract/0.log" Jun 09 12:08:23.722497 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.722471 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/util/0.log" Jun 09 12:08:23.758281 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.758249 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926ptr_59b80681-1491-441e-9e04-6aa1bfcd0503/pull/0.log" Jun 09 12:08:23.799198 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.799167 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/extract/0.log" Jun 09 12:08:23.827969 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.827942 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/util/0.log" Jun 09 12:08:23.868511 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.868481 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqnhc_45b0b036-bb34-412d-97d4-b63f10784603/pull/0.log" Jun 09 12:08:23.937687 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.937576 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/extract/0.log" Jun 09 12:08:23.966264 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.966229 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/util/0.log" Jun 09 12:08:23.990738 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:23.990708 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737wq9d_63405be0-7c79-4ad2-a85e-8b8026fed1d5/pull/0.log" Jun 09 12:08:24.040488 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:24.040454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/extract/0.log" Jun 09 12:08:24.086716 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:24.086679 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/util/0.log" Jun 09 12:08:24.116391 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:24.116366 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lv45d_47f3003f-8aab-43ea-967a-5d3d0f31d320/pull/0.log" Jun 09 12:08:24.178301 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:24.178273 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-74brn_108f8991-459e-499c-bb0a-4d85e38df2d8/manager/0.log" Jun 09 12:08:26.476716 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:26.476686 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88xk2_475257bb-d9b8-4e88-86b5-08e7e24dbf5f/node-exporter/0.log" Jun 09 12:08:26.508808 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:26.508776 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88xk2_475257bb-d9b8-4e88-86b5-08e7e24dbf5f/kube-rbac-proxy/0.log" Jun 09 12:08:26.534721 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:26.534697 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-88xk2_475257bb-d9b8-4e88-86b5-08e7e24dbf5f/init-textfile/0.log" Jun 09 12:08:28.536355 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.536321 2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr"] Jun 09 12:08:28.536992 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.536689 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" containerName="limitador" Jun 09 12:08:28.536992 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.536707 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" containerName="limitador" Jun 09 12:08:28.536992 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.536851 2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0538ed9f-6823-4f3c-8a0c-da7c9e684415" containerName="limitador" Jun 09 12:08:28.543369 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.543349 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.546803 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.546773 2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-96slk\"/\"default-dockercfg-kxqrm\"" Jun 09 12:08:28.546934 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.546808 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96slk\"/\"openshift-service-ca.crt\"" Jun 09 12:08:28.547880 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.547862 2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96slk\"/\"kube-root-ca.crt\"" Jun 09 12:08:28.552556 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.552533 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr"] Jun 09 12:08:28.615524 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.615489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf4t9\" (UniqueName: \"kubernetes.io/projected/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-kube-api-access-gf4t9\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.615727 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.615547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-proc\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.615727 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.615575 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-sys\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.615727 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.615598 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-podres\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.615727 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.615642 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-lib-modules\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716700 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716659 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-podres\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716700 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716706 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-lib-modules\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716748 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf4t9\" (UniqueName: \"kubernetes.io/projected/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-kube-api-access-gf4t9\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716851 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-proc\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-podres\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-lib-modules\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716912 2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-sys\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716925 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-proc\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.716989 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.716946 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-sys\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.732369 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.732344 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf4t9\" (UniqueName: \"kubernetes.io/projected/bdd3e170-19dd-4017-8c7e-a98d0e08d52a-kube-api-access-gf4t9\") pod \"perf-node-gather-daemonset-th9fr\" (UID: \"bdd3e170-19dd-4017-8c7e-a98d0e08d52a\") " pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.854527 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.854434 2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:28.932434 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:28.932402 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-df6mx_54727fd7-e573-4d34-b317-1349a79e35b8/networking-console-plugin/0.log" Jun 09 12:08:29.006940 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:29.006909 2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr"] Jun 09 12:08:29.008512 ip-10-0-129-223 kubenswrapper[2567]: W0609 12:08:29.008484 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdd3e170_19dd_4017_8c7e_a98d0e08d52a.slice/crio-82a13dc8c2899798db799b9fdc1e6621c31ae82affcee8616eb03e65d1620ace WatchSource:0}: Error finding container 82a13dc8c2899798db799b9fdc1e6621c31ae82affcee8616eb03e65d1620ace: Status 404 returned error can't find the container with id 82a13dc8c2899798db799b9fdc1e6621c31ae82affcee8616eb03e65d1620ace Jun 09 12:08:29.974463 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:29.974397 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" event={"ID":"bdd3e170-19dd-4017-8c7e-a98d0e08d52a","Type":"ContainerStarted","Data":"14476f77d7b9299d702ad4dfce0f6927488f2b3bd1322069d0c6a2a38afb466f"} Jun 09 12:08:29.974938 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:29.974480 2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" event={"ID":"bdd3e170-19dd-4017-8c7e-a98d0e08d52a","Type":"ContainerStarted","Data":"82a13dc8c2899798db799b9fdc1e6621c31ae82affcee8616eb03e65d1620ace"} Jun 09 12:08:29.974938 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:29.974531 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:29.994456 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:29.994401 2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" podStartSLOduration=1.99438557 podStartE2EDuration="1.99438557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:08:29.992072643 +0000 UTC m=+815.858387469" watchObservedRunningTime="2026-06-09 12:08:29.99438557 +0000 UTC m=+815.860700376" Jun 09 12:08:30.110318 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:30.110284 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c7d696d89-chgn5_dcdc8174-0667-4143-b9f1-adcd9c47f3c3/console/0.log" Jun 09 12:08:30.145731 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:30.145699 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-j6hwg_db7fec50-f838-4b99-a0d7-47c6b2560f82/download-server/0.log" Jun 09 12:08:30.738686 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:30.738645 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-z6l8n_d4c2e16c-7193-4f7f-953b-7d8e5b7bf621/volume-data-source-validator/0.log" Jun 09 12:08:31.931472 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:31.931428 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdqnq_f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a/dns/0.log" Jun 09 12:08:31.965140 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:31.965112 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jdqnq_f8df7731-63e3-4d3e-b8a2-ce8f7f2eff6a/kube-rbac-proxy/0.log" Jun 09 12:08:32.054780 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:32.054728 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-75zr2_ede206f8-ecd6-4fc1-917e-1b6d7a86148c/dns-node-resolver/0.log" Jun 09 12:08:32.661693 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:32.661659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fb7c8d6f-88gfs_5eaa90d1-ffa2-4d1f-92c1-3faa1a3c4d53/registry/0.log" Jun 09 12:08:32.687427 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:32.687399 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-25spp_f0a7af62-383e-4c22-b8a8-e4649fed0be9/node-ca/0.log" Jun 09 12:08:33.764309 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:33.764261 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gmnng_70713f5f-a7b7-45ab-a935-e466fb596314/discovery/0.log" Jun 09 12:08:33.785223 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:33.785178 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-5vr9p_20ed3983-232c-4cc8-a8d3-933ca4d8966d/kube-auth-proxy/0.log" Jun 09 12:08:34.486686 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:34.486658 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6779_b29effef-3c90-429b-84d5-1cd7cd4b07ee/serve-healthcheck-canary/0.log" Jun 09 12:08:35.072127 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:35.072091 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4bjz_0c65e2a6-7966-432f-acb5-539583bb6101/kube-rbac-proxy/0.log" Jun 09 12:08:35.097194 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:35.097171 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4bjz_0c65e2a6-7966-432f-acb5-539583bb6101/exporter/0.log" Jun 09 12:08:35.123082 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:35.123046 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4bjz_0c65e2a6-7966-432f-acb5-539583bb6101/extractor/0.log" Jun 09 12:08:35.990757 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:35.990723 2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-96slk/perf-node-gather-daemonset-th9fr" Jun 09 12:08:37.731462 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.731413 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-cc45d96b7-9bf66_12414066-9cd4-41f4-9eb3-4f9606ef9cfb/nginx/0.log" Jun 09 12:08:37.796094 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.796066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bwtc7_d8196fac-7ab6-4155-b4fa-3dfef72dea58/manager/0.log" Jun 09 12:08:37.824867 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.824836 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rq6mh_c5a6bdb6-7abc-46e4-8545-3535e6fd1d09/manager/0.log" Jun 09 12:08:37.854591 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.854562 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sfscc_e019ab16-ba69-4bb2-9737-3de4cc9ff999/server/0.log" Jun 09 12:08:37.905401 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.905370 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-kpm6z_e6a48bf9-056a-4852-9879-4b6a5577c13e/manager/0.log" Jun 09 12:08:37.934358 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.934328 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-8fkvs_9e39a88a-aced-498e-a58d-594d96458e83/manager/0.log" Jun 09 12:08:37.961454 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:37.961427 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-656cd88b4c-8fkvs_9e39a88a-aced-498e-a58d-594d96458e83/copy-manifests/0.log" Jun 09 12:08:43.273347 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:43.273311 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gmnng_70713f5f-a7b7-45ab-a935-e466fb596314/discovery/0.log" Jun 09 12:08:43.285368 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:43.285325 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-5vr9p_20ed3983-232c-4cc8-a8d3-933ca4d8966d/kube-auth-proxy/0.log" Jun 09 12:08:44.516711 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:44.516669 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gmnng_70713f5f-a7b7-45ab-a935-e466fb596314/discovery/0.log" Jun 09 12:08:44.533072 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:44.533048 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-5vr9p_20ed3983-232c-4cc8-a8d3-933ca4d8966d/kube-auth-proxy/0.log" Jun 09 12:08:45.067601 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:45.067572 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zzgnf_7ac6946e-d770-4c92-9fe2-feecf006a4d4/migrator/0.log" Jun 09 12:08:45.092187 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:45.092152 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-zzgnf_7ac6946e-d770-4c92-9fe2-feecf006a4d4/graceful-termination/0.log" Jun 09 12:08:46.373485 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:46.373454 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-gmnng_70713f5f-a7b7-45ab-a935-e466fb596314/discovery/0.log" Jun 09 12:08:46.383800 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:46.383752 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68d7c54df5-5vr9p_20ed3983-232c-4cc8-a8d3-933ca4d8966d/kube-auth-proxy/0.log" Jun 09 12:08:46.770837 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:46.770795 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5dckx_e8c408c8-8f9c-44ad-92a8-c100d05d0b80/kube-multus/0.log" Jun 09 12:08:47.009175 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.009145 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/kube-multus-additional-cni-plugins/0.log" Jun 09 12:08:47.036777 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.036689 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/egress-router-binary-copy/0.log" Jun 09 12:08:47.063147 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.063118 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/cni-plugins/0.log" Jun 09 12:08:47.090923 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.090892 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/bond-cni-plugin/0.log" Jun 09 12:08:47.119487 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.119456 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/routeoverride-cni/0.log" Jun 09 12:08:47.151132 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.151103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/whereabouts-cni-bincopy/0.log" Jun 09 12:08:47.180923 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.180893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbblh_ba081705-3921-4c66-9c79-642330c65850/whereabouts-cni/0.log" Jun 09 12:08:47.469544 ip-10-0-129-223 kubenswrapper[2567]: I0609 12:08:47.469512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hn75f_6d4682ac-9b0f-41d2-b47f-561c4dee9522/network-metrics-daemon/0.log"