Jun 06 13:01:34.818471 ip-10-0-140-166 systemd[1]: Starting Kubernetes Kubelet... Jun 06 13:01:35.211490 ip-10-0-140-166 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:35.211490 ip-10-0-140-166 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 13:01:35.211490 ip-10-0-140-166 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:35.212276 ip-10-0-140-166 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 13:01:35.212276 ip-10-0-140-166 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 13:01:35.213190 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.213092 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 13:01:35.219183 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219168 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.219183 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219182 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.219183 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219185 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219189 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219192 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219194 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219197 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219200 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219203 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219207 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219209 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219212 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219215 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219217 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219220 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219223 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219225 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219228 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219235 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219238 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219241 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219244 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.219272 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219246 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219249 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219252 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219254 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219257 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219259 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219262 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219264 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219267 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219269 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219272 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219274 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219277 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219280 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219283 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219285 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219288 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219291 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219294 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219296 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.219743 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219299 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219301 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219304 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219306 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219309 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219316 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219319 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219322 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219324 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219327 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219329 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219333 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219337 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219339 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219343 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219346 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219349 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219351 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219354 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219356 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.220252 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219359 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219362 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219364 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219367 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219370 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219372 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219374 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219377 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219380 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219382 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219390 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219393 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219395 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219398 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219402 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219406 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219409 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219412 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219414 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.220757 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219417 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219422 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219425 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219428 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219431 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219434 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219437 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219441 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219444 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219447 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219449 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219452 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219454 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219457 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219459 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219462 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219464 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.219467 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220206 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.221236 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220213 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220216 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220219 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220222 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220225 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220228 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220233 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220237 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220240 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220243 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220246 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220249 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220252 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220255 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220258 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220260 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220263 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220267 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220269 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220272 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.221696 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220275 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220278 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220280 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220283 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220285 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220288 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220291 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220293 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220296 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220298 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220301 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220303 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220306 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220308 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220311 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220313 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220316 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220318 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220321 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220324 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.222195 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220326 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220329 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220331 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220334 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220337 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220339 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220342 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220344 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220353 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220357 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220362 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220364 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220367 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220370 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220373 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220375 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220378 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220380 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220383 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220386 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.222679 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220389 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220391 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220394 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220397 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220399 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220402 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220404 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220407 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220410 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220412 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220415 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220417 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220422 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220426 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220429 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220431 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220434 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220436 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220439 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.223185 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220442 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220444 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220447 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220449 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220452 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220457 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220460 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220463 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220466 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220469 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220472 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220474 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220477 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220479 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220482 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220484 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220487 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220489 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220492 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.223655 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220871 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220877 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220880 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220883 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220886 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220890 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220893 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220895 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220898 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220900 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220903 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220906 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220909 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220912 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220914 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220917 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220919 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220922 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220925 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220928 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.224158 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220930 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220933 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220936 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220938 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220941 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220943 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220946 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220948 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220951 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220954 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220956 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220959 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220966 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220969 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220971 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220974 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220976 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220979 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220982 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220984 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.224670 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220987 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220989 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220992 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220994 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.220998 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221002 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221005 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221008 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221010 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221013 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221016 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221019 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221021 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221024 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221027 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221030 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221032 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221035 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.225175 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221038 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221040 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221044 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221048 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221050 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221053 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221057 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221060 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221063 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221067 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221072 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221075 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221078 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221081 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221084 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221086 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221089 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221092 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221095 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.225643 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221110 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221113 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221116 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221118 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221121 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221123 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221126 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221129 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221132 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221134 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221137 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221139 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221142 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221145 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221147 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221150 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221153 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221155 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221158 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221161 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.226094 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221164 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221167 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221242 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221252 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221262 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221269 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221273 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221277 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221282 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221286 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221289 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221292 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221295 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221298 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221301 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221304 2560 flags.go:64] FLAG: --cgroup-root="" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221307 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221310 2560 flags.go:64] FLAG: --client-ca-file="" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221313 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221316 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221320 2560 flags.go:64] FLAG: --cluster-domain="" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221322 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221325 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221328 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 13:01:35.226595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221332 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221335 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221338 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221341 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221344 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221347 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221350 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221355 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221361 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221364 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221368 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221371 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221374 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221377 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221380 2560 flags.go:64] FLAG: --enable-server="true" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221383 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221389 2560 flags.go:64] FLAG: --event-burst="100" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221392 2560 flags.go:64] FLAG: --event-qps="50" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221395 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221398 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221401 2560 flags.go:64] FLAG: --eviction-hard="" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221404 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221407 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221410 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221413 2560 flags.go:64] FLAG: --eviction-soft="" Jun 06 13:01:35.227213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221416 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221419 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221421 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221425 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221427 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221430 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221433 2560 flags.go:64] FLAG: --feature-gates="" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221437 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221440 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221443 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221446 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221449 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221452 2560 flags.go:64] FLAG: --help="false" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221455 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221460 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221463 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221466 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221470 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221473 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221476 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221478 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221481 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221484 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 13:01:35.227815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221487 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221491 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221494 2560 flags.go:64] FLAG: --kube-reserved="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221496 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221499 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221502 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221505 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221507 2560 flags.go:64] FLAG: --lock-file="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221510 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221513 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221516 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221521 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221524 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221526 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221529 2560 flags.go:64] FLAG: --logging-format="text" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221532 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221535 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221538 2560 flags.go:64] FLAG: --manifest-url="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221541 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221545 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221548 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221552 2560 flags.go:64] FLAG: --max-pods="110" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221555 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221559 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221562 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 13:01:35.228482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221565 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221568 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221571 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221574 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221581 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221584 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221587 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221590 2560 flags.go:64] FLAG: --pod-cidr="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221593 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221599 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221602 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221605 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221608 2560 flags.go:64] FLAG: --port="10250" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221611 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221614 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a22d449539134e57" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221617 2560 flags.go:64] FLAG: --qos-reserved="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221620 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221623 2560 flags.go:64] FLAG: --register-node="true" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221626 2560 flags.go:64] FLAG: --register-with-taints="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221629 2560 flags.go:64] FLAG: --registry-burst="10" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221632 2560 flags.go:64] FLAG: --registry-qps="5" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221635 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221638 2560 flags.go:64] FLAG: --reserved-memory="" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221642 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221644 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 13:01:35.229485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221647 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221650 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221653 2560 flags.go:64] FLAG: --runonce="false" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221655 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221658 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221662 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221665 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221670 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221673 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221675 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221678 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221681 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221684 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221687 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221690 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221693 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221696 2560 flags.go:64] FLAG: --system-cgroups="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221699 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221705 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221708 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221711 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221715 2560 flags.go:64] FLAG: --tls-min-version="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221718 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221720 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221723 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 13:01:35.230562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221726 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221729 2560 flags.go:64] FLAG: --v="2" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221733 2560 flags.go:64] FLAG: --version="false" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221736 2560 flags.go:64] FLAG: --vmodule="" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221740 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.221743 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221856 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221859 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221862 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221865 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221868 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221870 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221873 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221876 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221880 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221882 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221885 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221887 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221890 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221893 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221895 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.231663 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221898 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221900 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221903 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221905 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221908 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221911 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221913 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221916 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221918 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221921 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221923 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221926 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221928 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221931 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221933 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221936 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221938 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221941 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221944 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221946 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.232223 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221949 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221951 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221954 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221958 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221961 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221965 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221968 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221971 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221974 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221976 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221979 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221983 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221986 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221989 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221992 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221995 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.221998 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222007 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222010 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.232953 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222012 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222015 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222018 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222021 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222023 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222026 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222029 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222032 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222035 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222038 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222041 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222043 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222046 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222048 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222051 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222053 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222056 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222059 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222063 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222065 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.233805 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222068 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222071 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222074 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222076 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222079 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222082 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222084 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222087 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222089 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222092 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222094 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222112 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222115 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222118 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222121 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222124 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222126 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222129 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222131 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222134 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.234386 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222137 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222140 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222142 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222145 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.222149 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.223026 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.231617 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.231636 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.232446 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.232468 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232554 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232563 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232568 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232573 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.235259 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232578 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232583 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232587 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232592 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232597 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232601 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232606 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232610 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232614 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232619 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232623 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232627 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232632 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232637 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232641 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232646 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232650 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232654 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232659 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232663 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.235778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232667 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232672 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232684 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232691 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232697 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232702 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232707 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232712 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232717 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232722 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232726 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232731 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232735 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232740 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232746 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232751 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232756 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232760 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232764 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.236626 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232769 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232773 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232778 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232782 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232786 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232790 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232795 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232799 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232803 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232807 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232811 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232816 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232820 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232824 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232829 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232833 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232840 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232846 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232852 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232857 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.237221 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232862 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232866 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232871 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232876 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232881 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232885 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232889 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232894 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232898 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232902 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232906 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232910 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232915 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232919 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232924 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232928 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232934 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232938 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232943 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.237783 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232947 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232951 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232955 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232960 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232963 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232967 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232971 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232975 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232980 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232985 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232989 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232994 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.232999 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233003 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233007 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233012 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.238297 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233016 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.233023 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233219 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233230 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233234 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233239 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233243 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233247 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233252 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233256 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233260 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233267 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233274 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233281 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 13:01:35.238736 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233286 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233291 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233295 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233299 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233304 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233309 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233313 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233317 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233322 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233326 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233330 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233335 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233339 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233344 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233350 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233355 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233360 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233364 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233368 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233373 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 13:01:35.239084 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233377 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233381 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233385 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233390 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233395 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233399 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233403 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233407 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233412 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233416 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233420 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233424 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233428 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233433 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233437 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233442 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233446 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233451 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233455 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 13:01:35.239654 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233459 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233463 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233468 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233472 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233476 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233480 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233485 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233489 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233493 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233497 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233501 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233505 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233509 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233513 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233517 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233521 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233525 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233530 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233534 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233538 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 13:01:35.240167 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233542 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233546 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233549 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233554 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233560 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233566 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233570 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233575 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233580 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233584 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233589 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233592 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233596 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233601 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233605 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233609 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233614 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233618 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233622 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233626 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 13:01:35.240726 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233630 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233635 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233638 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233642 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233647 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233651 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233655 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:35.233659 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.233667 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.233812 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.237184 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.238638 2560 server.go:1019] "Starting client certificate rotation" Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.238739 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:01:35.241268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.238775 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 13:01:35.243788 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.243771 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:01:35.245143 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.245124 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 13:01:35.254344 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.254329 2560 log.go:25] "Validated CRI v1 runtime API" Jun 06 13:01:35.256734 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.256720 2560 log.go:25] "Validated CRI v1 image API" Jun 06 13:01:35.257465 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.257450 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 13:01:35.259856 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.259837 2560 fs.go:135] Filesystem UUIDs: map[2c66e686-9bfd-4893-8283-6dccdae23357:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fb846179-fb35-4b16-8df7-ac799a52f537:/dev/nvme0n1p4] Jun 06 13:01:35.259929 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.259855 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 13:01:35.265733 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.265715 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:01:35.265822 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.265622 2560 manager.go:216] Machine: {Timestamp:2026-06-06 13:01:35.264393509 +0000 UTC m=+0.331490847 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099626 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cd3231b88fae4d0642b99a185f579 SystemUUID:ec2cd323-1b88-fae4-d064-2b99a185f579 BootID:bc43e766-b66f-4664-9c46-a4768f811880 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9c:06:b2:70:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9c:06:b2:70:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:c5:4e:f2:ac:c6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 13:01:35.265822 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.265752 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 13:01:35.265907 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.265830 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 13:01:35.269149 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.269125 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 13:01:35.269278 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.269152 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 13:01:35.269830 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.269821 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 13:01:35.269861 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.269833 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 13:01:35.269861 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.269840 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:01:35.270495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.270485 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 13:01:35.271412 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.271403 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 13:01:35.274314 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274301 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:01:35.274423 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274414 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 13:01:35.274454 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274441 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 06 13:01:35.274454 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274450 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 13:01:35.274524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274464 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 13:01:35.274524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274473 2560 kubelet.go:398] "Adding apiserver pod source" Jun 06 13:01:35.274524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274487 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 13:01:35.274857 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274846 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:01:35.274894 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.274868 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 13:01:35.277712 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.277693 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 13:01:35.279149 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.279136 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 13:01:35.279192 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.279166 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 13:01:35.280282 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280269 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280284 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280291 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280297 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280306 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280312 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280320 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 13:01:35.280328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280326 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 13:01:35.280516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280332 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 13:01:35.280516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280338 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 13:01:35.280516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280356 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 13:01:35.280516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.280362 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 13:01:35.281893 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.281878 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 13:01:35.281893 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.281894 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 13:01:35.283079 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.283056 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 13:01:35.283191 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.283094 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 13:01:35.284896 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.284878 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvnxm" Jun 06 13:01:35.285220 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.285208 2560 server.go:1268] "Started kubelet" Jun 06 13:01:35.285355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.285305 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 13:01:35.285411 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.285294 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 13:01:35.285411 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.285406 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 13:01:35.286007 ip-10-0-140-166 systemd[1]: Started Kubernetes Kubelet. Jun 06 13:01:35.287209 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.287197 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 06 13:01:35.287890 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.287875 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 13:01:35.290287 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.290268 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 13:01:35.291941 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.291923 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lvnxm" Jun 06 13:01:35.294590 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.293490 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-166.ec2.internal.18b67f8122ee9788 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-166.ec2.internal,UID:ip-10-0-140-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-166.ec2.internal,},FirstTimestamp:2026-06-06 13:01:35.285180296 +0000 UTC m=+0.352277635,LastTimestamp:2026-06-06 13:01:35.285180296 +0000 UTC m=+0.352277635,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-166.ec2.internal,}" Jun 06 13:01:35.294843 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.294825 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 13:01:35.294843 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.294833 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 13:01:35.295750 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.295719 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.295837 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.295787 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 13:01:35.295837 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.295805 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 13:01:35.295940 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.295913 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 13:01:35.296021 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.296007 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 06 13:01:35.296070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.296022 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 06 13:01:35.296413 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.296398 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 13:01:35.297202 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.297169 2560 factory.go:55] Registering systemd factory Jun 06 13:01:35.297202 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.297193 2560 factory.go:223] Registration of the systemd container factory successfully Jun 06 13:01:35.298190 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.297836 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 13:01:35.300136 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.299716 2560 factory.go:153] Registering CRI-O factory Jun 06 13:01:35.300215 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.300142 2560 factory.go:223] Registration of the crio container factory successfully Jun 06 13:01:35.300215 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.300199 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 13:01:35.300342 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.300224 2560 factory.go:103] Registering Raw factory Jun 06 13:01:35.300342 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.300241 2560 manager.go:1196] Started watching for new ooms in manager Jun 06 13:01:35.300677 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.300660 2560 manager.go:349] Starting recovery of all containers Jun 06 13:01:35.308507 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.308487 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:35.310219 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.310204 2560 manager.go:354] Recovery completed Jun 06 13:01:35.314077 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.314065 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.316538 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.316516 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.316622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.316549 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.316622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.316560 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.317072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.317058 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 13:01:35.317072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.317069 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 13:01:35.317072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.317070 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.317226 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.317085 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 06 13:01:35.318118 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318089 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.318167 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318128 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.318167 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318138 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.318303 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318292 2560 policy_none.go:49] "None policy: Start" Jun 06 13:01:35.318334 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318309 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 13:01:35.318334 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.318319 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 13:01:35.319444 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.319434 2560 policy_none.go:47] "Start" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355405 2560 manager.go:337] "Starting Device Plugin manager" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.355436 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355447 2560 server.go:87] "Starting device plugin registration server" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355678 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355690 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355788 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355866 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.355875 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.357088 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.357148 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.365786 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.366866 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.366898 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.366915 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 13:01:35.368766 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.366982 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 13:01:35.369497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.369454 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:35.456169 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.456135 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.457046 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.457027 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.457148 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.457060 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.457148 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.457071 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.457148 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.457094 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.464367 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.464325 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.464367 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.464351 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-166.ec2.internal\": node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.467060 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.467025 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal"] Jun 06 13:01:35.467140 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.467130 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.467882 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.467859 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.467965 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.467889 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.467965 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.467899 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.469165 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469153 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.469328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469313 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.469372 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469353 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.469816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469800 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.469884 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469806 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.469884 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469831 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.469884 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469842 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.469884 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469844 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.469884 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.469856 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.470800 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.470784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.470800 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.470808 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 13:01:35.471433 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.471420 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientMemory" Jun 06 13:01:35.471507 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.471444 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 13:01:35.471507 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.471453 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeHasSufficientPID" Jun 06 13:01:35.476945 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.476930 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.497696 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.497675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.497794 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.497711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.497794 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.497742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4574fa384fd3b7e76e4c8c36e9cfabee-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"4574fa384fd3b7e76e4c8c36e9cfabee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.497794 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.497753 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-166.ec2.internal\" not found" node="ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.502004 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.501991 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-166.ec2.internal\" not found" node="ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.577935 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.577916 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.598259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598242 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.598319 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.598319 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4574fa384fd3b7e76e4c8c36e9cfabee-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"4574fa384fd3b7e76e4c8c36e9cfabee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.598388 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598324 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.598388 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc62032061a5bd3ba50ee4e18214d8a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal\" (UID: \"fc62032061a5bd3ba50ee4e18214d8a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.598388 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.598373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4574fa384fd3b7e76e4c8c36e9cfabee-config\") pod \"kube-apiserver-proxy-ip-10-0-140-166.ec2.internal\" (UID: \"4574fa384fd3b7e76e4c8c36e9cfabee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.678439 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.678395 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.779157 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.779093 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.801585 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.801566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.806221 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:35.806207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:35.879891 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.879857 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:35.980426 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:35.980386 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.080908 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.080842 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.181403 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.181371 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.237981 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.237808 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 13:01:36.238567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.238116 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 13:01:36.238567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.238162 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 13:01:36.282305 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.282278 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.296824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.296794 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 12:56:35 +0000 UTC" deadline="2028-01-26 06:30:52.117904543 +0000 UTC" Jun 06 13:01:36.296824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.296823 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14369h29m15.821084843s" Jun 06 13:01:36.302142 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:36.302090 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4574fa384fd3b7e76e4c8c36e9cfabee.slice/crio-9d2a581db59173bee664453e8871b96243772839e4de735da548d5bba904322e WatchSource:0}: Error finding container 9d2a581db59173bee664453e8871b96243772839e4de735da548d5bba904322e: Status 404 returned error can't find the container with id 9d2a581db59173bee664453e8871b96243772839e4de735da548d5bba904322e Jun 06 13:01:36.302864 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:36.302841 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc62032061a5bd3ba50ee4e18214d8a8.slice/crio-0595149cad421005f6146b0b09ee1a62b19226a5110e3549dcf9b51825583998 WatchSource:0}: Error finding container 0595149cad421005f6146b0b09ee1a62b19226a5110e3549dcf9b51825583998: Status 404 returned error can't find the container with id 0595149cad421005f6146b0b09ee1a62b19226a5110e3549dcf9b51825583998 Jun 06 13:01:36.307653 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.307634 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:01:36.372581 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.372467 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"fc62032061a5bd3ba50ee4e18214d8a8","Type":"ContainerStarted","Data":"0595149cad421005f6146b0b09ee1a62b19226a5110e3549dcf9b51825583998"} Jun 06 13:01:36.373451 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.373430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" event={"ID":"4574fa384fd3b7e76e4c8c36e9cfabee","Type":"ContainerStarted","Data":"9d2a581db59173bee664453e8871b96243772839e4de735da548d5bba904322e"} Jun 06 13:01:36.382591 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.382565 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.483067 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.483030 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.583575 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.583543 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.684061 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:36.683992 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-166.ec2.internal\" not found" Jun 06 13:01:36.692695 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.692673 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:36.696669 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.696644 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" Jun 06 13:01:36.707934 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.707885 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:01:36.709481 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.709462 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" Jun 06 13:01:36.716932 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.716911 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 13:01:36.783467 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:36.783441 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:37.276213 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.276179 2560 apiserver.go:52] "Watching apiserver" Jun 06 13:01:37.284225 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.284201 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 13:01:37.286398 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.285574 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-gvsxw","openshift-multus/network-metrics-daemon-mqp5b","openshift-network-diagnostics/network-check-target-pcqj5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl","openshift-image-registry/node-ca-9nchz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal","openshift-multus/multus-z9mxl","openshift-network-operator/iptables-alerter-8dh5v","openshift-ovn-kubernetes/ovnkube-node-l9qqc","kube-system/global-pull-secret-syncer-rpdcb","kube-system/konnectivity-agent-zs7vm","kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9tvcg","openshift-dns/node-resolver-lrvwh"] Jun 06 13:01:37.287228 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.287206 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.288571 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.288546 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.289705 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.289675 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.289705 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.289698 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6sg8w\"" Jun 06 13:01:37.289870 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.289844 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.289870 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.289855 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 13:01:37.289973 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.289890 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 13:01:37.290050 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.290005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:37.290127 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.290075 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:37.290830 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.290807 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.291163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.290888 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6pjp\"" Jun 06 13:01:37.291163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.290900 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.291163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.291041 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.292064 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.292000 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.293257 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.293237 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.293359 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.293288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.293526 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.293507 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.293779 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.293664 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-25n9j\"" Jun 06 13:01:37.293779 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.293682 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 13:01:37.294310 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.294293 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.294816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.294605 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2t4v7\"" Jun 06 13:01:37.294816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.294620 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 13:01:37.294816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.294637 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.295280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.294898 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.295623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.295484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.295623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.295503 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.295754 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.295727 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 13:01:37.295878 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.295849 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2wf5m\"" Jun 06 13:01:37.296347 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.296318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.297152 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.297134 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 13:01:37.297249 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.297173 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.297609 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.297581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.297727 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.297655 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:37.298516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.298498 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.298600 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.298542 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 13:01:37.298913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.298895 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 13:01:37.299004 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.298916 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 13:01:37.299060 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.299051 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 13:01:37.299164 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.299147 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 13:01:37.299229 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.299147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p6rjm\"" Jun 06 13:01:37.299355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.299339 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.299465 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.299446 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:37.299520 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.299384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wwp5m\"" Jun 06 13:01:37.300263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.300245 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.301862 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.301842 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.302874 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.302431 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 13:01:37.302874 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.302641 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 13:01:37.303341 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.303324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vzk6b\"" Jun 06 13:01:37.306008 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.304774 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 13:01:37.306008 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.304879 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wp7cq\"" Jun 06 13:01:37.306394 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.306352 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:01:37.307275 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307258 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 13:01:37.307355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-config\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307406 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-os-release\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.307444 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307408 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.307483 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-os-release\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307483 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28nqm\" (UniqueName: \"kubernetes.io/projected/509cd412-0eb0-43db-aec3-4c8455909278-kube-api-access-28nqm\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-socket-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.307588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.307588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-netns\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307571 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-lib-modules\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.307718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307592 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-host\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.307718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-var-lib-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307622 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-etc-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-bin\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307756 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cnibin\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-cni-binary-copy\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-multus-daemon-config\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-netns\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-netd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-multus\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.307927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysconfig\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307968 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-run\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.307989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-host\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-etc-selinux\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-system-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-var-lib-kubelet\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmbm8\" (UniqueName: \"kubernetes.io/projected/c9383e3e-7bec-4060-bdce-025583c4600e-kube-api-access-jmbm8\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-registration-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308213 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zxs\" (UniqueName: \"kubernetes.io/projected/22488cff-e21d-48b4-a2c0-218fc783318b-kube-api-access-x7zxs\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308261 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-kubernetes\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-sys-fs\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.308313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-systemd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-log-socket\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-systemd\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-conf-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37551d62-2bb9-4b80-bcb0-a349529e9c41-tmp-dir\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308474 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-slash\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-socket-dir-parent\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-tuned\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-ovn\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-env-overrides\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22488cff-e21d-48b4-a2c0-218fc783318b-ovn-node-metrics-cert\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-k8s-cni-cncf-io\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-kubelet\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.308852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-modprobe-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-sys\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-kubelet\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-cnibin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-multus-certs\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308846 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-etc-kubernetes\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308869 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fldj\" (UniqueName: \"kubernetes.io/projected/d3066353-7273-4a19-8a26-9b5cd26f406a-kube-api-access-5fldj\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308903 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njxpq\" (UniqueName: \"kubernetes.io/projected/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-kube-api-access-njxpq\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-device-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-systemd-units\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-node-log\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.308997 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5q44\" (UniqueName: \"kubernetes.io/projected/37551d62-2bb9-4b80-bcb0-a349529e9c41-kube-api-access-n5q44\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309063 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9lc\" (UniqueName: \"kubernetes.io/projected/2765a605-7e97-4987-833b-0de68de07830-kube-api-access-pd9lc\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37551d62-2bb9-4b80-bcb0-a349529e9c41-hosts-file\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-hostroot\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.309630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-conf\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr84m\" (UniqueName: \"kubernetes.io/projected/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-kube-api-access-zr84m\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-serviceca\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-script-lib\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-bin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.310274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.309388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-tmp\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.310699 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.310362 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 13:01:37.325306 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.325285 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hr2v5" Jun 06 13:01:37.332048 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.332028 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hr2v5" Jun 06 13:01:37.397092 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.397065 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 13:01:37.410145 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-netd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.410271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-multus\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.410271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysconfig\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-netd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-run\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410360 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysconfig\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-host\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4df01c08-53a8-448c-bede-b1bdf3011c0e-agent-certs\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.410426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410420 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-host\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-etc-selinux\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-multus\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-run\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-system-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-etc-selinux\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-system-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410509 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-var-lib-kubelet\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmbm8\" (UniqueName: \"kubernetes.io/projected/c9383e3e-7bec-4060-bdce-025583c4600e-kube-api-access-jmbm8\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410577 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-var-lib-kubelet\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410579 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-dbus\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410615 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-registration-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zxs\" (UniqueName: \"kubernetes.io/projected/22488cff-e21d-48b4-a2c0-218fc783318b-kube-api-access-x7zxs\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.410709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.410689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-registration-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.411380 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411230 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-kubernetes\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.411380 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411264 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.411380 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-kubernetes\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.411380 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-sys-fs\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.411380 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-systemd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.411626 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-log-socket\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.411626 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411452 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-systemd\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.411626 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4df01c08-53a8-448c-bede-b1bdf3011c0e-konnectivity-ca\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.411784 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411672 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-sys-fs\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.411784 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-systemd\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.411784 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-log-socket\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.411930 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-systemd\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.411978 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-conf-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.411979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37551d62-2bb9-4b80-bcb0-a349529e9c41-tmp-dir\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.412026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:37.412134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.412134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-conf-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-slash\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412151 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-socket-dir-parent\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-tuned\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.412271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-ovn\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412269 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-env-overrides\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412307 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22488cff-e21d-48b4-a2c0-218fc783318b-ovn-node-metrics-cert\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-k8s-cni-cncf-io\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-kubelet\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412418 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-modprobe-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-sys\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.412484 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-kubelet\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412770 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.412770 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-cnibin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412770 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412638 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-multus-certs\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412770 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-etc-kubernetes\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.412770 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fldj\" (UniqueName: \"kubernetes.io/projected/d3066353-7273-4a19-8a26-9b5cd26f406a-kube-api-access-5fldj\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.412987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412772 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 13:01:37.412987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412795 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-ovn\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.412987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.412861 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413303 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njxpq\" (UniqueName: \"kubernetes.io/projected/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-kube-api-access-njxpq\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.413374 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413324 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-device-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.413374 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-systemd-units\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413473 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-node-log\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413473 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-env-overrides\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413473 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413393 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37551d62-2bb9-4b80-bcb0-a349529e9c41-tmp-dir\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.413606 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413478 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6878e44f-927a-40e8-8faa-8402445318d8-iptables-alerter-script\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.413656 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-slash\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413743 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.413815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-systemd-units\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413795 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-node-log\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413825 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-device-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.413913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-kubelet\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.413913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-socket-dir-parent\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.413913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-k8s-cni-cncf-io\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-multus-certs\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.413966 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-kubelet\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.414095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414082 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-modprobe-d\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.414295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-cnibin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-etc-kubernetes\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-sys\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.414295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5q44\" (UniqueName: \"kubernetes.io/projected/37551d62-2bb9-4b80-bcb0-a349529e9c41-kube-api-access-n5q44\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.414295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9lc\" (UniqueName: \"kubernetes.io/projected/2765a605-7e97-4987-833b-0de68de07830-kube-api-access-pd9lc\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37551d62-2bb9-4b80-bcb0-a349529e9c41-hosts-file\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-hostroot\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-conf\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr84m\" (UniqueName: \"kubernetes.io/projected/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-kube-api-access-zr84m\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-serviceca\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6878e44f-927a-40e8-8faa-8402445318d8-host-slash\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.414567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7vx\" (UniqueName: \"kubernetes.io/projected/6878e44f-927a-40e8-8faa-8402445318d8-kube-api-access-rq7vx\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-script-lib\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414596 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/37551d62-2bb9-4b80-bcb0-a349529e9c41-hosts-file\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414627 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-bin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-tmp\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-config\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-os-release\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-os-release\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28nqm\" (UniqueName: \"kubernetes.io/projected/509cd412-0eb0-43db-aec3-4c8455909278-kube-api-access-28nqm\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.414950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-kubelet-config\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.414976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-socket-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-hostroot\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-netns\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-run-netns\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-lib-modules\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415147 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-host\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-lib-modules\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-var-lib-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-etc-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415300 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-bin\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cnibin\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-cni-binary-copy\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-script-lib\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.415524 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.415451 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-multus-daemon-config\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-netns\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415525 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-multus-cni-dir\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-os-release\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.415718 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:01:37.915672636 +0000 UTC m=+2.982769981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-sysctl-conf\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.415963 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-var-lib-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416003 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-etc-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-run-openvswitch\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cnibin\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-host\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416310 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2765a605-7e97-4987-833b-0de68de07830-socket-dir\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.416405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416404 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-os-release\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.417012 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416480 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.417012 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.416771 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.417145 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417120 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-cni-binary-copy\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.417196 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417124 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/22488cff-e21d-48b4-a2c0-218fc783318b-ovnkube-config\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.417196 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509cd412-0eb0-43db-aec3-4c8455909278-host-var-lib-cni-bin\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.417301 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417150 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.417354 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-run-netns\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.417354 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417345 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-etc-tuned\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.417503 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.417477 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:37.417562 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.417513 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:37.417562 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.417534 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:37.417658 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.417596 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:37.917571079 +0000 UTC m=+2.984668424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:37.417963 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417928 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509cd412-0eb0-43db-aec3-4c8455909278-multus-daemon-config\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.418044 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22488cff-e21d-48b4-a2c0-218fc783318b-host-cni-bin\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.418044 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.417943 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-serviceca\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.418968 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.418942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.419260 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.419188 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/22488cff-e21d-48b4-a2c0-218fc783318b-ovn-node-metrics-cert\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.420407 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.420384 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3066353-7273-4a19-8a26-9b5cd26f406a-tmp\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.420878 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.420838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zxs\" (UniqueName: \"kubernetes.io/projected/22488cff-e21d-48b4-a2c0-218fc783318b-kube-api-access-x7zxs\") pod \"ovnkube-node-l9qqc\" (UID: \"22488cff-e21d-48b4-a2c0-218fc783318b\") " pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.420969 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.420876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmbm8\" (UniqueName: \"kubernetes.io/projected/c9383e3e-7bec-4060-bdce-025583c4600e-kube-api-access-jmbm8\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.422449 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.422417 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njxpq\" (UniqueName: \"kubernetes.io/projected/b9b4178c-f6e9-4b57-bd69-2ebc27923c2e-kube-api-access-njxpq\") pod \"node-ca-9nchz\" (UID: \"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e\") " pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.422561 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.422534 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fldj\" (UniqueName: \"kubernetes.io/projected/d3066353-7273-4a19-8a26-9b5cd26f406a-kube-api-access-5fldj\") pod \"tuned-9tvcg\" (UID: \"d3066353-7273-4a19-8a26-9b5cd26f406a\") " pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.423409 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.423385 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5q44\" (UniqueName: \"kubernetes.io/projected/37551d62-2bb9-4b80-bcb0-a349529e9c41-kube-api-access-n5q44\") pod \"node-resolver-lrvwh\" (UID: \"37551d62-2bb9-4b80-bcb0-a349529e9c41\") " pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.424210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.424149 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9lc\" (UniqueName: \"kubernetes.io/projected/2765a605-7e97-4987-833b-0de68de07830-kube-api-access-pd9lc\") pod \"aws-ebs-csi-driver-node-2hpkl\" (UID: \"2765a605-7e97-4987-833b-0de68de07830\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.424511 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.424492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28nqm\" (UniqueName: \"kubernetes.io/projected/509cd412-0eb0-43db-aec3-4c8455909278-kube-api-access-28nqm\") pod \"multus-z9mxl\" (UID: \"509cd412-0eb0-43db-aec3-4c8455909278\") " pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.425076 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.425055 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr84m\" (UniqueName: \"kubernetes.io/projected/ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1-kube-api-access-zr84m\") pod \"multus-additional-cni-plugins-gvsxw\" (UID: \"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1\") " pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.516128 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6878e44f-927a-40e8-8faa-8402445318d8-iptables-alerter-script\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6878e44f-927a-40e8-8faa-8402445318d8-host-slash\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516161 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7vx\" (UniqueName: \"kubernetes.io/projected/6878e44f-927a-40e8-8faa-8402445318d8-kube-api-access-rq7vx\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-kubelet-config\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516219 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6878e44f-927a-40e8-8faa-8402445318d8-host-slash\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516262 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4df01c08-53a8-448c-bede-b1bdf3011c0e-agent-certs\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.516283 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-dbus\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.516602 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516305 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-kubelet-config\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.516602 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4df01c08-53a8-448c-bede-b1bdf3011c0e-konnectivity-ca\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.516602 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516411 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69d08e50-2ea5-4861-9048-f6d616307aa6-dbus\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:37.516602 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.516470 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:37.516602 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.516545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:38.016526309 +0000 UTC m=+3.083623658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:37.516853 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516684 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6878e44f-927a-40e8-8faa-8402445318d8-iptables-alerter-script\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.516910 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.516869 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4df01c08-53a8-448c-bede-b1bdf3011c0e-konnectivity-ca\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.518825 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.518803 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4df01c08-53a8-448c-bede-b1bdf3011c0e-agent-certs\") pod \"konnectivity-agent-zs7vm\" (UID: \"4df01c08-53a8-448c-bede-b1bdf3011c0e\") " pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.526404 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.526350 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7vx\" (UniqueName: \"kubernetes.io/projected/6878e44f-927a-40e8-8faa-8402445318d8-kube-api-access-rq7vx\") pod \"iptables-alerter-8dh5v\" (UID: \"6878e44f-927a-40e8-8faa-8402445318d8\") " pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.598261 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.598235 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z9mxl" Jun 06 13:01:37.606676 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.606656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" Jun 06 13:01:37.615212 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.615190 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" Jun 06 13:01:37.620792 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.620771 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nchz" Jun 06 13:01:37.628241 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.628220 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lrvwh" Jun 06 13:01:37.633986 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.633964 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:01:37.640824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.640799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" Jun 06 13:01:37.648342 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.648315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:37.654850 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.654834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8dh5v" Jun 06 13:01:37.708758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.708735 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:37.719040 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.719022 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 13:01:37.919220 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.919145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:37.919220 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:37.919204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:37.919401 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919331 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:37.919401 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919341 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:37.919401 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919355 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:37.919401 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919364 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:37.919401 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919399 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:01:38.919378892 +0000 UTC m=+3.986476218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:37.919593 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:37.919420 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:38.919409553 +0000 UTC m=+3.986506877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:38.019929 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.019898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:38.020093 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.020028 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:38.020187 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.020093 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:39.020074805 +0000 UTC m=+4.087172156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:38.119299 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.119269 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509cd412_0eb0_43db_aec3_4c8455909278.slice/crio-bf1cad972e7e332aee3ea8076733b8b89b1a3ebbc942f63d7dc7d092d3a5bb3e WatchSource:0}: Error finding container bf1cad972e7e332aee3ea8076733b8b89b1a3ebbc942f63d7dc7d092d3a5bb3e: Status 404 returned error can't find the container with id bf1cad972e7e332aee3ea8076733b8b89b1a3ebbc942f63d7dc7d092d3a5bb3e Jun 06 13:01:38.121438 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.121371 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22488cff_e21d_48b4_a2c0_218fc783318b.slice/crio-d8703d74a2a8393f750c72489961f387f45b4ee0b1fb66353f44da4b572c31aa WatchSource:0}: Error finding container d8703d74a2a8393f750c72489961f387f45b4ee0b1fb66353f44da4b572c31aa: Status 404 returned error can't find the container with id d8703d74a2a8393f750c72489961f387f45b4ee0b1fb66353f44da4b572c31aa Jun 06 13:01:38.124310 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.124284 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df01c08_53a8_448c_bede_b1bdf3011c0e.slice/crio-7e10d5f0c8770ce975c9541be61efb89040ebb3a1d05b778437906d3917c3c80 WatchSource:0}: Error finding container 7e10d5f0c8770ce975c9541be61efb89040ebb3a1d05b778437906d3917c3c80: Status 404 returned error can't find the container with id 7e10d5f0c8770ce975c9541be61efb89040ebb3a1d05b778437906d3917c3c80 Jun 06 13:01:38.126446 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.125945 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b4178c_f6e9_4b57_bd69_2ebc27923c2e.slice/crio-3635b26055c2158f1d045f51591a06b0eea105084f13874de6f92a0dcc48939d WatchSource:0}: Error finding container 3635b26055c2158f1d045f51591a06b0eea105084f13874de6f92a0dcc48939d: Status 404 returned error can't find the container with id 3635b26055c2158f1d045f51591a06b0eea105084f13874de6f92a0dcc48939d Jun 06 13:01:38.126766 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.126712 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6878e44f_927a_40e8_8faa_8402445318d8.slice/crio-9cf663f6de6f9f79e6f30cfc58a9b5ccb2e8010052dc4d2614b2c75099451d00 WatchSource:0}: Error finding container 9cf663f6de6f9f79e6f30cfc58a9b5ccb2e8010052dc4d2614b2c75099451d00: Status 404 returned error can't find the container with id 9cf663f6de6f9f79e6f30cfc58a9b5ccb2e8010052dc4d2614b2c75099451d00 Jun 06 13:01:38.129469 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.129319 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3c912c_e5fc_42d3_8974_7c0d16ad9ac1.slice/crio-25b47effc215196680ed3fef4543725598eeb65548afa4153cfc61b751876a2e WatchSource:0}: Error finding container 25b47effc215196680ed3fef4543725598eeb65548afa4153cfc61b751876a2e: Status 404 returned error can't find the container with id 25b47effc215196680ed3fef4543725598eeb65548afa4153cfc61b751876a2e Jun 06 13:01:38.130512 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.130455 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37551d62_2bb9_4b80_bcb0_a349529e9c41.slice/crio-7f0adc1e806e97f3bdff2a9f841a1e22a9ae4b37a4455dc56f164931ddc8db5f WatchSource:0}: Error finding container 7f0adc1e806e97f3bdff2a9f841a1e22a9ae4b37a4455dc56f164931ddc8db5f: Status 404 returned error can't find the container with id 7f0adc1e806e97f3bdff2a9f841a1e22a9ae4b37a4455dc56f164931ddc8db5f Jun 06 13:01:38.131570 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.131542 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3066353_7273_4a19_8a26_9b5cd26f406a.slice/crio-a2d1defb82ef83ef5f5d633ea5d6d82aa07997e2482dcfbad00f6c35729fd13b WatchSource:0}: Error finding container a2d1defb82ef83ef5f5d633ea5d6d82aa07997e2482dcfbad00f6c35729fd13b: Status 404 returned error can't find the container with id a2d1defb82ef83ef5f5d633ea5d6d82aa07997e2482dcfbad00f6c35729fd13b Jun 06 13:01:38.132908 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:01:38.132634 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2765a605_7e97_4987_833b_0de68de07830.slice/crio-67656afc9231460406056032337e2a2f399ed3fd8d01d3536021d6886e72373b WatchSource:0}: Error finding container 67656afc9231460406056032337e2a2f399ed3fd8d01d3536021d6886e72373b: Status 404 returned error can't find the container with id 67656afc9231460406056032337e2a2f399ed3fd8d01d3536021d6886e72373b Jun 06 13:01:38.334340 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.334304 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 12:56:37 +0000 UTC" deadline="2028-01-07 19:27:48.379344781 +0000 UTC" Jun 06 13:01:38.334340 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.334335 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13926h26m10.045014138s" Jun 06 13:01:38.367925 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.367902 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:38.368044 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.368024 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:38.378422 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.378335 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" event={"ID":"d3066353-7273-4a19-8a26-9b5cd26f406a","Type":"ContainerStarted","Data":"a2d1defb82ef83ef5f5d633ea5d6d82aa07997e2482dcfbad00f6c35729fd13b"} Jun 06 13:01:38.380066 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.380032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerStarted","Data":"25b47effc215196680ed3fef4543725598eeb65548afa4153cfc61b751876a2e"} Jun 06 13:01:38.381437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.381414 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrvwh" event={"ID":"37551d62-2bb9-4b80-bcb0-a349529e9c41","Type":"ContainerStarted","Data":"7f0adc1e806e97f3bdff2a9f841a1e22a9ae4b37a4455dc56f164931ddc8db5f"} Jun 06 13:01:38.382556 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.382536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8dh5v" event={"ID":"6878e44f-927a-40e8-8faa-8402445318d8","Type":"ContainerStarted","Data":"9cf663f6de6f9f79e6f30cfc58a9b5ccb2e8010052dc4d2614b2c75099451d00"} Jun 06 13:01:38.383556 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.383534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nchz" event={"ID":"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e","Type":"ContainerStarted","Data":"3635b26055c2158f1d045f51591a06b0eea105084f13874de6f92a0dcc48939d"} Jun 06 13:01:38.384573 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.384555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"d8703d74a2a8393f750c72489961f387f45b4ee0b1fb66353f44da4b572c31aa"} Jun 06 13:01:38.385514 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.385495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9mxl" event={"ID":"509cd412-0eb0-43db-aec3-4c8455909278","Type":"ContainerStarted","Data":"bf1cad972e7e332aee3ea8076733b8b89b1a3ebbc942f63d7dc7d092d3a5bb3e"} Jun 06 13:01:38.388633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.388594 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" event={"ID":"4574fa384fd3b7e76e4c8c36e9cfabee","Type":"ContainerStarted","Data":"1681d441287b15df647c2e5d3856f8d339f81ab357004a35c79e0cf2a74734c7"} Jun 06 13:01:38.389836 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.389814 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs7vm" event={"ID":"4df01c08-53a8-448c-bede-b1bdf3011c0e","Type":"ContainerStarted","Data":"7e10d5f0c8770ce975c9541be61efb89040ebb3a1d05b778437906d3917c3c80"} Jun 06 13:01:38.390956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.390939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" event={"ID":"2765a605-7e97-4987-833b-0de68de07830","Type":"ContainerStarted","Data":"67656afc9231460406056032337e2a2f399ed3fd8d01d3536021d6886e72373b"} Jun 06 13:01:38.415956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.415914 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-166.ec2.internal" podStartSLOduration=2.4159031779999998 podStartE2EDuration="2.415903178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:38.415430702 +0000 UTC m=+3.482528048" watchObservedRunningTime="2026-06-06 13:01:38.415903178 +0000 UTC m=+3.483000525" Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.925181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:38.925473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.925601 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.925663 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:01:40.925645067 +0000 UTC m=+5.992742397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.926092 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.926129 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.926144 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:38.926270 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:38.926191 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:40.926175925 +0000 UTC m=+5.993273273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:39.026622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.026572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:39.026788 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:39.026756 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:39.026870 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:39.026823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:41.026804278 +0000 UTC m=+6.093901621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:39.334982 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.334871 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 12:56:37 +0000 UTC" deadline="2028-02-06 08:42:59.204244032 +0000 UTC" Jun 06 13:01:39.334982 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.334935 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14635h41m19.869313202s" Jun 06 13:01:39.367636 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.367608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:39.367777 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.367638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:39.367777 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:39.367751 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:39.367899 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:39.367855 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:39.409175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.408214 2560 generic.go:356] "Generic (PLEG): container finished" podID="fc62032061a5bd3ba50ee4e18214d8a8" containerID="763be5e8e19d63fd55830085cdd77a38aadd0b020aa9f34677888dd721e114c2" exitCode=0 Jun 06 13:01:39.409175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:39.408739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"fc62032061a5bd3ba50ee4e18214d8a8","Type":"ContainerDied","Data":"763be5e8e19d63fd55830085cdd77a38aadd0b020aa9f34677888dd721e114c2"} Jun 06 13:01:40.367862 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:40.367829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:40.368351 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.367961 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:40.424151 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:40.424034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" event={"ID":"fc62032061a5bd3ba50ee4e18214d8a8","Type":"ContainerStarted","Data":"8c94659f9c93d5c8a4dd4d7718bd7e17b1ad466d1624619a30587622a559572d"} Jun 06 13:01:40.442030 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:40.441971 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-166.ec2.internal" podStartSLOduration=4.441950197 podStartE2EDuration="4.441950197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:40.439688642 +0000 UTC m=+5.506785990" watchObservedRunningTime="2026-06-06 13:01:40.441950197 +0000 UTC m=+5.509047547" Jun 06 13:01:40.943282 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:40.943243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:40.943441 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:40.943339 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:40.943441 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943417 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:40.943513 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943478 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:40.943513 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943494 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:01:44.943471935 +0000 UTC m=+10.010569281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:40.943513 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943496 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:40.943513 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943512 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:40.943648 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:40.943564 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:44.943547545 +0000 UTC m=+10.010644890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:41.044677 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:41.044639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:41.044852 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:41.044783 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:41.044917 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:41.044905 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:45.044885437 +0000 UTC m=+10.111982779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:41.368392 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:41.367672 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:41.368392 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:41.367817 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:41.368392 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:41.368195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:41.368392 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:41.368293 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:42.367670 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:42.367636 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:42.367851 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:42.367737 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:43.367951 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:43.367918 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:43.368445 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:43.367967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:43.368445 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:43.368067 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:43.368445 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:43.368188 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:44.367595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:44.367561 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:44.367789 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.367696 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:44.974458 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:44.974425 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:44.974513 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974589 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974635 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974648 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974657 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974659 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:01:52.974642496 +0000 UTC m=+18.041739847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:44.974902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:44.974693 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:52.974682176 +0000 UTC m=+18.041779515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:45.074880 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:45.074841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:45.075048 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:45.074997 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:45.075121 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:45.075059 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:01:53.075040063 +0000 UTC m=+18.142137389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:45.368210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:45.368182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:45.368419 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:45.368288 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:45.368493 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:45.368477 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:45.368622 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:45.368597 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:46.367365 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:46.367330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:46.367853 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:46.367466 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:47.368196 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:47.368154 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:47.368671 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:47.368286 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:47.368740 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:47.368700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:47.368902 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:47.368806 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:48.367121 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:48.367071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:48.367291 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:48.367218 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:49.367979 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:49.367937 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:49.368643 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:49.368065 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:49.368643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:49.368135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:49.368643 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:49.368251 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:50.367331 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:50.367296 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:50.367501 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:50.367429 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:51.367939 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:51.367901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:51.368400 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:51.367901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:51.368400 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:51.368085 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:51.368400 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:51.368206 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:52.368052 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:52.368012 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:52.368554 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:52.368144 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:53.032929 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:53.032884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:53.033141 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:53.032942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:53.033141 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033088 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:01:53.033141 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033130 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:01:53.033141 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033142 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:53.033343 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033156 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:53.033343 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033193 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:09.033178898 +0000 UTC m=+34.100276222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:01:53.033343 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.033209 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:02:09.033202021 +0000 UTC m=+34.100299346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:01:53.134279 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:53.134241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:53.134442 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.134408 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:53.134487 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.134476 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:09.13445716 +0000 UTC m=+34.201554505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:01:53.367667 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:53.367577 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:53.367826 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:53.367584 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:53.367826 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.367707 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:53.367826 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:53.367789 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:54.367474 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:54.367443 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:54.368029 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:54.367563 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:55.367897 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:55.367863 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:55.368302 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:55.368004 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:55.368302 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:55.368134 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:55.368302 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:55.368264 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:56.367725 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:56.367697 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:56.367889 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:56.367799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:57.367974 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.367946 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:57.368698 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:57.368077 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:57.368698 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.368142 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:57.368698 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:57.368262 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:57.461058 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.461029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" event={"ID":"2765a605-7e97-4987-833b-0de68de07830","Type":"ContainerStarted","Data":"a2f69ef66b791ce223e6e5f156185b3268031e9000c53cd39fdc1350490528a8"} Jun 06 13:01:57.462621 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.462566 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" event={"ID":"d3066353-7273-4a19-8a26-9b5cd26f406a","Type":"ContainerStarted","Data":"d42c0b8d481e8a2d5fdc58fbcd6c420528a4a55993c118cfe0e703d4bd8a997c"} Jun 06 13:01:57.464433 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.464408 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="8124f64fc12fa3940f2f3498188803244cf41a3a49dcc7c49f4ab4ad9a136cf2" exitCode=0 Jun 06 13:01:57.464532 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.464495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"8124f64fc12fa3940f2f3498188803244cf41a3a49dcc7c49f4ab4ad9a136cf2"} Jun 06 13:01:57.466721 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.466684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lrvwh" event={"ID":"37551d62-2bb9-4b80-bcb0-a349529e9c41","Type":"ContainerStarted","Data":"1657f4d53532d9072302b74ce3b2ec1f78fc5a3810d4ce3a2f4f5ac4970ec750"} Jun 06 13:01:57.469349 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.469156 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nchz" event={"ID":"b9b4178c-f6e9-4b57-bd69-2ebc27923c2e","Type":"ContainerStarted","Data":"958bd7e9f49e8f0e35936ea564384365cd8285065cd08369077d2167ce330229"} Jun 06 13:01:57.472129 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472090 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:01:57.472635 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472610 2560 generic.go:356] "Generic (PLEG): container finished" podID="22488cff-e21d-48b4-a2c0-218fc783318b" containerID="6ca33ae8653c37b42c8ff299590adc85122381020f453b5bf675fe6756d783bb" exitCode=1 Jun 06 13:01:57.472710 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"0d81b6ef7c849ff50462dc29606633640a95ae46c070497c7e0ce81819183613"} Jun 06 13:01:57.472771 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472748 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"e1fb142c9384f9e916de417ab7ecf42ae061bef17139e95b27a001ddcd206717"} Jun 06 13:01:57.472810 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerDied","Data":"6ca33ae8653c37b42c8ff299590adc85122381020f453b5bf675fe6756d783bb"} Jun 06 13:01:57.472849 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.472842 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"4c5f052a201bb6f12c769e108d7472fca47e99ed998c7f3b5b612ab451c55efc"} Jun 06 13:01:57.474475 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.474455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z9mxl" event={"ID":"509cd412-0eb0-43db-aec3-4c8455909278","Type":"ContainerStarted","Data":"38547d8df2e6b21c8327f149cc4af64b900369fd05e7ac27319fd84a484821ff"} Jun 06 13:01:57.475927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.475905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zs7vm" event={"ID":"4df01c08-53a8-448c-bede-b1bdf3011c0e","Type":"ContainerStarted","Data":"277faf264b17b8688ffefb4bd914f15a3d05a1b91471cf66546815df8a7b63f3"} Jun 06 13:01:57.484427 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.484382 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9tvcg" podStartSLOduration=3.825497981 podStartE2EDuration="22.484368261s" totalImagesPullingTime="18.65887028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:57.481062545 +0000 UTC m=+22.548159917" watchObservedRunningTime="2026-06-06 13:01:57.484368261 +0000 UTC m=+22.551465608" Jun 06 13:01:57.509537 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.509401 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z9mxl" podStartSLOduration=3.811803691 podStartE2EDuration="22.5093873s" totalImagesPullingTime="18.697583609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:57.509245759 +0000 UTC m=+22.576343107" watchObservedRunningTime="2026-06-06 13:01:57.5093873 +0000 UTC m=+22.576484647" Jun 06 13:01:57.509658 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.509638 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zs7vm" podStartSLOduration=4.214836874 podStartE2EDuration="22.509633951s" totalImagesPullingTime="18.294797077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:57.494036694 +0000 UTC m=+22.561134041" watchObservedRunningTime="2026-06-06 13:01:57.509633951 +0000 UTC m=+22.576731350" Jun 06 13:01:57.523625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.523592 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9nchz" podStartSLOduration=3.909390083 podStartE2EDuration="22.52357951s" totalImagesPullingTime="18.614189427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:57.52303811 +0000 UTC m=+22.590135458" watchObservedRunningTime="2026-06-06 13:01:57.52357951 +0000 UTC m=+22.590676848" Jun 06 13:01:57.560062 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.560021 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lrvwh" podStartSLOduration=3.950845253 podStartE2EDuration="22.560007535s" totalImagesPullingTime="18.609162282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:57.536262053 +0000 UTC m=+22.603359535" watchObservedRunningTime="2026-06-06 13:01:57.560007535 +0000 UTC m=+22.627104881" Jun 06 13:01:57.798556 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.798479 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:57.799534 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:57.799509 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:58.367453 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.367335 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:01:58.367539 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:58.367443 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:01:58.383354 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.383333 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 13:01:58.480084 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.480048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8dh5v" event={"ID":"6878e44f-927a-40e8-8faa-8402445318d8","Type":"ContainerStarted","Data":"4ba40a638d3e15bfd3d3ff3db2f037968ad73b3e935ff0c57afb41d47f9a5c46"} Jun 06 13:01:58.484053 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.484031 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:01:58.484520 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.484497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"6a150e1c5a52b88cb507d83c763d042c08500773cad9b039283922020155ece2"} Jun 06 13:01:58.484640 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.484562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"0e8be7dad2d25ef880cafbcd83f7de1a99e09db392a22cba87866398c978a3d8"} Jun 06 13:01:58.486634 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.486611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" event={"ID":"2765a605-7e97-4987-833b-0de68de07830","Type":"ContainerStarted","Data":"b9f19a5fa72dddfc176a70a5309f15cd2520e21d45b2b918c43e110fbda5bca0"} Jun 06 13:01:58.487340 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.487323 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:58.487543 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.487525 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zs7vm" Jun 06 13:01:58.494623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:58.494547 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8dh5v" podStartSLOduration=4.832067536 podStartE2EDuration="23.494530038s" totalImagesPullingTime="18.662462502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:58.494041892 +0000 UTC m=+23.561139241" watchObservedRunningTime="2026-06-06 13:01:58.494530038 +0000 UTC m=+23.561627388" Jun 06 13:01:59.368114 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.367790 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T13:01:58.38335053Z","UUID":"9b715466-53d0-4949-a0e8-a5460e41f3a4","Handler":null,"Name":"","Endpoint":""} Jun 06 13:01:59.368114 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.367960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:01:59.368114 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:59.368071 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:01:59.368357 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.368296 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:01:59.368415 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:01:59.368388 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:01:59.369530 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.369511 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 13:01:59.369623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.369544 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 13:01:59.494233 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.492975 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" event={"ID":"2765a605-7e97-4987-833b-0de68de07830","Type":"ContainerStarted","Data":"e1858a1bb5870a1b203f43d6a493a93b65b77358edd50ea43ecf16d70447008a"} Jun 06 13:01:59.510749 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:01:59.510707 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2hpkl" podStartSLOduration=3.773914376 podStartE2EDuration="24.510694252s" totalImagesPullingTime="20.736779876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:01:59.510468776 +0000 UTC m=+24.577566133" watchObservedRunningTime="2026-06-06 13:01:59.510694252 +0000 UTC m=+24.577791599" Jun 06 13:02:00.367516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:00.367491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:00.367673 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:00.367586 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:00.497792 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:00.497763 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:02:00.498257 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:00.498131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"cc2f014f6b089c6aa7169ccdff6251c9051ed5b5bf6fbf2c44f03caf7415b62a"} Jun 06 13:02:01.367852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:01.367811 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:01.367852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:01.367829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:01.368067 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:01.367946 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:01.368150 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:01.368076 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:02.367985 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.367762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:02.368497 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:02.368008 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:02.504245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.504212 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="bfd0a823c9596803b9531bd402e2db576060984a31cc07c2785fb7083cd08bb4" exitCode=0 Jun 06 13:02:02.504402 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.504294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"bfd0a823c9596803b9531bd402e2db576060984a31cc07c2785fb7083cd08bb4"} Jun 06 13:02:02.507697 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.507676 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:02:02.508034 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.508016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"63aa0ab73b0b71f1eab378a2eb84416083aa281c6eed17c2336c59b530c79fb7"} Jun 06 13:02:02.508284 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.508265 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:02.508373 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.508365 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:02.508533 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.508521 2560 scope.go:117] "RemoveContainer" containerID="6ca33ae8653c37b42c8ff299590adc85122381020f453b5bf675fe6756d783bb" Jun 06 13:02:02.523889 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:02.523872 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:03.367719 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.367537 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:03.367878 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.367543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:03.367878 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:03.367806 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:03.367954 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:03.367918 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:03.514067 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.514042 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:02:03.514481 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.514459 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" event={"ID":"22488cff-e21d-48b4-a2c0-218fc783318b","Type":"ContainerStarted","Data":"4f1b960bd1c3008478c6bb1993772eb4bf6bd54c7bacf5a0731596905e39a84e"} Jun 06 13:02:03.514656 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.514644 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:03.530946 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.530920 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:03.542395 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.542357 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" podStartSLOduration=9.820792212 podStartE2EDuration="28.542342563s" totalImagesPullingTime="18.721550351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:03.540481607 +0000 UTC m=+28.607578955" watchObservedRunningTime="2026-06-06 13:02:03.542342563 +0000 UTC m=+28.609439910" Jun 06 13:02:03.878702 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.878624 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rpdcb"] Jun 06 13:02:03.878836 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.878727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:03.878836 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:03.878807 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:03.881476 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.881438 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pcqj5"] Jun 06 13:02:03.881610 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.881541 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:03.881676 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:03.881644 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:03.882199 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.882172 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqp5b"] Jun 06 13:02:03.882301 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:03.882267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:03.882394 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:03.882368 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:04.518520 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:04.518484 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="f235bbbfaa9ff1568b8c8ca79d21a646ce5ed5393a0092e39658aa6628905325" exitCode=0 Jun 06 13:02:04.519113 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:04.518575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"f235bbbfaa9ff1568b8c8ca79d21a646ce5ed5393a0092e39658aa6628905325"} Jun 06 13:02:05.368421 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:05.368390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:05.368566 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:05.368456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:05.368566 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:05.368462 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:05.368652 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:05.368561 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:05.368652 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:05.368610 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:05.368708 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:05.368662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:06.524940 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:06.524761 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="1f88765afd4deea6e47e0d0bc010dbb68f14af4fbbee28a4d7fb970c36137697" exitCode=0 Jun 06 13:02:06.525449 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:06.524832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"1f88765afd4deea6e47e0d0bc010dbb68f14af4fbbee28a4d7fb970c36137697"} Jun 06 13:02:07.367880 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:07.367843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:07.368050 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:07.367845 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:07.368050 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:07.367844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:07.368050 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:07.368036 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:07.368247 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:07.368160 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:07.368247 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:07.368240 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:09.052232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.052193 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:09.052232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.052244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052356 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052390 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052416 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052424 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:02:41.052405815 +0000 UTC m=+66.119503146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052429 2560 projected.go:196] Error preparing data for projected volume kube-api-access-bzvt2 for pod openshift-network-diagnostics/network-check-target-pcqj5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:02:09.052839 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.052483 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2 podName:83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:41.05246721 +0000 UTC m=+66.119564552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bzvt2" (UniqueName: "kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2") pod "network-check-target-pcqj5" (UID: "83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 13:02:09.152549 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.152514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:09.152715 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.152645 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 13:02:09.152715 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.152707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret podName:69d08e50-2ea5-4861-9048-f6d616307aa6 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:41.152691449 +0000 UTC m=+66.219788778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret") pod "global-pull-secret-syncer-rpdcb" (UID: "69d08e50-2ea5-4861-9048-f6d616307aa6") : object "kube-system"/"original-pull-secret" not registered Jun 06 13:02:09.367404 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.367288 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:09.367404 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.367300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:09.367683 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.367473 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:09.367683 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.367492 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:02:09.367683 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.367552 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rpdcb" podUID="69d08e50-2ea5-4861-9048-f6d616307aa6" Jun 06 13:02:09.367683 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:09.367640 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pcqj5" podUID="83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73" Jun 06 13:02:09.743370 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.743331 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-166.ec2.internal" event="NodeReady" Jun 06 13:02:09.743612 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.743481 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 13:02:09.784712 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.784681 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wl8b6"] Jun 06 13:02:09.816537 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.816484 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gg4"] Jun 06 13:02:09.816705 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.816637 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:09.819294 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.819270 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9w2\"" Jun 06 13:02:09.819448 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.819270 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 13:02:09.819514 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.819274 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 13:02:09.830537 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.830511 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wl8b6"] Jun 06 13:02:09.830666 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.830557 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gg4"] Jun 06 13:02:09.830666 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.830646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:09.833232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.833214 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 13:02:09.833358 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.833335 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 13:02:09.833477 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.833366 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 13:02:09.833477 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.833388 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jgnwh\"" Jun 06 13:02:09.959320 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be491cdc-5209-406a-a52d-4ef3da74d838-cert\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:09.959488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhx5p\" (UniqueName: \"kubernetes.io/projected/3c629622-118c-4d37-b8de-9776c6bc2ce9-kube-api-access-rhx5p\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:09.959488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959393 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c629622-118c-4d37-b8de-9776c6bc2ce9-config-volume\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:09.959488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:09.959488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959442 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h89b5\" (UniqueName: \"kubernetes.io/projected/be491cdc-5209-406a-a52d-4ef3da74d838-kube-api-access-h89b5\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:09.959488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:09.959481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c629622-118c-4d37-b8de-9776c6bc2ce9-tmp-dir\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.060675 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhx5p\" (UniqueName: \"kubernetes.io/projected/3c629622-118c-4d37-b8de-9776c6bc2ce9-kube-api-access-rhx5p\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.060675 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c629622-118c-4d37-b8de-9776c6bc2ce9-config-volume\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060755 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060831 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h89b5\" (UniqueName: \"kubernetes.io/projected/be491cdc-5209-406a-a52d-4ef3da74d838-kube-api-access-h89b5\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c629622-118c-4d37-b8de-9776c6bc2ce9-tmp-dir\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:10.060880 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.060919 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be491cdc-5209-406a-a52d-4ef3da74d838-cert\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:10.061238 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:10.060960 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:10.560938991 +0000 UTC m=+35.628036336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:10.061526 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.061245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c629622-118c-4d37-b8de-9776c6bc2ce9-config-volume\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.061526 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.061279 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c629622-118c-4d37-b8de-9776c6bc2ce9-tmp-dir\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.065357 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.065333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be491cdc-5209-406a-a52d-4ef3da74d838-cert\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:10.069232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.069193 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhx5p\" (UniqueName: \"kubernetes.io/projected/3c629622-118c-4d37-b8de-9776c6bc2ce9-kube-api-access-rhx5p\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.069352 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.069237 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h89b5\" (UniqueName: \"kubernetes.io/projected/be491cdc-5209-406a-a52d-4ef3da74d838-kube-api-access-h89b5\") pod \"ingress-canary-t9gg4\" (UID: \"be491cdc-5209-406a-a52d-4ef3da74d838\") " pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:10.141323 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.141284 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9gg4" Jun 06 13:02:10.564801 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.564763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:10.565018 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:10.564929 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:10.565018 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:10.565007 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:11.56498597 +0000 UTC m=+36.632083310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:10.774702 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:10.774674 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9gg4"] Jun 06 13:02:10.778164 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:02:10.778135 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe491cdc_5209_406a_a52d_4ef3da74d838.slice/crio-15ade52255529cff2c3535c450175260cce390610174782cbd57ad37db867d0d WatchSource:0}: Error finding container 15ade52255529cff2c3535c450175260cce390610174782cbd57ad37db867d0d: Status 404 returned error can't find the container with id 15ade52255529cff2c3535c450175260cce390610174782cbd57ad37db867d0d Jun 06 13:02:11.368037 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.367855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:11.368451 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.367855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:11.368451 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.367915 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372288 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372338 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372360 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372366 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcwkx\"" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372294 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-brfnl\"" Jun 06 13:02:11.372506 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.372379 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:02:11.542819 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.542776 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="b790bdeb06b398cb4113486870d367235be7b90b438d3b388eb6f0ddaa703d57" exitCode=0 Jun 06 13:02:11.542989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.542843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"b790bdeb06b398cb4113486870d367235be7b90b438d3b388eb6f0ddaa703d57"} Jun 06 13:02:11.544255 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.544219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9gg4" event={"ID":"be491cdc-5209-406a-a52d-4ef3da74d838","Type":"ContainerStarted","Data":"15ade52255529cff2c3535c450175260cce390610174782cbd57ad37db867d0d"} Jun 06 13:02:11.573060 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:11.573035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:11.573202 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:11.573185 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:11.573268 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:11.573249 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:13.573231395 +0000 UTC m=+38.640328736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:12.550477 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:12.550424 2560 generic.go:356] "Generic (PLEG): container finished" podID="ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1" containerID="265560cc6685b450a2fa2d0780fa1f6a3e1b316b7e2772f83a2b9ab6b291c634" exitCode=0 Jun 06 13:02:12.550477 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:12.550460 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerDied","Data":"265560cc6685b450a2fa2d0780fa1f6a3e1b316b7e2772f83a2b9ab6b291c634"} Jun 06 13:02:13.555595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:13.555560 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" event={"ID":"ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1","Type":"ContainerStarted","Data":"8e109db4903a18cf6ce428d3b1d5f4d5efb5dbe305f4e622f0eb256b3561583c"} Jun 06 13:02:13.556933 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:13.556908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9gg4" event={"ID":"be491cdc-5209-406a-a52d-4ef3da74d838","Type":"ContainerStarted","Data":"a26816c2303d14b8e2c21c2e89325eea5b44a0e35971994f38a72d47ebedf79f"} Jun 06 13:02:13.576310 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:13.576265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvsxw" podStartSLOduration=9.241218597 podStartE2EDuration="38.576249829s" totalImagesPullingTime="29.335031232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:13.574603091 +0000 UTC m=+38.641700429" watchObservedRunningTime="2026-06-06 13:02:13.576249829 +0000 UTC m=+38.643347175" Jun 06 13:02:13.588446 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:13.588411 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t9gg4" podStartSLOduration=2.590488788 podStartE2EDuration="4.588400846s" totalImagesPullingTime="1.997912058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:13.587970719 +0000 UTC m=+38.655068065" watchObservedRunningTime="2026-06-06 13:02:13.588400846 +0000 UTC m=+38.655498193" Jun 06 13:02:13.589166 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:13.589150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:13.589289 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:13.589275 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:13.589335 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:13.589326 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:17.589314699 +0000 UTC m=+42.656412051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:17.619280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:17.619246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:17.619627 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:17.619391 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:17.619627 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:17.619448 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:25.619432861 +0000 UTC m=+50.686530194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:25.672485 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:25.672438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:25.673000 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:25.672582 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:25.673000 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:25.672641 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:02:41.672626698 +0000 UTC m=+66.739724023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:33.200459 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.200415 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn"] Jun 06 13:02:33.250801 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.250772 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn"] Jun 06 13:02:33.250947 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.250854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.255259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.255236 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 06 13:02:33.255259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.255255 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 06 13:02:33.255259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.255262 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 06 13:02:33.255523 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.255283 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 06 13:02:33.255523 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.255238 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mncmd\"" Jun 06 13:02:33.415424 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.415394 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52ts\" (UniqueName: \"kubernetes.io/projected/7e66c3dd-89e1-43fe-b109-307e0d0104b8-kube-api-access-l52ts\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.415611 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.415477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e66c3dd-89e1-43fe-b109-307e0d0104b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.516735 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.516706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l52ts\" (UniqueName: \"kubernetes.io/projected/7e66c3dd-89e1-43fe-b109-307e0d0104b8-kube-api-access-l52ts\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.516888 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.516774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e66c3dd-89e1-43fe-b109-307e0d0104b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.520057 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.520029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7e66c3dd-89e1-43fe-b109-307e0d0104b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.524752 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.524729 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52ts\" (UniqueName: \"kubernetes.io/projected/7e66c3dd-89e1-43fe-b109-307e0d0104b8-kube-api-access-l52ts\") pod \"managed-serviceaccount-addon-agent-69d877fd5d-n49vn\" (UID: \"7e66c3dd-89e1-43fe-b109-307e0d0104b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.571238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.571214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" Jun 06 13:02:33.709625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:33.709597 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn"] Jun 06 13:02:33.712976 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:02:33.712951 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e66c3dd_89e1_43fe_b109_307e0d0104b8.slice/crio-982e263af6b509b05c736a6a2ca10b617bdca6b46793b32db962ffe51dc16617 WatchSource:0}: Error finding container 982e263af6b509b05c736a6a2ca10b617bdca6b46793b32db962ffe51dc16617: Status 404 returned error can't find the container with id 982e263af6b509b05c736a6a2ca10b617bdca6b46793b32db962ffe51dc16617 Jun 06 13:02:34.607692 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:34.607647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" event={"ID":"7e66c3dd-89e1-43fe-b109-307e0d0104b8","Type":"ContainerStarted","Data":"982e263af6b509b05c736a6a2ca10b617bdca6b46793b32db962ffe51dc16617"} Jun 06 13:02:35.531403 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:35.531372 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l9qqc" Jun 06 13:02:36.613740 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:36.613705 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" event={"ID":"7e66c3dd-89e1-43fe-b109-307e0d0104b8","Type":"ContainerStarted","Data":"ba8230915c6f99e6c46e73301de2de73666ab08fefacdeca098574e563ab0880"} Jun 06 13:02:36.627968 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:36.627924 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" podStartSLOduration=1.307498262 podStartE2EDuration="3.627910075s" totalImagesPullingTime="2.320411813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:36.627683697 +0000 UTC m=+61.694781044" watchObservedRunningTime="2026-06-06 13:02:36.627910075 +0000 UTC m=+61.695007422" Jun 06 13:02:41.071321 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.071276 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:41.071799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.071343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:02:41.074452 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.074430 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 13:02:41.074565 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.074465 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 13:02:41.081844 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:41.081818 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:02:41.081947 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:41.081875 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:03:45.081857538 +0000 UTC m=+130.148954879 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : secret "metrics-daemon-secret" not found Jun 06 13:02:41.084200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.084185 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 13:02:41.094497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.094478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvt2\" (UniqueName: \"kubernetes.io/projected/83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73-kube-api-access-bzvt2\") pod \"network-check-target-pcqj5\" (UID: \"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73\") " pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:41.172021 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.171997 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:41.174786 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.174767 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 13:02:41.184859 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.184835 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69d08e50-2ea5-4861-9048-f6d616307aa6-original-pull-secret\") pod \"global-pull-secret-syncer-rpdcb\" (UID: \"69d08e50-2ea5-4861-9048-f6d616307aa6\") " pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:41.378977 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.378895 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rpdcb" Jun 06 13:02:41.390255 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.390231 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-brfnl\"" Jun 06 13:02:41.397453 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.397433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:41.519039 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.519004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rpdcb"] Jun 06 13:02:41.521847 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:02:41.521821 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d08e50_2ea5_4861_9048_f6d616307aa6.slice/crio-cd979c8c039629720d1737eb82352f861b62a9377439f838e804de9d1599cf0d WatchSource:0}: Error finding container cd979c8c039629720d1737eb82352f861b62a9377439f838e804de9d1599cf0d: Status 404 returned error can't find the container with id cd979c8c039629720d1737eb82352f861b62a9377439f838e804de9d1599cf0d Jun 06 13:02:41.539666 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.539643 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pcqj5"] Jun 06 13:02:41.542602 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:02:41.542581 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ccbda8_cb9b_4b7e_80d4_0479e0f8ce73.slice/crio-5d2239e0c566801df68169130baa0cd5237bb3e81cffa9dec81fe2d677b1db16 WatchSource:0}: Error finding container 5d2239e0c566801df68169130baa0cd5237bb3e81cffa9dec81fe2d677b1db16: Status 404 returned error can't find the container with id 5d2239e0c566801df68169130baa0cd5237bb3e81cffa9dec81fe2d677b1db16 Jun 06 13:02:41.626200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.626170 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rpdcb" event={"ID":"69d08e50-2ea5-4861-9048-f6d616307aa6","Type":"ContainerStarted","Data":"cd979c8c039629720d1737eb82352f861b62a9377439f838e804de9d1599cf0d"} Jun 06 13:02:41.627179 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.627160 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pcqj5" event={"ID":"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73","Type":"ContainerStarted","Data":"5d2239e0c566801df68169130baa0cd5237bb3e81cffa9dec81fe2d677b1db16"} Jun 06 13:02:41.680601 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:41.680545 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:02:41.680695 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:41.680678 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:02:41.680742 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:02:41.680731 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:03:13.680715709 +0000 UTC m=+98.747813050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:02:46.640833 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:46.640790 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rpdcb" event={"ID":"69d08e50-2ea5-4861-9048-f6d616307aa6","Type":"ContainerStarted","Data":"bebc33447feb5fe317bf90dbb17a4e6aaf8b13d4dc59e9ff7addcedf52c4113e"} Jun 06 13:02:46.642210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:46.642184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pcqj5" event={"ID":"83ccbda8-cb9b-4b7e-80d4-0479e0f8ce73","Type":"ContainerStarted","Data":"a3f5aa32ffb4614170d46062760e98585210e02b4b7a4bef706c0a2ff2706e57"} Jun 06 13:02:46.642320 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:46.642247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:02:46.655630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:46.655593 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rpdcb" podStartSLOduration=67.179398404 podStartE2EDuration="1m11.655581908s" totalImagesPullingTime="4.476183504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:46.654777309 +0000 UTC m=+71.721874657" watchObservedRunningTime="2026-06-06 13:02:46.655581908 +0000 UTC m=+71.722679255" Jun 06 13:02:46.668276 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:02:46.668239 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pcqj5" podStartSLOduration=67.216001848 podStartE2EDuration="1m11.668227501s" totalImagesPullingTime="4.452225653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:02:46.667476013 +0000 UTC m=+71.734573360" watchObservedRunningTime="2026-06-06 13:02:46.668227501 +0000 UTC m=+71.735324848" Jun 06 13:03:13.771054 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:03:13.771026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:03:13.771451 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:03:13.771157 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:03:13.771451 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:03:13.771218 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:17.771203747 +0000 UTC m=+162.838301073 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:03:17.647194 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:03:17.647160 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pcqj5" Jun 06 13:03:45.177688 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:03:45.177652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:03:45.178192 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:03:45.177761 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 13:03:45.178192 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:03:45.177830 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs podName:c9383e3e-7bec-4060-bdce-025583c4600e nodeName:}" failed. No retries permitted until 2026-06-06 13:05:47.177816829 +0000 UTC m=+252.244914154 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs") pod "network-metrics-daemon-mqp5b" (UID: "c9383e3e-7bec-4060-bdce-025583c4600e") : secret "metrics-daemon-secret" not found Jun 06 13:04:12.828791 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:12.828750 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wl8b6" podUID="3c629622-118c-4d37-b8de-9776c6bc2ce9" Jun 06 13:04:12.847605 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:12.847583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:04:14.392623 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:14.392582 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mqp5b" podUID="c9383e3e-7bec-4060-bdce-025583c4600e" Jun 06 13:04:17.798896 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:17.798820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:04:17.799274 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:17.798937 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 13:04:17.799274 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:17.799014 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls podName:3c629622-118c-4d37-b8de-9776c6bc2ce9 nodeName:}" failed. No retries permitted until 2026-06-06 13:06:19.798994662 +0000 UTC m=+284.866092004 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls") pod "dns-default-wl8b6" (UID: "3c629622-118c-4d37-b8de-9776c6bc2ce9") : secret "dns-default-metrics-tls" not found Jun 06 13:04:27.368256 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:27.368212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:04:36.909577 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:36.909543 2560 generic.go:356] "Generic (PLEG): container finished" podID="7e66c3dd-89e1-43fe-b109-307e0d0104b8" containerID="ba8230915c6f99e6c46e73301de2de73666ab08fefacdeca098574e563ab0880" exitCode=255 Jun 06 13:04:36.909988 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:36.909603 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" event={"ID":"7e66c3dd-89e1-43fe-b109-307e0d0104b8","Type":"ContainerDied","Data":"ba8230915c6f99e6c46e73301de2de73666ab08fefacdeca098574e563ab0880"} Jun 06 13:04:36.915192 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:36.915173 2560 scope.go:117] "RemoveContainer" containerID="ba8230915c6f99e6c46e73301de2de73666ab08fefacdeca098574e563ab0880" Jun 06 13:04:37.914345 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:37.914310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69d877fd5d-n49vn" event={"ID":"7e66c3dd-89e1-43fe-b109-307e0d0104b8","Type":"ContainerStarted","Data":"29654fecd0d3c36202de2fe95f1380193019ba9b61b41e4d801cd310ca5eb0e9"} Jun 06 13:04:40.784136 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.784083 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw"] Jun 06 13:04:40.785823 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.785806 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" Jun 06 13:04:40.787188 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.787164 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7"] Jun 06 13:04:40.788245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.788221 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.788385 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.788361 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.789007 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.788991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:40.789426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.789409 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bpmk9\"" Jun 06 13:04:40.791269 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.791253 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jdqhm\"" Jun 06 13:04:40.791568 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.791548 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z7t94"] Jun 06 13:04:40.792733 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.792714 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 06 13:04:40.792733 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.792724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 06 13:04:40.793416 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.793388 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7959bd76fc-gp9zz"] Jun 06 13:04:40.793519 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.793502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:40.795157 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.795142 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.797540 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.797522 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw"] Jun 06 13:04:40.799926 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.799905 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 06 13:04:40.800178 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800002 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 06 13:04:40.800178 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800068 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kswmg\"" Jun 06 13:04:40.800303 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800002 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 06 13:04:40.800421 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800405 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.800659 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800640 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 06 13:04:40.800659 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800655 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 06 13:04:40.800835 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800734 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 06 13:04:40.800925 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:40.801008 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.800941 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.801122 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.801039 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dh8jv\"" Jun 06 13:04:40.801417 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.801396 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 06 13:04:40.805134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.805114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7"] Jun 06 13:04:40.812210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.812175 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z7t94"] Jun 06 13:04:40.812876 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.812825 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 06 13:04:40.816750 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.816726 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7959bd76fc-gp9zz"] Jun 06 13:04:40.856986 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.856950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn62q\" (UniqueName: \"kubernetes.io/projected/36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b-kube-api-access-fn62q\") pod \"volume-data-source-validator-78dd696465-hj9qw\" (UID: \"36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" Jun 06 13:04:40.886883 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.886846 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:04:40.888772 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.888750 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:40.891291 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.891268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 13:04:40.891412 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.891384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 13:04:40.891504 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.891481 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 13:04:40.891868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.891856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b82xj\"" Jun 06 13:04:40.896730 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.896708 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 13:04:40.901906 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.901880 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:04:40.958364 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:40.958364 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958366 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36fb4002-c77e-4980-bb45-8751dcbe7755-serving-cert\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63a99380-0a01-42b8-9b32-7c4c173abbf1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958466 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn62q\" (UniqueName: \"kubernetes.io/projected/36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b-kube-api-access-fn62q\") pod \"volume-data-source-validator-78dd696465-hj9qw\" (UID: \"36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-default-certificate\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-stats-auth\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.958630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-trusted-ca\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:40.958852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-config\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:40.958852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmbf\" (UniqueName: \"kubernetes.io/projected/36fb4002-c77e-4980-bb45-8751dcbe7755-kube-api-access-zvmbf\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:40.958852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.958852 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.958719 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9f5\" (UniqueName: \"kubernetes.io/projected/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-kube-api-access-fz9f5\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:40.965788 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:40.965761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn62q\" (UniqueName: \"kubernetes.io/projected/36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b-kube-api-access-fn62q\") pod \"volume-data-source-validator-78dd696465-hj9qw\" (UID: \"36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" Jun 06 13:04:41.060026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.059938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36fb4002-c77e-4980-bb45-8751dcbe7755-serving-cert\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.060026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.059977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv7b8\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63a99380-0a01-42b8-9b32-7c4c173abbf1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060030 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060079 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-stats-auth\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-trusted-ca\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmbf\" (UniqueName: \"kubernetes.io/projected/36fb4002-c77e-4980-bb45-8751dcbe7755-kube-api-access-zvmbf\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-default-certificate\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.060348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.060375 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.060441 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.560421784 +0000 UTC m=+186.627519113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.060544 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.060620 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.560603428 +0000 UTC m=+186.627700753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : secret "router-metrics-certs-default" not found Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-config\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060717 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.060799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9f5\" (UniqueName: \"kubernetes.io/projected/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-kube-api-access-fz9f5\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.061262 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.060869 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/63a99380-0a01-42b8-9b32-7c4c173abbf1-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:41.061262 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.060995 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.560979562 +0000 UTC m=+186.628076907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : configmap references non-existent config key: service-ca.crt Jun 06 13:04:41.061262 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.061215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-trusted-ca\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.061416 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.061394 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/36fb4002-c77e-4980-bb45-8751dcbe7755-config\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.062574 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.062556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/36fb4002-c77e-4980-bb45-8751dcbe7755-serving-cert\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.062703 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.062685 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-stats-auth\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.062766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.062756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-default-certificate\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.068462 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.068441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmbf\" (UniqueName: \"kubernetes.io/projected/36fb4002-c77e-4980-bb45-8751dcbe7755-kube-api-access-zvmbf\") pod \"console-operator-668fdbf85c-z7t94\" (UID: \"36fb4002-c77e-4980-bb45-8751dcbe7755\") " pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.068711 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.068694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9f5\" (UniqueName: \"kubernetes.io/projected/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-kube-api-access-fz9f5\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.096805 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.096779 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" Jun 06 13:04:41.114413 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.114390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:41.161225 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv7b8\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161225 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161225 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161312 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161693 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.161506 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.161797 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.161759 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:04:41.161860 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.161800 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-699fc6766d-5mjx9: secret "image-registry-tls" not found Jun 06 13:04:41.161913 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.161877 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls podName:49b07720-799f-4c71-98b7-cda18222db2c nodeName:}" failed. No retries permitted until 2026-06-06 13:04:41.661857985 +0000 UTC m=+186.728955330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls") pod "image-registry-699fc6766d-5mjx9" (UID: "49b07720-799f-4c71-98b7-cda18222db2c") : secret "image-registry-tls" not found Jun 06 13:04:41.162846 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.162703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.162997 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.162968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.163598 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.163571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.165272 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.165220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.166706 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.166664 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.172800 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.172751 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.172931 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.172911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv7b8\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.225633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.225579 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw"] Jun 06 13:04:41.228600 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:04:41.228574 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c0c4e5_bc25_4bcc_8500_7e8c3f9de55b.slice/crio-d9a6046aba992ff318304e242cd88a8cad74bc91bbb6d71eebb1f062b41d110a WatchSource:0}: Error finding container d9a6046aba992ff318304e242cd88a8cad74bc91bbb6d71eebb1f062b41d110a: Status 404 returned error can't find the container with id d9a6046aba992ff318304e242cd88a8cad74bc91bbb6d71eebb1f062b41d110a Jun 06 13:04:41.243491 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.243462 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-z7t94"] Jun 06 13:04:41.245778 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:04:41.245753 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fb4002_c77e_4980_bb45_8751dcbe7755.slice/crio-952f5b863d22d28c0268168f865d5e1a6491da28e2a8fa93dd282410f25254d3 WatchSource:0}: Error finding container 952f5b863d22d28c0268168f865d5e1a6491da28e2a8fa93dd282410f25254d3: Status 404 returned error can't find the container with id 952f5b863d22d28c0268168f865d5e1a6491da28e2a8fa93dd282410f25254d3 Jun 06 13:04:41.564286 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.564253 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.564327 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.564370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.564439 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.564419658 +0000 UTC m=+187.631516999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : configmap references non-existent config key: service-ca.crt Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.564454 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.564440 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:41.564540 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.564514 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.564499001 +0000 UTC m=+187.631596347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : secret "router-metrics-certs-default" not found Jun 06 13:04:41.564745 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.564553 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.564540245 +0000 UTC m=+187.631637575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:41.665809 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.665737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:41.665978 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.665895 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:04:41.665978 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.665914 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-699fc6766d-5mjx9: secret "image-registry-tls" not found Jun 06 13:04:41.665978 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:41.665975 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls podName:49b07720-799f-4c71-98b7-cda18222db2c nodeName:}" failed. No retries permitted until 2026-06-06 13:04:42.66595316 +0000 UTC m=+187.733050515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls") pod "image-registry-699fc6766d-5mjx9" (UID: "49b07720-799f-4c71-98b7-cda18222db2c") : secret "image-registry-tls" not found Jun 06 13:04:41.928072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.927983 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" event={"ID":"36fb4002-c77e-4980-bb45-8751dcbe7755","Type":"ContainerStarted","Data":"952f5b863d22d28c0268168f865d5e1a6491da28e2a8fa93dd282410f25254d3"} Jun 06 13:04:41.929274 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:41.929245 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" event={"ID":"36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b","Type":"ContainerStarted","Data":"d9a6046aba992ff318304e242cd88a8cad74bc91bbb6d71eebb1f062b41d110a"} Jun 06 13:04:42.573870 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.573842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:42.574026 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.573889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:42.574026 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.573982 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:04:42.574026 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.573983 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:42.574189 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.574031 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.574017163 +0000 UTC m=+189.641114487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : secret "router-metrics-certs-default" not found Jun 06 13:04:42.574189 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.574049 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:42.574189 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.574083 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.574063061 +0000 UTC m=+189.641160397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:42.574189 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.574135 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.574125417 +0000 UTC m=+189.641222744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : configmap references non-existent config key: service-ca.crt Jun 06 13:04:42.675341 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.675311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:42.675522 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.675483 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:04:42.675522 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.675504 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-699fc6766d-5mjx9: secret "image-registry-tls" not found Jun 06 13:04:42.675643 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:42.675574 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls podName:49b07720-799f-4c71-98b7-cda18222db2c nodeName:}" failed. No retries permitted until 2026-06-06 13:04:44.675551512 +0000 UTC m=+189.742648837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls") pod "image-registry-699fc6766d-5mjx9" (UID: "49b07720-799f-4c71-98b7-cda18222db2c") : secret "image-registry-tls" not found Jun 06 13:04:42.936769 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.936693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" event={"ID":"36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b","Type":"ContainerStarted","Data":"5db8e746f4e46668df9988009480e9a97d4f7955cc8b6b231d9270f55149a103"} Jun 06 13:04:42.950493 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:42.950449 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hj9qw" podStartSLOduration=1.6841467620000001 podStartE2EDuration="2.950435122s" totalImagesPullingTime="1.26628836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:42.949524296 +0000 UTC m=+188.016621654" watchObservedRunningTime="2026-06-06 13:04:42.950435122 +0000 UTC m=+188.017532467" Jun 06 13:04:44.590637 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.590587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:44.590637 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.590645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.590679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.590744 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.590782 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.590768507 +0000 UTC m=+193.657865848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : configmap references non-existent config key: service-ca.crt Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.590808 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.590794997 +0000 UTC m=+193.657892322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.590816 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:04:44.591134 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.590879 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.590863142 +0000 UTC m=+193.657960483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : secret "router-metrics-certs-default" not found Jun 06 13:04:44.691471 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.691437 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:44.691612 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.691581 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:04:44.691612 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.691599 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-699fc6766d-5mjx9: secret "image-registry-tls" not found Jun 06 13:04:44.691684 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:44.691660 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls podName:49b07720-799f-4c71-98b7-cda18222db2c nodeName:}" failed. No retries permitted until 2026-06-06 13:04:48.691645073 +0000 UTC m=+193.758742397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls") pod "image-registry-699fc6766d-5mjx9" (UID: "49b07720-799f-4c71-98b7-cda18222db2c") : secret "image-registry-tls" not found Jun 06 13:04:44.944553 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.944481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/0.log" Jun 06 13:04:44.944553 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.944520 2560 generic.go:356] "Generic (PLEG): container finished" podID="36fb4002-c77e-4980-bb45-8751dcbe7755" containerID="67ccc5783bd680a33fd4afe0131d5546516171cb29a74315c6f7c2251a635ab6" exitCode=255 Jun 06 13:04:44.944726 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.944600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" event={"ID":"36fb4002-c77e-4980-bb45-8751dcbe7755","Type":"ContainerDied","Data":"67ccc5783bd680a33fd4afe0131d5546516171cb29a74315c6f7c2251a635ab6"} Jun 06 13:04:44.944829 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:44.944818 2560 scope.go:117] "RemoveContainer" containerID="67ccc5783bd680a33fd4afe0131d5546516171cb29a74315c6f7c2251a635ab6" Jun 06 13:04:45.495572 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.495536 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9"] Jun 06 13:04:45.498646 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.498629 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" Jun 06 13:04:45.501228 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.501209 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 06 13:04:45.501316 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.501294 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 06 13:04:45.502261 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.502234 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cnqpd\"" Jun 06 13:04:45.509357 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.509337 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9"] Jun 06 13:04:45.598568 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.598539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9gzr\" (UniqueName: \"kubernetes.io/projected/d28883ef-f3e2-4c58-a2a7-caad82cd3279-kube-api-access-b9gzr\") pod \"migrator-955ffdf5f-sctb9\" (UID: \"d28883ef-f3e2-4c58-a2a7-caad82cd3279\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" Jun 06 13:04:45.699296 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.699259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9gzr\" (UniqueName: \"kubernetes.io/projected/d28883ef-f3e2-4c58-a2a7-caad82cd3279-kube-api-access-b9gzr\") pod \"migrator-955ffdf5f-sctb9\" (UID: \"d28883ef-f3e2-4c58-a2a7-caad82cd3279\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" Jun 06 13:04:45.706808 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.706784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9gzr\" (UniqueName: \"kubernetes.io/projected/d28883ef-f3e2-4c58-a2a7-caad82cd3279-kube-api-access-b9gzr\") pod \"migrator-955ffdf5f-sctb9\" (UID: \"d28883ef-f3e2-4c58-a2a7-caad82cd3279\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" Jun 06 13:04:45.807209 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.807097 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" Jun 06 13:04:45.929742 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.929712 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9"] Jun 06 13:04:45.932360 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:04:45.932334 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28883ef_f3e2_4c58_a2a7_caad82cd3279.slice/crio-57ddcc59502a42ffa52abc0f091915f88e7fe20ab8218060d61cf9de5bdcede9 WatchSource:0}: Error finding container 57ddcc59502a42ffa52abc0f091915f88e7fe20ab8218060d61cf9de5bdcede9: Status 404 returned error can't find the container with id 57ddcc59502a42ffa52abc0f091915f88e7fe20ab8218060d61cf9de5bdcede9 Jun 06 13:04:45.949690 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.949669 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:04:45.950116 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.950085 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/0.log" Jun 06 13:04:45.950177 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.950135 2560 generic.go:356] "Generic (PLEG): container finished" podID="36fb4002-c77e-4980-bb45-8751dcbe7755" containerID="1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870" exitCode=255 Jun 06 13:04:45.950251 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.950226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" event={"ID":"36fb4002-c77e-4980-bb45-8751dcbe7755","Type":"ContainerDied","Data":"1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870"} Jun 06 13:04:45.950303 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.950284 2560 scope.go:117] "RemoveContainer" containerID="67ccc5783bd680a33fd4afe0131d5546516171cb29a74315c6f7c2251a635ab6" Jun 06 13:04:45.950535 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.950518 2560 scope.go:117] "RemoveContainer" containerID="1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870" Jun 06 13:04:45.950726 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:45.950705 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z7t94_openshift-console-operator(36fb4002-c77e-4980-bb45-8751dcbe7755)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" podUID="36fb4002-c77e-4980-bb45-8751dcbe7755" Jun 06 13:04:45.951494 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:45.951326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" event={"ID":"d28883ef-f3e2-4c58-a2a7-caad82cd3279","Type":"ContainerStarted","Data":"57ddcc59502a42ffa52abc0f091915f88e7fe20ab8218060d61cf9de5bdcede9"} Jun 06 13:04:46.955938 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:46.955909 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:04:46.956316 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:46.956267 2560 scope.go:117] "RemoveContainer" containerID="1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870" Jun 06 13:04:46.956442 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:46.956423 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z7t94_openshift-console-operator(36fb4002-c77e-4980-bb45-8751dcbe7755)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" podUID="36fb4002-c77e-4980-bb45-8751dcbe7755" Jun 06 13:04:47.960218 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:47.960182 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" event={"ID":"d28883ef-f3e2-4c58-a2a7-caad82cd3279","Type":"ContainerStarted","Data":"6863b38c0454b9fc77f2b16031f60be95c55b2d13f359dc215a388925ba0d521"} Jun 06 13:04:47.960717 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:47.960240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" event={"ID":"d28883ef-f3e2-4c58-a2a7-caad82cd3279","Type":"ContainerStarted","Data":"45f7a1b679412e5640debadb51047c118376f53090707a35b2f1de5128b8df26"} Jun 06 13:04:47.974773 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:47.974724 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sctb9" podStartSLOduration=1.627377193 podStartE2EDuration="2.974709134s" totalImagesPullingTime="1.347331941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:47.973798597 +0000 UTC m=+193.040895945" watchObservedRunningTime="2026-06-06 13:04:47.974709134 +0000 UTC m=+193.041806481" Jun 06 13:04:48.625205 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:48.625154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:48.625205 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:48.625209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:48.625248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.625310 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.625383 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.625365075 +0000 UTC m=+201.692462428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.625390 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.625430 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.625417545 +0000 UTC m=+201.692514870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : configmap references non-existent config key: service-ca.crt Jun 06 13:04:48.625470 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.625445 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs podName:5587c9a1-e695-4ff2-8d23-e5e0a186d0d3 nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.625437782 +0000 UTC m=+201.692535107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs") pod "router-default-7959bd76fc-gp9zz" (UID: "5587c9a1-e695-4ff2-8d23-e5e0a186d0d3") : secret "router-metrics-certs-default" not found Jun 06 13:04:48.726232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:48.726189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:48.726409 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.726313 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 13:04:48.726409 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.726332 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-699fc6766d-5mjx9: secret "image-registry-tls" not found Jun 06 13:04:48.726409 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:48.726387 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls podName:49b07720-799f-4c71-98b7-cda18222db2c nodeName:}" failed. No retries permitted until 2026-06-06 13:04:56.726371903 +0000 UTC m=+201.793469250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls") pod "image-registry-699fc6766d-5mjx9" (UID: "49b07720-799f-4c71-98b7-cda18222db2c") : secret "image-registry-tls" not found Jun 06 13:04:48.926362 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:48.926288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrvwh_37551d62-2bb9-4b80-bcb0-a349529e9c41/dns-node-resolver/0.log" Jun 06 13:04:49.525184 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:49.525157 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nchz_b9b4178c-f6e9-4b57-bd69-2ebc27923c2e/node-ca/0.log" Jun 06 13:04:50.726246 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:50.726215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gg4_be491cdc-5209-406a-a52d-4ef3da74d838/serve-healthcheck-canary/0.log" Jun 06 13:04:50.926247 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:50.926219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sctb9_d28883ef-f3e2-4c58-a2a7-caad82cd3279/migrator/0.log" Jun 06 13:04:51.114691 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:51.114590 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:51.114691 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:51.114686 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:04:51.115014 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:51.115002 2560 scope.go:117] "RemoveContainer" containerID="1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870" Jun 06 13:04:51.115192 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:51.115173 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-z7t94_openshift-console-operator(36fb4002-c77e-4980-bb45-8751dcbe7755)\"" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" podUID="36fb4002-c77e-4980-bb45-8751dcbe7755" Jun 06 13:04:51.125115 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:51.125078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sctb9_d28883ef-f3e2-4c58-a2a7-caad82cd3279/graceful-termination/0.log" Jun 06 13:04:56.688455 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.688407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:04:56.688455 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.688460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:56.688972 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.688493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:56.688972 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:56.688551 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 06 13:04:56.688972 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:04:56.688627 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert podName:63a99380-0a01-42b8-9b32-7c4c173abbf1 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:12.68861149 +0000 UTC m=+217.755708836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c2gn7" (UID: "63a99380-0a01-42b8-9b32-7c4c173abbf1") : secret "networking-console-plugin-cert" not found Jun 06 13:04:56.689123 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.689025 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-service-ca-bundle\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:56.690874 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.690855 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5587c9a1-e695-4ff2-8d23-e5e0a186d0d3-metrics-certs\") pod \"router-default-7959bd76fc-gp9zz\" (UID: \"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3\") " pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:56.720942 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.720914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:56.789756 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.789728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:56.792021 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.791993 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"image-registry-699fc6766d-5mjx9\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:56.797845 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.797819 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:04:56.848266 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.848182 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7959bd76fc-gp9zz"] Jun 06 13:04:56.852539 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:04:56.852397 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5587c9a1_e695_4ff2_8d23_e5e0a186d0d3.slice/crio-02471d6f8ccfd74b76fb254b749e6305166c3e99106ad51f12d8b55579305094 WatchSource:0}: Error finding container 02471d6f8ccfd74b76fb254b749e6305166c3e99106ad51f12d8b55579305094: Status 404 returned error can't find the container with id 02471d6f8ccfd74b76fb254b749e6305166c3e99106ad51f12d8b55579305094 Jun 06 13:04:56.932053 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.932032 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:04:56.935347 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:04:56.935325 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b07720_799f_4c71_98b7_cda18222db2c.slice/crio-193b3b7af848e4f0007e051129f47ab14e68564b6d733bb9a4102648aa6ae097 WatchSource:0}: Error finding container 193b3b7af848e4f0007e051129f47ab14e68564b6d733bb9a4102648aa6ae097: Status 404 returned error can't find the container with id 193b3b7af848e4f0007e051129f47ab14e68564b6d733bb9a4102648aa6ae097 Jun 06 13:04:56.988593 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.988563 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" event={"ID":"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3","Type":"ContainerStarted","Data":"b39724a6be6916cd3e4df561cce64089df8ec14588db657793e753a680957480"} Jun 06 13:04:56.988783 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.988621 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" event={"ID":"5587c9a1-e695-4ff2-8d23-e5e0a186d0d3","Type":"ContainerStarted","Data":"02471d6f8ccfd74b76fb254b749e6305166c3e99106ad51f12d8b55579305094"} Jun 06 13:04:56.990077 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:56.990058 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" event={"ID":"49b07720-799f-4c71-98b7-cda18222db2c","Type":"ContainerStarted","Data":"193b3b7af848e4f0007e051129f47ab14e68564b6d733bb9a4102648aa6ae097"} Jun 06 13:04:57.005865 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.005822 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" podStartSLOduration=17.005808768 podStartE2EDuration="17.005808768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:57.004639994 +0000 UTC m=+202.071737341" watchObservedRunningTime="2026-06-06 13:04:57.005808768 +0000 UTC m=+202.072906117" Jun 06 13:04:57.721585 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.721547 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:57.724153 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.724130 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:57.995074 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.995037 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" event={"ID":"49b07720-799f-4c71-98b7-cda18222db2c","Type":"ContainerStarted","Data":"fc7b22dae9b4b0b26007a4f2f41606e0c6a0dc2a1ac5add1eaee73a8f7d48a4f"} Jun 06 13:04:57.995263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.995234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:57.996461 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:57.996444 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7959bd76fc-gp9zz" Jun 06 13:04:58.011982 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:58.011938 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" podStartSLOduration=18.01192449 podStartE2EDuration="18.01192449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:04:58.010718321 +0000 UTC m=+203.077815661" watchObservedRunningTime="2026-06-06 13:04:58.01192449 +0000 UTC m=+203.079021837" Jun 06 13:04:58.998827 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:04:58.998794 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:05:02.367368 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:02.367344 2560 scope.go:117] "RemoveContainer" containerID="1e4c3eb11e35b227da661c1d111eb6db346c7c2a93e91cd72d87169d2a478870" Jun 06 13:05:03.013471 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:03.013440 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:05:03.013643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:03.013498 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" event={"ID":"36fb4002-c77e-4980-bb45-8751dcbe7755","Type":"ContainerStarted","Data":"51dab18340a8c172873acbb07ebfe15cbdceca8a1d5ee892e34746f049170040"} Jun 06 13:05:03.013805 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:03.013771 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:05:03.031196 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:03.031153 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" podStartSLOduration=20.372362266 podStartE2EDuration="23.03114099s" totalImagesPullingTime="2.658778724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:03.030540876 +0000 UTC m=+208.097638224" watchObservedRunningTime="2026-06-06 13:05:03.03114099 +0000 UTC m=+208.098238336" Jun 06 13:05:03.289974 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:03.289905 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-z7t94" Jun 06 13:05:09.013926 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.013891 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:05:09.024336 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.024312 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sdpbv"] Jun 06 13:05:09.027589 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.027574 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.030243 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.030222 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 13:05:09.030355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.030239 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 13:05:09.030426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.030374 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ff56m\"" Jun 06 13:05:09.030574 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.030539 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 13:05:09.030574 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.030556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 13:05:09.039127 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.039091 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdpbv"] Jun 06 13:05:09.080608 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.080587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13133f6-2165-4cf9-9e58-421148bb9518-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.080722 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.080619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jn5r\" (UniqueName: \"kubernetes.io/projected/f13133f6-2165-4cf9-9e58-421148bb9518-kube-api-access-4jn5r\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.080722 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.080651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13133f6-2165-4cf9-9e58-421148bb9518-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.080722 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.080693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13133f6-2165-4cf9-9e58-421148bb9518-crio-socket\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.080850 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.080726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13133f6-2165-4cf9-9e58-421148bb9518-data-volume\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182029 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.181996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13133f6-2165-4cf9-9e58-421148bb9518-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182029 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182028 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jn5r\" (UniqueName: \"kubernetes.io/projected/f13133f6-2165-4cf9-9e58-421148bb9518-kube-api-access-4jn5r\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182275 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182049 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13133f6-2165-4cf9-9e58-421148bb9518-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182275 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13133f6-2165-4cf9-9e58-421148bb9518-crio-socket\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182275 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13133f6-2165-4cf9-9e58-421148bb9518-data-volume\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182284 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f13133f6-2165-4cf9-9e58-421148bb9518-crio-socket\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182527 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f13133f6-2165-4cf9-9e58-421148bb9518-data-volume\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.182702 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.182686 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f13133f6-2165-4cf9-9e58-421148bb9518-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.184470 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.184449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f13133f6-2165-4cf9-9e58-421148bb9518-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.192969 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.192946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jn5r\" (UniqueName: \"kubernetes.io/projected/f13133f6-2165-4cf9-9e58-421148bb9518-kube-api-access-4jn5r\") pod \"insights-runtime-extractor-sdpbv\" (UID: \"f13133f6-2165-4cf9-9e58-421148bb9518\") " pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.336649 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.336621 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sdpbv" Jun 06 13:05:09.459503 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:09.459468 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sdpbv"] Jun 06 13:05:09.462596 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:09.462574 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13133f6_2165_4cf9_9e58_421148bb9518.slice/crio-7b475a4e6e04fa3b44eb0c967afeaf6d64bd7e1ee94c5aa29525c5727d8a80d7 WatchSource:0}: Error finding container 7b475a4e6e04fa3b44eb0c967afeaf6d64bd7e1ee94c5aa29525c5727d8a80d7: Status 404 returned error can't find the container with id 7b475a4e6e04fa3b44eb0c967afeaf6d64bd7e1ee94c5aa29525c5727d8a80d7 Jun 06 13:05:10.036946 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:10.036912 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdpbv" event={"ID":"f13133f6-2165-4cf9-9e58-421148bb9518","Type":"ContainerStarted","Data":"8ffb3458450714c410f714fb468459f899a97d6218883189f11ce8bbf906cc5e"} Jun 06 13:05:10.037321 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:10.036976 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdpbv" event={"ID":"f13133f6-2165-4cf9-9e58-421148bb9518","Type":"ContainerStarted","Data":"7b475a4e6e04fa3b44eb0c967afeaf6d64bd7e1ee94c5aa29525c5727d8a80d7"} Jun 06 13:05:11.043250 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:11.043210 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdpbv" event={"ID":"f13133f6-2165-4cf9-9e58-421148bb9518","Type":"ContainerStarted","Data":"5be553210d174afae38805aee7b16ed81b8789e1934318f1dbc35016bc42af2e"} Jun 06 13:05:12.048637 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:12.048601 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sdpbv" event={"ID":"f13133f6-2165-4cf9-9e58-421148bb9518","Type":"ContainerStarted","Data":"a162257d740c8903fa2ce10df4dee168c95968c298eacd600865d9bbb10eb19f"} Jun 06 13:05:12.065314 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:12.065269 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sdpbv" podStartSLOduration=1.961126537 podStartE2EDuration="4.065255717s" totalImagesPullingTime="2.10412918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:05:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:12.063554889 +0000 UTC m=+217.130652268" watchObservedRunningTime="2026-06-06 13:05:12.065255717 +0000 UTC m=+217.132353063" Jun 06 13:05:12.710415 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:12.710377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:05:12.712713 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:12.712689 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/63a99380-0a01-42b8-9b32-7c4c173abbf1-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c2gn7\" (UID: \"63a99380-0a01-42b8-9b32-7c4c173abbf1\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:05:12.903795 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:12.903759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" Jun 06 13:05:13.024903 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:13.024874 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7"] Jun 06 13:05:13.027375 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:13.027335 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a99380_0a01_42b8_9b32_7c4c173abbf1.slice/crio-39806ab7ce3d89e13aa80e1b994551f74a2c54616523a8b6d3e990f9b55975b7 WatchSource:0}: Error finding container 39806ab7ce3d89e13aa80e1b994551f74a2c54616523a8b6d3e990f9b55975b7: Status 404 returned error can't find the container with id 39806ab7ce3d89e13aa80e1b994551f74a2c54616523a8b6d3e990f9b55975b7 Jun 06 13:05:13.052515 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:13.052490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" event={"ID":"63a99380-0a01-42b8-9b32-7c4c173abbf1","Type":"ContainerStarted","Data":"39806ab7ce3d89e13aa80e1b994551f74a2c54616523a8b6d3e990f9b55975b7"} Jun 06 13:05:15.062070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.062034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" event={"ID":"63a99380-0a01-42b8-9b32-7c4c173abbf1","Type":"ContainerStarted","Data":"cc7e34b034c86d25d49d62966c4fb07088b21718fbe260b6a1f0f40d537002fc"} Jun 06 13:05:15.077389 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.077344 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c2gn7" podStartSLOduration=33.856537025 podStartE2EDuration="35.07733204s" totalImagesPullingTime="1.220795015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:15.076444522 +0000 UTC m=+220.143541870" watchObservedRunningTime="2026-06-06 13:05:15.07733204 +0000 UTC m=+220.144429417" Jun 06 13:05:15.772524 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.772464 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:05:15.775701 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.775683 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.778456 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.778434 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 13:05:15.778560 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.778462 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 13:05:15.779599 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.779573 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 13:05:15.779719 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.779577 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 13:05:15.779798 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.779752 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 13:05:15.779798 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.779779 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 13:05:15.779998 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.779980 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8jlbh\"" Jun 06 13:05:15.780072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.780055 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 13:05:15.787168 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.787142 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:05:15.791399 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.791376 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 13:05:15.834559 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834661 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834661 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834744 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834744 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fpg\" (UniqueName: \"kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834744 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.834833 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.834757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935507 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935552 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935569 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935591 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fpg\" (UniqueName: \"kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.935631 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.935629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.936387 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.936352 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.936495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.936397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.936495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.936461 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.936611 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.936512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.937920 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.937898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.938176 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.938157 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:15.942456 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:15.942434 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fpg\" (UniqueName: \"kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg\") pod \"console-5c9758fd9c-lvqbh\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:16.090250 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:16.090166 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:16.213622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:16.213531 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:05:16.216275 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:16.216251 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8f1091_13d6_493c_8f6b_80e7261f7a56.slice/crio-97c36a488075c64df3025a4b1bbc2d4796ccfb4f089017368a37f06347c4bfb9 WatchSource:0}: Error finding container 97c36a488075c64df3025a4b1bbc2d4796ccfb4f089017368a37f06347c4bfb9: Status 404 returned error can't find the container with id 97c36a488075c64df3025a4b1bbc2d4796ccfb4f089017368a37f06347c4bfb9 Jun 06 13:05:17.070218 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:17.070178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9758fd9c-lvqbh" event={"ID":"1f8f1091-13d6-493c-8f6b-80e7261f7a56","Type":"ContainerStarted","Data":"97c36a488075c64df3025a4b1bbc2d4796ccfb4f089017368a37f06347c4bfb9"} Jun 06 13:05:18.826683 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.826634 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv"] Jun 06 13:05:18.829692 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.829667 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:18.832365 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.832344 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 06 13:05:18.832462 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.832404 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 13:05:18.833414 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.833392 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jcxgw\"" Jun 06 13:05:18.833414 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.833404 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 13:05:18.833563 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.833421 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 06 13:05:18.833563 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.833472 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 13:05:18.835613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.835589 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9"] Jun 06 13:05:18.841215 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.841164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.842358 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.842299 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv"] Jun 06 13:05:18.843710 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.843684 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 06 13:05:18.843981 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.843945 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c5xwn\"" Jun 06 13:05:18.844222 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.844199 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 06 13:05:18.844353 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.844304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 06 13:05:18.851747 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.851728 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sgdxv"] Jun 06 13:05:18.854793 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.854776 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.857701 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.857683 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 13:05:18.857803 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.857737 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 13:05:18.857803 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.857773 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 13:05:18.857911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.857895 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pf29j\"" Jun 06 13:05:18.861996 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.861974 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9"] Jun 06 13:05:18.958158 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55q92\" (UniqueName: \"kubernetes.io/projected/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-api-access-55q92\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/436d359b-65ea-43e2-a39f-0f7ec3808d75-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958309 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958295 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7rjz\" (UniqueName: \"kubernetes.io/projected/9de57963-c152-4830-8ccb-0acace388179-kube-api-access-n7rjz\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:18.958489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958387 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-sys\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:18.958489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-node-exporter-wtmp\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958614 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9de57963-c152-4830-8ccb-0acace388179-node-exporter-textfile\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958614 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958614 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958569 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-metrics-client-ca\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958614 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:18.958614 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:18.958758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-root\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:18.958758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfz6z\" (UniqueName: \"kubernetes.io/projected/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-kube-api-access-zfz6z\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:18.958758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:18.958682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.020260 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.020175 2560 patch_prober.go:28] interesting pod/image-registry-699fc6766d-5mjx9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 13:05:19.020260 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.020232 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 13:05:19.059418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059389 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059441 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/436d359b-65ea-43e2-a39f-0f7ec3808d75-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7rjz\" (UniqueName: \"kubernetes.io/projected/9de57963-c152-4830-8ccb-0acace388179-kube-api-access-n7rjz\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-sys\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059606 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:05:19.059631 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-sys\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:05:19.059702 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls podName:436d359b-65ea-43e2-a39f-0f7ec3808d75 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:19.559679105 +0000 UTC m=+224.626776436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-v4vs9" (UID: "436d359b-65ea-43e2-a39f-0f7ec3808d75") : secret "kube-state-metrics-tls" not found Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-node-exporter-wtmp\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9de57963-c152-4830-8ccb-0acace388179-node-exporter-textfile\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059755 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-node-exporter-wtmp\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-metrics-client-ca\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059859 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/436d359b-65ea-43e2-a39f-0f7ec3808d75-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.059915 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:05:19.059634 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:05:19.059964 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls podName:9de57963-c152-4830-8ccb-0acace388179 nodeName:}" failed. No retries permitted until 2026-06-06 13:05:19.559946081 +0000 UTC m=+224.627043421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls") pod "node-exporter-sgdxv" (UID: "9de57963-c152-4830-8ccb-0acace388179") : secret "node-exporter-tls" not found Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.059865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060007 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-root\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060081 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfz6z\" (UniqueName: \"kubernetes.io/projected/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-kube-api-access-zfz6z\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060086 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9de57963-c152-4830-8ccb-0acace388179-node-exporter-textfile\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060193 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9de57963-c152-4830-8ccb-0acace388179-root\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55q92\" (UniqueName: \"kubernetes.io/projected/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-api-access-55q92\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060365 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.060437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060408 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.060987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060459 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-metrics-client-ca\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060849 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9de57963-c152-4830-8ccb-0acace388179-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.060987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.060893 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.061165 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.061090 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436d359b-65ea-43e2-a39f-0f7ec3808d75-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.062393 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.062363 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.062572 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.062555 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.062613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.062586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.062678 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.062658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.071218 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.071199 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55q92\" (UniqueName: \"kubernetes.io/projected/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-api-access-55q92\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.071689 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.071668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7rjz\" (UniqueName: \"kubernetes.io/projected/9de57963-c152-4830-8ccb-0acace388179-kube-api-access-n7rjz\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.071907 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.071887 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfz6z\" (UniqueName: \"kubernetes.io/projected/9d1ac40a-0b2d-4069-bc3e-aaf0015381db-kube-api-access-zfz6z\") pod \"openshift-state-metrics-65f78d5c66-z66vv\" (UID: \"9d1ac40a-0b2d-4069-bc3e-aaf0015381db\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.079003 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.078982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9758fd9c-lvqbh" event={"ID":"1f8f1091-13d6-493c-8f6b-80e7261f7a56","Type":"ContainerStarted","Data":"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f"} Jun 06 13:05:19.095449 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.095409 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c9758fd9c-lvqbh" podStartSLOduration=1.560356268 podStartE2EDuration="4.095396804s" totalImagesPullingTime="2.535040536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:19.094495691 +0000 UTC m=+224.161593051" watchObservedRunningTime="2026-06-06 13:05:19.095396804 +0000 UTC m=+224.162494150" Jun 06 13:05:19.140299 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.140276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" Jun 06 13:05:19.271554 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.271475 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv"] Jun 06 13:05:19.275283 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:19.275256 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1ac40a_0b2d_4069_bc3e_aaf0015381db.slice/crio-ecbc1bd3d51fb8bb52c5965ff32e188dc5e92cfda88a0cb1969eba256c2a0e22 WatchSource:0}: Error finding container ecbc1bd3d51fb8bb52c5965ff32e188dc5e92cfda88a0cb1969eba256c2a0e22: Status 404 returned error can't find the container with id ecbc1bd3d51fb8bb52c5965ff32e188dc5e92cfda88a0cb1969eba256c2a0e22 Jun 06 13:05:19.565230 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.565148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.565230 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.565183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.567390 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.567362 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9de57963-c152-4830-8ccb-0acace388179-node-exporter-tls\") pod \"node-exporter-sgdxv\" (UID: \"9de57963-c152-4830-8ccb-0acace388179\") " pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.567529 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.567507 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/436d359b-65ea-43e2-a39f-0f7ec3808d75-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-v4vs9\" (UID: \"436d359b-65ea-43e2-a39f-0f7ec3808d75\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.752144 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.752113 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" Jun 06 13:05:19.764179 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.764153 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgdxv" Jun 06 13:05:19.774878 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:19.774854 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de57963_c152_4830_8ccb_0acace388179.slice/crio-8c289a1f3edf4e8e10ba3b9f983f0c73263a5005f1dad32698226dd917f58bac WatchSource:0}: Error finding container 8c289a1f3edf4e8e10ba3b9f983f0c73263a5005f1dad32698226dd917f58bac: Status 404 returned error can't find the container with id 8c289a1f3edf4e8e10ba3b9f983f0c73263a5005f1dad32698226dd917f58bac Jun 06 13:05:19.894135 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:19.894091 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9"] Jun 06 13:05:19.897021 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:19.896990 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436d359b_65ea_43e2_a39f_0f7ec3808d75.slice/crio-a5e67002654bc39c9607c5d6cf194b87727573412a60ed7ea68199eb1ac7da32 WatchSource:0}: Error finding container a5e67002654bc39c9607c5d6cf194b87727573412a60ed7ea68199eb1ac7da32: Status 404 returned error can't find the container with id a5e67002654bc39c9607c5d6cf194b87727573412a60ed7ea68199eb1ac7da32 Jun 06 13:05:20.084376 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:20.084329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" event={"ID":"436d359b-65ea-43e2-a39f-0f7ec3808d75","Type":"ContainerStarted","Data":"a5e67002654bc39c9607c5d6cf194b87727573412a60ed7ea68199eb1ac7da32"} Jun 06 13:05:20.085451 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:20.085404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdxv" event={"ID":"9de57963-c152-4830-8ccb-0acace388179","Type":"ContainerStarted","Data":"8c289a1f3edf4e8e10ba3b9f983f0c73263a5005f1dad32698226dd917f58bac"} Jun 06 13:05:20.087239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:20.087218 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" event={"ID":"9d1ac40a-0b2d-4069-bc3e-aaf0015381db","Type":"ContainerStarted","Data":"b90bbd5a278ccbf30c65aab08fb888393cd12e12d832c16f813ed7b1def33c6d"} Jun 06 13:05:20.087362 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:20.087263 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" event={"ID":"9d1ac40a-0b2d-4069-bc3e-aaf0015381db","Type":"ContainerStarted","Data":"b068162764896d3676a926845458d6a8fd21ca808a6bd91834d26c35160909f9"} Jun 06 13:05:20.087362 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:20.087282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" event={"ID":"9d1ac40a-0b2d-4069-bc3e-aaf0015381db","Type":"ContainerStarted","Data":"ecbc1bd3d51fb8bb52c5965ff32e188dc5e92cfda88a0cb1969eba256c2a0e22"} Jun 06 13:05:21.093785 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:21.093699 2560 generic.go:356] "Generic (PLEG): container finished" podID="9de57963-c152-4830-8ccb-0acace388179" containerID="362fe7bac4fdb0ffbcb90596e46f85b6dcfbdb931dcff1d6873ea78adff5619e" exitCode=0 Jun 06 13:05:21.094252 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:21.093783 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdxv" event={"ID":"9de57963-c152-4830-8ccb-0acace388179","Type":"ContainerDied","Data":"362fe7bac4fdb0ffbcb90596e46f85b6dcfbdb931dcff1d6873ea78adff5619e"} Jun 06 13:05:21.096248 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:21.096227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" event={"ID":"9d1ac40a-0b2d-4069-bc3e-aaf0015381db","Type":"ContainerStarted","Data":"eb138bdd7c40670b0caf12bbd63897b3259246901a537077ceb36cfc648948fa"} Jun 06 13:05:21.128859 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:21.128794 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-z66vv" podStartSLOduration=2.082927021 podStartE2EDuration="3.128775601s" totalImagesPullingTime="1.04584858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:21.12833838 +0000 UTC m=+226.195435752" watchObservedRunningTime="2026-06-06 13:05:21.128775601 +0000 UTC m=+226.195872948" Jun 06 13:05:22.102326 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.102287 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdxv" event={"ID":"9de57963-c152-4830-8ccb-0acace388179","Type":"ContainerStarted","Data":"82c1b75eb634d16ea19ab4f9a9100832027d57a317d348e0f59a6d48fee33d4e"} Jun 06 13:05:22.102774 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.102347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgdxv" event={"ID":"9de57963-c152-4830-8ccb-0acace388179","Type":"ContainerStarted","Data":"5b387fc0580d3551480855220194942cd9c1e40e1aec2235ff7707d46a49e08d"} Jun 06 13:05:22.104385 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.104354 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" event={"ID":"436d359b-65ea-43e2-a39f-0f7ec3808d75","Type":"ContainerStarted","Data":"b0f950ba0cd290a0b0378f6ea3b6ec695b62083064c32b30bebc729d0e659b9b"} Jun 06 13:05:22.104479 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.104410 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" event={"ID":"436d359b-65ea-43e2-a39f-0f7ec3808d75","Type":"ContainerStarted","Data":"a79c9ef7011eb8e5ffb253296afee92ded7ff89640c9cd7b98009f705a366b8b"} Jun 06 13:05:22.104479 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.104431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" event={"ID":"436d359b-65ea-43e2-a39f-0f7ec3808d75","Type":"ContainerStarted","Data":"bef4599c216450294b55434dc5b057c46e11dfeb058139da106967e88abdb739"} Jun 06 13:05:22.122345 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.122297 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sgdxv" podStartSLOduration=3.060994887 podStartE2EDuration="4.122283534s" totalImagesPullingTime="987.482213ms" totalInitContainerRuntime="73.806434ms" isStatefulPod=true podCreationTimestamp="2026-06-06 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:22.120382255 +0000 UTC m=+227.187479602" watchObservedRunningTime="2026-06-06 13:05:22.122283534 +0000 UTC m=+227.189380919" Jun 06 13:05:22.138362 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:22.138320 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-v4vs9" podStartSLOduration=2.721852617 podStartE2EDuration="4.138310115s" totalImagesPullingTime="1.416457498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:22.137587577 +0000 UTC m=+227.204684949" watchObservedRunningTime="2026-06-06 13:05:22.138310115 +0000 UTC m=+227.205407462" Jun 06 13:05:23.086276 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.086236 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-664c864c94-82ksd"] Jun 06 13:05:23.089671 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.089648 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.092121 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.092086 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 06 13:05:23.093341 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.093316 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 06 13:05:23.093341 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.093333 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 06 13:05:23.093503 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.093359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 13:05:23.093503 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.093384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z5v6t\"" Jun 06 13:05:23.093503 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.093407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-352phsme32sef\"" Jun 06 13:05:23.098210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.098191 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-664c864c94-82ksd"] Jun 06 13:05:23.193964 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.193937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-client-certs\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194424 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.193976 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-client-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194424 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.194152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-metrics-server-audit-profiles\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194424 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.194237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-audit-log\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194424 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.194280 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45pgt\" (UniqueName: \"kubernetes.io/projected/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-kube-api-access-45pgt\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194642 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.194420 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.194642 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.194475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-tls\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295556 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-audit-log\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295721 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295562 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45pgt\" (UniqueName: \"kubernetes.io/projected/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-kube-api-access-45pgt\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295721 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295721 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295661 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-tls\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295721 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-client-certs\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295923 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-client-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.295923 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.295771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-metrics-server-audit-profiles\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.296031 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.296010 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-audit-log\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.296445 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.296418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.296643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.296625 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-metrics-server-audit-profiles\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.298070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.298052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-tls\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.298604 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.298586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-secret-metrics-server-client-certs\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.298731 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.298711 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-client-ca-bundle\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.302554 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.302532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45pgt\" (UniqueName: \"kubernetes.io/projected/00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf-kube-api-access-45pgt\") pod \"metrics-server-664c864c94-82ksd\" (UID: \"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf\") " pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.399656 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.399592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:23.525719 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:23.525688 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-664c864c94-82ksd"] Jun 06 13:05:23.528866 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:23.528833 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c0ac0b_3c64_4ba9_ab2a_8a0f24833bdf.slice/crio-c304ed8b7ba5feb670362d124a348f52dd9102782f772bdbb31971017d38a039 WatchSource:0}: Error finding container c304ed8b7ba5feb670362d124a348f52dd9102782f772bdbb31971017d38a039: Status 404 returned error can't find the container with id c304ed8b7ba5feb670362d124a348f52dd9102782f772bdbb31971017d38a039 Jun 06 13:05:24.111705 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:24.111665 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" event={"ID":"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf","Type":"ContainerStarted","Data":"c304ed8b7ba5feb670362d124a348f52dd9102782f772bdbb31971017d38a039"} Jun 06 13:05:26.090787 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.090753 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:26.091246 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.090907 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:05:26.093001 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.092974 2560 patch_prober.go:28] interesting pod/console-5c9758fd9c-lvqbh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 06 13:05:26.093154 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.093017 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c9758fd9c-lvqbh" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 06 13:05:26.119317 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.119286 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" event={"ID":"00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf","Type":"ContainerStarted","Data":"3d2eb20b579d4891f00a8865e6049a638c8c6c1f164db4a49fc70396ad412dae"} Jun 06 13:05:26.134921 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:26.134881 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" podStartSLOduration=1.584729603 podStartE2EDuration="3.134868631s" totalImagesPullingTime="1.550139028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:26.133753808 +0000 UTC m=+231.200851159" watchObservedRunningTime="2026-06-06 13:05:26.134868631 +0000 UTC m=+231.201966046" Jun 06 13:05:28.710202 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:28.710166 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:05:29.018317 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:29.018287 2560 patch_prober.go:28] interesting pod/image-registry-699fc6766d-5mjx9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 13:05:29.018470 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:29.018343 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 13:05:34.034038 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.033967 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" containerID="cri-o://fc7b22dae9b4b0b26007a4f2f41606e0c6a0dc2a1ac5add1eaee73a8f7d48a4f" gracePeriod=30 Jun 06 13:05:34.149822 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.149790 2560 generic.go:356] "Generic (PLEG): container finished" podID="49b07720-799f-4c71-98b7-cda18222db2c" containerID="fc7b22dae9b4b0b26007a4f2f41606e0c6a0dc2a1ac5add1eaee73a8f7d48a4f" exitCode=0 Jun 06 13:05:34.149952 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.149857 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" event={"ID":"49b07720-799f-4c71-98b7-cda18222db2c","Type":"ContainerDied","Data":"fc7b22dae9b4b0b26007a4f2f41606e0c6a0dc2a1ac5add1eaee73a8f7d48a4f"} Jun 06 13:05:34.273310 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.273287 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:05:34.386371 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386291 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386371 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386328 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386371 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386360 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386619 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386378 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386619 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386395 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv7b8\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386619 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386431 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386619 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386449 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.386619 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.386604 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") pod \"49b07720-799f-4c71-98b7-cda18222db2c\" (UID: \"49b07720-799f-4c71-98b7-cda18222db2c\") " Jun 06 13:05:34.387299 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.387249 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:05:34.387431 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.387322 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:05:34.389027 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.388995 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:05:34.389137 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.389061 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:05:34.389413 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.389383 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8" (OuterVolumeSpecName: "kube-api-access-jv7b8") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "kube-api-access-jv7b8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:05:34.389413 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.389406 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:05:34.389533 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.389420 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:05:34.395000 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.394978 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49b07720-799f-4c71-98b7-cda18222db2c" (UID: "49b07720-799f-4c71-98b7-cda18222db2c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:05:34.488245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488194 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-trusted-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488244 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-installation-pull-secrets\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488254 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-registry-tls\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488262 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-bound-sa-token\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488494 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488271 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49b07720-799f-4c71-98b7-cda18222db2c-ca-trust-extracted\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488494 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488280 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49b07720-799f-4c71-98b7-cda18222db2c-image-registry-private-configuration\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488494 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488289 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49b07720-799f-4c71-98b7-cda18222db2c-registry-certificates\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:34.488494 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:34.488297 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv7b8\" (UniqueName: \"kubernetes.io/projected/49b07720-799f-4c71-98b7-cda18222db2c-kube-api-access-jv7b8\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:05:35.154942 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.154905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" event={"ID":"49b07720-799f-4c71-98b7-cda18222db2c","Type":"ContainerDied","Data":"193b3b7af848e4f0007e051129f47ab14e68564b6d733bb9a4102648aa6ae097"} Jun 06 13:05:35.154942 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.154934 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-699fc6766d-5mjx9" Jun 06 13:05:35.155498 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.154969 2560 scope.go:117] "RemoveContainer" containerID="fc7b22dae9b4b0b26007a4f2f41606e0c6a0dc2a1ac5add1eaee73a8f7d48a4f" Jun 06 13:05:35.174859 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.174833 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:05:35.178023 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.178005 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-699fc6766d-5mjx9"] Jun 06 13:05:35.372459 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:35.372431 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b07720-799f-4c71-98b7-cda18222db2c" path="/var/lib/kubelet/pods/49b07720-799f-4c71-98b7-cda18222db2c/volumes" Jun 06 13:05:43.400323 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:43.400288 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:43.400831 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:43.400342 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:05:47.190924 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:47.190884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:05:47.193342 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:47.193314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9383e3e-7bec-4060-bdce-025583c4600e-metrics-certs\") pod \"network-metrics-daemon-mqp5b\" (UID: \"c9383e3e-7bec-4060-bdce-025583c4600e\") " pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:05:47.472169 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:47.472072 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcwkx\"" Jun 06 13:05:47.480061 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:47.480045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mqp5b" Jun 06 13:05:47.605051 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:47.604906 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mqp5b"] Jun 06 13:05:47.607652 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:05:47.607625 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9383e3e_7bec_4060_bdce_025583c4600e.slice/crio-7e34601c45ce58bad2062499dd762ce8bced0e73d935f9659767f0ca1a2ece57 WatchSource:0}: Error finding container 7e34601c45ce58bad2062499dd762ce8bced0e73d935f9659767f0ca1a2ece57: Status 404 returned error can't find the container with id 7e34601c45ce58bad2062499dd762ce8bced0e73d935f9659767f0ca1a2ece57 Jun 06 13:05:48.199438 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:48.199353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqp5b" event={"ID":"c9383e3e-7bec-4060-bdce-025583c4600e","Type":"ContainerStarted","Data":"7e34601c45ce58bad2062499dd762ce8bced0e73d935f9659767f0ca1a2ece57"} Jun 06 13:05:49.204181 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:49.204151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqp5b" event={"ID":"c9383e3e-7bec-4060-bdce-025583c4600e","Type":"ContainerStarted","Data":"e717f50def04e8f7f05b7639b1dbb0d41359d285753a80a65c5ff2199199992d"} Jun 06 13:05:49.204562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:49.204211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mqp5b" event={"ID":"c9383e3e-7bec-4060-bdce-025583c4600e","Type":"ContainerStarted","Data":"7728a7ab330e0a65f82e3df31b90d989b1a29a8804b91467f78598d2a06d15cb"} Jun 06 13:05:49.219989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:49.219943 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mqp5b" podStartSLOduration=253.263622797 podStartE2EDuration="4m14.219929033s" totalImagesPullingTime="956.306236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:05:49.217914937 +0000 UTC m=+254.285012285" watchObservedRunningTime="2026-06-06 13:05:49.219929033 +0000 UTC m=+254.287026380" Jun 06 13:05:53.729536 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:53.729492 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c9758fd9c-lvqbh" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerName="console" containerID="cri-o://73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f" gracePeriod=15 Jun 06 13:05:55.238413 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:55.238385 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-state-metrics/0.log" Jun 06 13:05:55.437263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:55.437234 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-rbac-proxy-main/0.log" Jun 06 13:05:55.637675 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:55.637600 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-rbac-proxy-self/0.log" Jun 06 13:05:55.838507 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:55.838481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-664c864c94-82ksd_00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf/metrics-server/0.log" Jun 06 13:05:56.837098 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:56.837070 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/init-textfile/0.log" Jun 06 13:05:57.037950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:57.037925 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/node-exporter/0.log" Jun 06 13:05:57.237670 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:57.237636 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/kube-rbac-proxy/0.log" Jun 06 13:05:58.037613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:58.037587 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/kube-rbac-proxy-main/0.log" Jun 06 13:05:58.236820 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:58.236794 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/kube-rbac-proxy-self/0.log" Jun 06 13:05:58.437545 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:05:58.437470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/openshift-state-metrics/0.log" Jun 06 13:06:02.437607 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:02.437581 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c2gn7_63a99380-0a01-42b8-9b32-7c4c173abbf1/networking-console-plugin/0.log" Jun 06 13:06:02.638720 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:02.638693 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:06:02.839160 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:02.839135 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/2.log" Jun 06 13:06:03.037606 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:03.037573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9758fd9c-lvqbh_1f8f1091-13d6-493c-8f6b-80e7261f7a56/console/0.log" Jun 06 13:06:03.405480 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:03.405453 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:06:03.409849 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:03.409822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-664c864c94-82ksd" Jun 06 13:06:04.073080 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.073054 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:06:04.123866 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.123840 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124014 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.123879 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124014 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.123901 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124014 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.123960 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124014 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124002 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124216 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124150 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2fpg\" (UniqueName: \"kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124264 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124241 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config\") pod \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\" (UID: \"1f8f1091-13d6-493c-8f6b-80e7261f7a56\") " Jun 06 13:06:04.124355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124331 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:04.124420 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124366 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:04.124588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124563 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config" (OuterVolumeSpecName: "console-config") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:04.124588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124580 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-trusted-ca-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.124686 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124601 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-oauth-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.124686 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.124661 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:06:04.126583 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.126555 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:04.126583 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.126557 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg" (OuterVolumeSpecName: "kube-api-access-r2fpg") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "kube-api-access-r2fpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:06:04.126704 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.126590 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f8f1091-13d6-493c-8f6b-80e7261f7a56" (UID: "1f8f1091-13d6-493c-8f6b-80e7261f7a56"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:06:04.225324 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.225239 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.225324 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.225268 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-oauth-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.225324 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.225278 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-service-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.225324 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.225288 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2fpg\" (UniqueName: \"kubernetes.io/projected/1f8f1091-13d6-493c-8f6b-80e7261f7a56-kube-api-access-r2fpg\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.225324 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.225297 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f8f1091-13d6-493c-8f6b-80e7261f7a56-console-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:06:04.257243 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.257210 2560 generic.go:356] "Generic (PLEG): container finished" podID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerID="73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f" exitCode=0 Jun 06 13:06:04.257378 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.257260 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9758fd9c-lvqbh" Jun 06 13:06:04.257378 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.257301 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9758fd9c-lvqbh" event={"ID":"1f8f1091-13d6-493c-8f6b-80e7261f7a56","Type":"ContainerDied","Data":"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f"} Jun 06 13:06:04.257447 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.257378 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9758fd9c-lvqbh" event={"ID":"1f8f1091-13d6-493c-8f6b-80e7261f7a56","Type":"ContainerDied","Data":"97c36a488075c64df3025a4b1bbc2d4796ccfb4f089017368a37f06347c4bfb9"} Jun 06 13:06:04.257447 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.257398 2560 scope.go:117] "RemoveContainer" containerID="73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f" Jun 06 13:06:04.265594 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.265579 2560 scope.go:117] "RemoveContainer" containerID="73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f" Jun 06 13:06:04.265875 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:06:04.265852 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f\": container with ID starting with 73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f not found: ID does not exist" containerID="73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f" Jun 06 13:06:04.265955 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.265886 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f"} err="failed to get container status \"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f\": rpc error: code = NotFound desc = could not find container \"73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f\": container with ID starting with 73ff21261dfd550263151582a3ae61c0274314e9e85392738f3345cee9d1c55f not found: ID does not exist" Jun 06 13:06:04.285592 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.285566 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:06:04.288698 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:04.288679 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9758fd9c-lvqbh"] Jun 06 13:06:05.372161 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:05.372123 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" path="/var/lib/kubelet/pods/1f8f1091-13d6-493c-8f6b-80e7261f7a56/volumes" Jun 06 13:06:05.637241 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:05.637175 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrvwh_37551d62-2bb9-4b80-bcb0-a349529e9c41/dns-node-resolver/0.log" Jun 06 13:06:06.237418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:06.237393 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nchz_b9b4178c-f6e9-4b57-bd69-2ebc27923c2e/node-ca/0.log" Jun 06 13:06:06.838124 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:06.838090 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log" Jun 06 13:06:07.437809 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:07.437784 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gg4_be491cdc-5209-406a-a52d-4ef3da74d838/serve-healthcheck-canary/0.log" Jun 06 13:06:15.848670 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:06:15.848627 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wl8b6" podUID="3c629622-118c-4d37-b8de-9776c6bc2ce9" Jun 06 13:06:16.300545 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:16.300516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:19.845753 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:19.845701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:19.847923 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:19.847902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c629622-118c-4d37-b8de-9776c6bc2ce9-metrics-tls\") pod \"dns-default-wl8b6\" (UID: \"3c629622-118c-4d37-b8de-9776c6bc2ce9\") " pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:19.903827 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:19.903795 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tk9w2\"" Jun 06 13:06:19.911695 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:19.911670 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:20.041488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:20.041457 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wl8b6"] Jun 06 13:06:20.044588 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:06:20.044560 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c629622_118c_4d37_b8de_9776c6bc2ce9.slice/crio-546341ac7300cda6c1d646715a9902043cb6972fc5cd2eb2d36f3f589c958cfc WatchSource:0}: Error finding container 546341ac7300cda6c1d646715a9902043cb6972fc5cd2eb2d36f3f589c958cfc: Status 404 returned error can't find the container with id 546341ac7300cda6c1d646715a9902043cb6972fc5cd2eb2d36f3f589c958cfc Jun 06 13:06:20.315449 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:20.315417 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wl8b6" event={"ID":"3c629622-118c-4d37-b8de-9776c6bc2ce9","Type":"ContainerStarted","Data":"546341ac7300cda6c1d646715a9902043cb6972fc5cd2eb2d36f3f589c958cfc"} Jun 06 13:06:22.324635 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:22.324589 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wl8b6" event={"ID":"3c629622-118c-4d37-b8de-9776c6bc2ce9","Type":"ContainerStarted","Data":"ba557b11541c3a48cc50084a7f381109003ddda256da5d947e5dc67bf0de8390"} Jun 06 13:06:22.325132 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:22.324673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wl8b6" event={"ID":"3c629622-118c-4d37-b8de-9776c6bc2ce9","Type":"ContainerStarted","Data":"9a64cac09dbcd0c028c5843436206aaa82d428e9319fa7b7be3f87b9b6cac7cb"} Jun 06 13:06:22.325132 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:22.324723 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:22.341439 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:22.341401 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wl8b6" podStartSLOduration=251.707029491 podStartE2EDuration="4m13.341388989s" totalImagesPullingTime="1.634359498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:06:22.339256202 +0000 UTC m=+287.406353550" watchObservedRunningTime="2026-06-06 13:06:22.341388989 +0000 UTC m=+287.408486335" Jun 06 13:06:32.330394 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:32.330358 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wl8b6" Jun 06 13:06:34.939172 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.939133 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:06:34.942284 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942251 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerName="console" Jun 06 13:06:34.942418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942334 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerName="console" Jun 06 13:06:34.942492 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942420 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" Jun 06 13:06:34.942492 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942431 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" Jun 06 13:06:34.942632 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942616 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8f1091-13d6-493c-8f6b-80e7261f7a56" containerName="console" Jun 06 13:06:34.942698 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.942642 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b07720-799f-4c71-98b7-cda18222db2c" containerName="registry" Jun 06 13:06:34.948439 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.948416 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:34.952496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952470 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 06 13:06:34.952646 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 06 13:06:34.952829 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 06 13:06:34.952898 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952859 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 06 13:06:34.952944 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952930 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8jlbh\"" Jun 06 13:06:34.952991 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952708 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 06 13:06:34.953059 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.952797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 06 13:06:34.953206 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.953188 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 06 13:06:34.955565 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.955540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:06:34.957391 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:34.957339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 06 13:06:35.064954 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.064920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.064962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.064980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnf8j\" (UniqueName: \"kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.065026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.065060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.065096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.065313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.065139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166011 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.165978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166021 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166086 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166374 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166175 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166374 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnf8j\" (UniqueName: \"kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.166909 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166886 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.167043 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166944 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.167043 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.166997 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.167136 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.167079 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.168497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.168465 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.168598 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.168543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.174002 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.173978 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnf8j\" (UniqueName: \"kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j\") pod \"console-56f6bbdcb4-dv7nm\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.260753 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.260724 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:35.322500 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.322362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:06:35.324552 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.324524 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:06:35.337032 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.337009 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:06:35.338232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.338210 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:06:35.340257 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.340239 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 13:06:35.411668 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:35.397026 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:06:35.411668 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:06:35.399533 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04821b3_8319_4dfb_bf10_f13cb09eaf81.slice/crio-14ff0d66eac37fd74afea6331e0c956d30071bd844d2503b644943aff473bd6d WatchSource:0}: Error finding container 14ff0d66eac37fd74afea6331e0c956d30071bd844d2503b644943aff473bd6d: Status 404 returned error can't find the container with id 14ff0d66eac37fd74afea6331e0c956d30071bd844d2503b644943aff473bd6d Jun 06 13:06:36.381255 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:36.381216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6bbdcb4-dv7nm" event={"ID":"e04821b3-8319-4dfb-bf10-f13cb09eaf81","Type":"ContainerStarted","Data":"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d"} Jun 06 13:06:36.381676 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:36.381293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6bbdcb4-dv7nm" event={"ID":"e04821b3-8319-4dfb-bf10-f13cb09eaf81","Type":"ContainerStarted","Data":"14ff0d66eac37fd74afea6331e0c956d30071bd844d2503b644943aff473bd6d"} Jun 06 13:06:36.400603 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:36.400559 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f6bbdcb4-dv7nm" podStartSLOduration=2.40054406 podStartE2EDuration="2.40054406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:06:36.399881968 +0000 UTC m=+301.466979422" watchObservedRunningTime="2026-06-06 13:06:36.40054406 +0000 UTC m=+301.467641410" Jun 06 13:06:45.261492 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:45.261451 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:45.261920 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:45.261534 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:45.268670 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:45.268646 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:06:45.416318 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:06:45.416289 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:07:50.823610 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.823576 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4"] Jun 06 13:07:50.826830 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.826810 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:50.829475 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.829455 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:07:50.829475 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.829469 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:07:50.830547 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.830530 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:07:50.834658 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.834638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4"] Jun 06 13:07:50.932539 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.932508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:50.932682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.932551 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:50.932682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:50.932589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x89ts\" (UniqueName: \"kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.033335 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.033305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.033458 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.033346 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x89ts\" (UniqueName: \"kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.033458 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.033396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.033697 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.033675 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.033736 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.033723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.041070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.041038 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x89ts\" (UniqueName: \"kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.136429 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.136371 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:07:51.258542 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.258521 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4"] Jun 06 13:07:51.260867 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:07:51.260839 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47222649_5b00_4d4d_b6d8_a42be08c94c4.slice/crio-3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf WatchSource:0}: Error finding container 3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf: Status 404 returned error can't find the container with id 3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf Jun 06 13:07:51.262779 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.262763 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:07:51.653974 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:51.653936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" event={"ID":"47222649-5b00-4d4d-b6d8-a42be08c94c4","Type":"ContainerStarted","Data":"3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf"} Jun 06 13:07:58.683302 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:58.683201 2560 generic.go:356] "Generic (PLEG): container finished" podID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerID="9f8865509aabbd19921ec1151aff14436be13edae61d2bd573eef684c55f8548" exitCode=0 Jun 06 13:07:58.683302 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:58.683263 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" event={"ID":"47222649-5b00-4d4d-b6d8-a42be08c94c4","Type":"ContainerDied","Data":"9f8865509aabbd19921ec1151aff14436be13edae61d2bd573eef684c55f8548"} Jun 06 13:07:59.688203 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:59.688160 2560 generic.go:356] "Generic (PLEG): container finished" podID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerID="1a5fdb6c98c14524fba5efdb438b4f548f3fab9af7bd25ed281f229dab8d6f6a" exitCode=0 Jun 06 13:07:59.688522 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:07:59.688216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" event={"ID":"47222649-5b00-4d4d-b6d8-a42be08c94c4","Type":"ContainerDied","Data":"1a5fdb6c98c14524fba5efdb438b4f548f3fab9af7bd25ed281f229dab8d6f6a"} Jun 06 13:08:07.724287 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:07.724205 2560 generic.go:356] "Generic (PLEG): container finished" podID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerID="cc9e7aba66f848b78860b00fe765af9c58de73d638b74a2e830995a0eadd227f" exitCode=0 Jun 06 13:08:07.724287 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:07.724262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" event={"ID":"47222649-5b00-4d4d-b6d8-a42be08c94c4","Type":"ContainerDied","Data":"cc9e7aba66f848b78860b00fe765af9c58de73d638b74a2e830995a0eadd227f"} Jun 06 13:08:08.854416 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.854392 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:08:08.982526 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.982449 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util\") pod \"47222649-5b00-4d4d-b6d8-a42be08c94c4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " Jun 06 13:08:08.982526 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.982494 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle\") pod \"47222649-5b00-4d4d-b6d8-a42be08c94c4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " Jun 06 13:08:08.982758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.982576 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x89ts\" (UniqueName: \"kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts\") pod \"47222649-5b00-4d4d-b6d8-a42be08c94c4\" (UID: \"47222649-5b00-4d4d-b6d8-a42be08c94c4\") " Jun 06 13:08:08.983225 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.983196 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle" (OuterVolumeSpecName: "bundle") pod "47222649-5b00-4d4d-b6d8-a42be08c94c4" (UID: "47222649-5b00-4d4d-b6d8-a42be08c94c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:08.984834 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.984796 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts" (OuterVolumeSpecName: "kube-api-access-x89ts") pod "47222649-5b00-4d4d-b6d8-a42be08c94c4" (UID: "47222649-5b00-4d4d-b6d8-a42be08c94c4"). InnerVolumeSpecName "kube-api-access-x89ts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:08:08.987458 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:08.987434 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util" (OuterVolumeSpecName: "util") pod "47222649-5b00-4d4d-b6d8-a42be08c94c4" (UID: "47222649-5b00-4d4d-b6d8-a42be08c94c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:09.083395 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.083352 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:09.083395 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.083390 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47222649-5b00-4d4d-b6d8-a42be08c94c4-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:09.083555 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.083405 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x89ts\" (UniqueName: \"kubernetes.io/projected/47222649-5b00-4d4d-b6d8-a42be08c94c4-kube-api-access-x89ts\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:09.733417 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.733383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" event={"ID":"47222649-5b00-4d4d-b6d8-a42be08c94c4","Type":"ContainerDied","Data":"3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf"} Jun 06 13:08:09.733568 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.733419 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dz94d4" Jun 06 13:08:09.733568 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:09.733432 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3080b46f8d0fd6cd8439b03dd4e343f3d8c3064822c5ce12192601f617924daf" Jun 06 13:08:13.500092 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500060 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w"] Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500354 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="util" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500365 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="util" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500379 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="extract" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500384 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="extract" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500395 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="pull" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500400 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="pull" Jun 06 13:08:13.500464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.500441 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="47222649-5b00-4d4d-b6d8-a42be08c94c4" containerName="extract" Jun 06 13:08:13.526775 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.526736 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w"] Jun 06 13:08:13.526908 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.526855 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.530285 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.530260 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qbrck\"" Jun 06 13:08:13.530418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.530296 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 06 13:08:13.530418 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.530266 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 06 13:08:13.617998 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.617965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5hbt\" (UniqueName: \"kubernetes.io/projected/c90ea3b7-1047-42e6-b3a8-73c86140d07d-kube-api-access-c5hbt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.618175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.618010 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c90ea3b7-1047-42e6-b3a8-73c86140d07d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.719330 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.719264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5hbt\" (UniqueName: \"kubernetes.io/projected/c90ea3b7-1047-42e6-b3a8-73c86140d07d-kube-api-access-c5hbt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.719330 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.719306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c90ea3b7-1047-42e6-b3a8-73c86140d07d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.719622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.719606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c90ea3b7-1047-42e6-b3a8-73c86140d07d-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.729750 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.729724 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5hbt\" (UniqueName: \"kubernetes.io/projected/c90ea3b7-1047-42e6-b3a8-73c86140d07d-kube-api-access-c5hbt\") pod \"cert-manager-operator-controller-manager-57757f7cfc-xj58w\" (UID: \"c90ea3b7-1047-42e6-b3a8-73c86140d07d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.836303 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.836277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" Jun 06 13:08:13.984388 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:13.984350 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w"] Jun 06 13:08:13.987131 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:08:13.987085 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90ea3b7_1047_42e6_b3a8_73c86140d07d.slice/crio-44c5a1c741070a17b30463578842fbba22eff222baebe4595c9e6183b93e1043 WatchSource:0}: Error finding container 44c5a1c741070a17b30463578842fbba22eff222baebe4595c9e6183b93e1043: Status 404 returned error can't find the container with id 44c5a1c741070a17b30463578842fbba22eff222baebe4595c9e6183b93e1043 Jun 06 13:08:14.753472 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:14.753439 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" event={"ID":"c90ea3b7-1047-42e6-b3a8-73c86140d07d","Type":"ContainerStarted","Data":"44c5a1c741070a17b30463578842fbba22eff222baebe4595c9e6183b93e1043"} Jun 06 13:08:17.768621 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:17.768583 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" event={"ID":"c90ea3b7-1047-42e6-b3a8-73c86140d07d","Type":"ContainerStarted","Data":"ad7ac426880b0bef5ac53f22b45b0d1fe93b239a170ceae3e441611b32bfb512"} Jun 06 13:08:17.789187 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:17.789140 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-xj58w" podStartSLOduration=1.580049705 podStartE2EDuration="4.789122419s" totalImagesPullingTime="3.209072714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:08:17.788860756 +0000 UTC m=+402.855958110" watchObservedRunningTime="2026-06-06 13:08:17.789122419 +0000 UTC m=+402.856219757" Jun 06 13:08:18.266745 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.266708 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr"] Jun 06 13:08:18.284514 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.284487 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr"] Jun 06 13:08:18.284682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.284608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.287156 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.287131 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:08:18.287362 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.287233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:08:18.288295 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.288277 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:08:18.359531 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.359506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.359651 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.359536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qb66\" (UniqueName: \"kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.359651 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.359558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.459896 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.459865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.460031 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.459902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qb66\" (UniqueName: \"kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.460031 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.459930 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.460329 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.460310 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.460373 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.460351 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.487402 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.487373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qb66\" (UniqueName: \"kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.595352 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.595273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:18.745096 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.745075 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr"] Jun 06 13:08:18.747302 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:08:18.747275 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37abe845_b37b_4e44_ae55_d799bf83a5ff.slice/crio-4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513 WatchSource:0}: Error finding container 4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513: Status 404 returned error can't find the container with id 4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513 Jun 06 13:08:18.773244 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:18.773220 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" event={"ID":"37abe845-b37b-4e44-ae55-d799bf83a5ff","Type":"ContainerStarted","Data":"4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513"} Jun 06 13:08:19.778914 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.778813 2560 generic.go:356] "Generic (PLEG): container finished" podID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerID="f0585b3aa5826cadbc79d1ba1120a41ce710cd3e0dad455dc3b82119f0663f88" exitCode=0 Jun 06 13:08:19.778914 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.778866 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" event={"ID":"37abe845-b37b-4e44-ae55-d799bf83a5ff","Type":"ContainerDied","Data":"f0585b3aa5826cadbc79d1ba1120a41ce710cd3e0dad455dc3b82119f0663f88"} Jun 06 13:08:19.837158 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.837125 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw"] Jun 06 13:08:19.839346 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.839329 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.841854 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.841832 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 13:08:19.841965 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.841891 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 13:08:19.841965 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.841915 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kp4fn\"" Jun 06 13:08:19.849773 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.849750 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw"] Jun 06 13:08:19.872249 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.872224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5xh\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-kube-api-access-ls5xh\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.872339 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.872257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.972791 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.972760 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5xh\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-kube-api-access-ls5xh\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.972950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.972795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.980392 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.980362 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:19.980602 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:19.980581 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5xh\" (UniqueName: \"kubernetes.io/projected/66a66b44-aa55-4611-b8ca-792fb248adcc-kube-api-access-ls5xh\") pod \"cert-manager-webhook-7dc76cbb94-5qlcw\" (UID: \"66a66b44-aa55-4611-b8ca-792fb248adcc\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:20.148742 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:20.148664 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:20.276786 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:20.276764 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw"] Jun 06 13:08:20.279110 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:08:20.279067 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66a66b44_aa55_4611_b8ca_792fb248adcc.slice/crio-f7a7759c0115d776b7636466daaed04aec648c11b9fa793bdf63f206f09de271 WatchSource:0}: Error finding container f7a7759c0115d776b7636466daaed04aec648c11b9fa793bdf63f206f09de271: Status 404 returned error can't find the container with id f7a7759c0115d776b7636466daaed04aec648c11b9fa793bdf63f206f09de271 Jun 06 13:08:20.785196 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:20.785154 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" event={"ID":"66a66b44-aa55-4611-b8ca-792fb248adcc","Type":"ContainerStarted","Data":"f7a7759c0115d776b7636466daaed04aec648c11b9fa793bdf63f206f09de271"} Jun 06 13:08:21.791615 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:21.791583 2560 generic.go:356] "Generic (PLEG): container finished" podID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerID="4e87bca6b7310b09ca8a8cfcc018852e0f6a294e517d464b69c63b987d993c29" exitCode=0 Jun 06 13:08:21.791978 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:21.791625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" event={"ID":"37abe845-b37b-4e44-ae55-d799bf83a5ff","Type":"ContainerDied","Data":"4e87bca6b7310b09ca8a8cfcc018852e0f6a294e517d464b69c63b987d993c29"} Jun 06 13:08:22.195905 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.195830 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6prs"] Jun 06 13:08:22.197799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.197783 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.200163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.200147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bkt2m\"" Jun 06 13:08:22.207744 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.207719 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6prs"] Jun 06 13:08:22.291937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.291900 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.292070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.291950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zdx\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-kube-api-access-d2zdx\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.392797 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.392762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zdx\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-kube-api-access-d2zdx\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.392947 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.392868 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.400117 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.400076 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.400221 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.400183 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zdx\" (UniqueName: \"kubernetes.io/projected/b59d6af4-93d1-422c-a8dd-6947d036344a-kube-api-access-d2zdx\") pod \"cert-manager-cainjector-5d99449ffd-l6prs\" (UID: \"b59d6af4-93d1-422c-a8dd-6947d036344a\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.506277 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.506245 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" Jun 06 13:08:22.626880 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.626555 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-l6prs"] Jun 06 13:08:22.629192 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:08:22.629154 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb59d6af4_93d1_422c_a8dd_6947d036344a.slice/crio-1fc763f9e93f904b2c66922e5a45303e358676f7ff08daf46d795b9d9c1d27ea WatchSource:0}: Error finding container 1fc763f9e93f904b2c66922e5a45303e358676f7ff08daf46d795b9d9c1d27ea: Status 404 returned error can't find the container with id 1fc763f9e93f904b2c66922e5a45303e358676f7ff08daf46d795b9d9c1d27ea Jun 06 13:08:22.800062 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.799931 2560 generic.go:356] "Generic (PLEG): container finished" podID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerID="f20e30d462598d47487dca49a9d44ea334712ebfb4ea18873635321fe8c98bb6" exitCode=0 Jun 06 13:08:22.800062 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.800039 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" event={"ID":"37abe845-b37b-4e44-ae55-d799bf83a5ff","Type":"ContainerDied","Data":"f20e30d462598d47487dca49a9d44ea334712ebfb4ea18873635321fe8c98bb6"} Jun 06 13:08:22.801517 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:22.801447 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" event={"ID":"b59d6af4-93d1-422c-a8dd-6947d036344a","Type":"ContainerStarted","Data":"1fc763f9e93f904b2c66922e5a45303e358676f7ff08daf46d795b9d9c1d27ea"} Jun 06 13:08:24.077278 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.077237 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:24.106344 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.106318 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qb66\" (UniqueName: \"kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66\") pod \"37abe845-b37b-4e44-ae55-d799bf83a5ff\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " Jun 06 13:08:24.106446 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.106381 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util\") pod \"37abe845-b37b-4e44-ae55-d799bf83a5ff\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " Jun 06 13:08:24.106519 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.106463 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle\") pod \"37abe845-b37b-4e44-ae55-d799bf83a5ff\" (UID: \"37abe845-b37b-4e44-ae55-d799bf83a5ff\") " Jun 06 13:08:24.106942 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.106914 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle" (OuterVolumeSpecName: "bundle") pod "37abe845-b37b-4e44-ae55-d799bf83a5ff" (UID: "37abe845-b37b-4e44-ae55-d799bf83a5ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:24.109153 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.109092 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66" (OuterVolumeSpecName: "kube-api-access-8qb66") pod "37abe845-b37b-4e44-ae55-d799bf83a5ff" (UID: "37abe845-b37b-4e44-ae55-d799bf83a5ff"). InnerVolumeSpecName "kube-api-access-8qb66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:08:24.113776 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.113749 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util" (OuterVolumeSpecName: "util") pod "37abe845-b37b-4e44-ae55-d799bf83a5ff" (UID: "37abe845-b37b-4e44-ae55-d799bf83a5ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:24.207280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.207255 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:24.207280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.207280 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qb66\" (UniqueName: \"kubernetes.io/projected/37abe845-b37b-4e44-ae55-d799bf83a5ff-kube-api-access-8qb66\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:24.207280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.207295 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37abe845-b37b-4e44-ae55-d799bf83a5ff-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:24.811422 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.811329 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" event={"ID":"66a66b44-aa55-4611-b8ca-792fb248adcc","Type":"ContainerStarted","Data":"3c55bf2f24e65fb8b961bf1fbeaea462a224b5eccae61fceb7138196ea8a78cf"} Jun 06 13:08:24.811422 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.811397 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:24.813221 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.813191 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" event={"ID":"37abe845-b37b-4e44-ae55-d799bf83a5ff","Type":"ContainerDied","Data":"4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513"} Jun 06 13:08:24.813221 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.813217 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdcnkr" Jun 06 13:08:24.813391 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.813241 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aad440b309bc310e2976d4ddfdae01e6a6067b66a0ce8a720701a3ce486f513" Jun 06 13:08:24.814741 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.814711 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" event={"ID":"b59d6af4-93d1-422c-a8dd-6947d036344a","Type":"ContainerStarted","Data":"2dc40f4f60ce83417d03659c94178fa91f1b8511049f1b3c3619e9aaa454a4cd"} Jun 06 13:08:24.827562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.827523 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" podStartSLOduration=2.014559544 podStartE2EDuration="5.827510514s" totalImagesPullingTime="3.81295097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:08:24.825536548 +0000 UTC m=+409.892633894" watchObservedRunningTime="2026-06-06 13:08:24.827510514 +0000 UTC m=+409.894607860" Jun 06 13:08:24.844162 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:24.844114 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-l6prs" podStartSLOduration=0.97916501 podStartE2EDuration="2.844085461s" totalImagesPullingTime="1.864920451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:08:24.84340118 +0000 UTC m=+409.910498528" watchObservedRunningTime="2026-06-06 13:08:24.844085461 +0000 UTC m=+409.911182808" Jun 06 13:08:30.820652 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:30.820620 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qlcw" Jun 06 13:08:50.229824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.229746 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj"] Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230067 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="util" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230081 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="util" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230118 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="extract" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230127 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="extract" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230142 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="pull" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230147 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="pull" Jun 06 13:08:50.230268 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.230192 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="37abe845-b37b-4e44-ae55-d799bf83a5ff" containerName="extract" Jun 06 13:08:50.235950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.235920 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.238651 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.238626 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:08:50.239470 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.239449 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:08:50.239681 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.239646 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:08:50.240656 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.240631 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj"] Jun 06 13:08:50.307437 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.307401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5g7\" (UniqueName: \"kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.307633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.307481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.307633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.307508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.408460 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.408424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5g7\" (UniqueName: \"kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.408624 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.408497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.408624 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.408522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.408891 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.408867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.408957 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.408907 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.415640 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.415612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5g7\" (UniqueName: \"kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.546912 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.546830 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:50.670158 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.670130 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj"] Jun 06 13:08:50.672069 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:08:50.672040 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4601d27e_0292_41e2_b7ba_b64eaa7929d3.slice/crio-3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a WatchSource:0}: Error finding container 3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a: Status 404 returned error can't find the container with id 3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a Jun 06 13:08:50.930686 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.930606 2560 generic.go:356] "Generic (PLEG): container finished" podID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerID="9290f52df7aa20f67ec6a6d4c0e148a4fb7f9895b0a11a2299fc9ee323241810" exitCode=0 Jun 06 13:08:50.930824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.930693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" event={"ID":"4601d27e-0292-41e2-b7ba-b64eaa7929d3","Type":"ContainerDied","Data":"9290f52df7aa20f67ec6a6d4c0e148a4fb7f9895b0a11a2299fc9ee323241810"} Jun 06 13:08:50.930824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:50.930743 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" event={"ID":"4601d27e-0292-41e2-b7ba-b64eaa7929d3","Type":"ContainerStarted","Data":"3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a"} Jun 06 13:08:51.937519 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:51.937490 2560 generic.go:356] "Generic (PLEG): container finished" podID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerID="ec2f31a9ea41970bdc0b20545b21dbd69e3b1bd1e66bf51dcfd32be935ca687b" exitCode=0 Jun 06 13:08:51.937856 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:51.937580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" event={"ID":"4601d27e-0292-41e2-b7ba-b64eaa7929d3","Type":"ContainerDied","Data":"ec2f31a9ea41970bdc0b20545b21dbd69e3b1bd1e66bf51dcfd32be935ca687b"} Jun 06 13:08:52.946221 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:52.946185 2560 generic.go:356] "Generic (PLEG): container finished" podID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerID="7cc2ad1251f3f239a93290df7abc363889c02c05748cf67cc23e2fd3913df087" exitCode=0 Jun 06 13:08:52.946576 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:52.946243 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" event={"ID":"4601d27e-0292-41e2-b7ba-b64eaa7929d3","Type":"ContainerDied","Data":"7cc2ad1251f3f239a93290df7abc363889c02c05748cf67cc23e2fd3913df087"} Jun 06 13:08:54.074563 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.074536 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:54.144635 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.144607 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle\") pod \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " Jun 06 13:08:54.144777 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.144660 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls5g7\" (UniqueName: \"kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7\") pod \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " Jun 06 13:08:54.144777 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.144740 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util\") pod \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\" (UID: \"4601d27e-0292-41e2-b7ba-b64eaa7929d3\") " Jun 06 13:08:54.145391 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.145353 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle" (OuterVolumeSpecName: "bundle") pod "4601d27e-0292-41e2-b7ba-b64eaa7929d3" (UID: "4601d27e-0292-41e2-b7ba-b64eaa7929d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:54.146776 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.146747 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7" (OuterVolumeSpecName: "kube-api-access-ls5g7") pod "4601d27e-0292-41e2-b7ba-b64eaa7929d3" (UID: "4601d27e-0292-41e2-b7ba-b64eaa7929d3"). InnerVolumeSpecName "kube-api-access-ls5g7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:08:54.150963 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.150937 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util" (OuterVolumeSpecName: "util") pod "4601d27e-0292-41e2-b7ba-b64eaa7929d3" (UID: "4601d27e-0292-41e2-b7ba-b64eaa7929d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:08:54.245992 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.245964 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:54.245992 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.245989 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4601d27e-0292-41e2-b7ba-b64eaa7929d3-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:54.246203 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.245997 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls5g7\" (UniqueName: \"kubernetes.io/projected/4601d27e-0292-41e2-b7ba-b64eaa7929d3-kube-api-access-ls5g7\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:08:54.956232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.956194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" event={"ID":"4601d27e-0292-41e2-b7ba-b64eaa7929d3","Type":"ContainerDied","Data":"3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a"} Jun 06 13:08:54.956232 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.956216 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdpmjpj" Jun 06 13:08:54.956430 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:08:54.956248 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ed1b5def114dbe7fd0328f15b7694b69ba61120a06eb2b282fd23de176b7b8a" Jun 06 13:09:01.039390 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039357 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8"] Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039639 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="extract" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039650 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="extract" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039665 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="util" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039670 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="util" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039681 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="pull" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039687 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="pull" Jun 06 13:09:01.039762 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.039731 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4601d27e-0292-41e2-b7ba-b64eaa7929d3" containerName="extract" Jun 06 13:09:01.044735 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.044711 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.048423 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.048400 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 13:09:01.048709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.048480 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 13:09:01.048872 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.048574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qx5bl\"" Jun 06 13:09:01.048944 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.048667 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 13:09:01.049046 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.048778 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 13:09:01.057528 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.057491 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8"] Jun 06 13:09:01.202466 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.202436 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.202625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.202483 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.202625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.202506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.202625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.202552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvtr\" (UniqueName: \"kubernetes.io/projected/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-kube-api-access-8jvtr\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.202625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.202587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303416 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvtr\" (UniqueName: \"kubernetes.io/projected/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-kube-api-access-8jvtr\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.303979 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.303952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-manifests\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.305927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.305895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-tmp\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.306030 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.305955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.306097 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.306053 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.318496 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.318475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvtr\" (UniqueName: \"kubernetes.io/projected/bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa-kube-api-access-8jvtr\") pod \"opendatahub-operator-controller-manager-58dc9788b4-kqxp8\" (UID: \"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa\") " pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.358508 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.358482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:01.493612 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.493540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8"] Jun 06 13:09:01.496212 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:01.496175 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda2c87e_5e92_43a8_a1c6_5127b6eeb7aa.slice/crio-01837f492812c9020a27710ed7a0ef2f81b220234171305c2342280cb22b8a74 WatchSource:0}: Error finding container 01837f492812c9020a27710ed7a0ef2f81b220234171305c2342280cb22b8a74: Status 404 returned error can't find the container with id 01837f492812c9020a27710ed7a0ef2f81b220234171305c2342280cb22b8a74 Jun 06 13:09:01.987647 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:01.987607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" event={"ID":"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa","Type":"ContainerStarted","Data":"01837f492812c9020a27710ed7a0ef2f81b220234171305c2342280cb22b8a74"} Jun 06 13:09:05.004467 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:05.004418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" event={"ID":"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa","Type":"ContainerStarted","Data":"0781b2110e387992fa330b83b243d915599d1ed9dd95581eb95964b3c7303bed"} Jun 06 13:09:06.011633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:06.011597 2560 generic.go:356] "Generic (PLEG): container finished" podID="bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa" containerID="0781b2110e387992fa330b83b243d915599d1ed9dd95581eb95964b3c7303bed" exitCode=0 Jun 06 13:09:06.012018 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:06.011678 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" event={"ID":"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa","Type":"ContainerDied","Data":"0781b2110e387992fa330b83b243d915599d1ed9dd95581eb95964b3c7303bed"} Jun 06 13:09:07.018448 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:07.018409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" event={"ID":"bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa","Type":"ContainerStarted","Data":"03e383ac3ef6b3fa07b006b238a8654606310ab527548302f2868d37bbfac505"} Jun 06 13:09:07.018916 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:07.018465 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:07.040070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:07.040024 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" podStartSLOduration=1.641866243 podStartE2EDuration="6.040010301s" totalImagesPullingTime="3.338427177s" totalInitContainerRuntime="1.059716881s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:07.037245027 +0000 UTC m=+452.104342374" watchObservedRunningTime="2026-06-06 13:09:07.040010301 +0000 UTC m=+452.107107648" Jun 06 13:09:18.024416 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:18.024378 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58dc9788b4-kqxp8" Jun 06 13:09:20.436134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.436088 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4"] Jun 06 13:09:20.438450 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.438428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.440789 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.440768 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4rhtc\"" Jun 06 13:09:20.440951 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.440929 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 13:09:20.441035 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.440996 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 13:09:20.450192 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.450169 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4"] Jun 06 13:09:20.563585 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.563552 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tls-certs\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.563759 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.563671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrbl\" (UniqueName: \"kubernetes.io/projected/6696dbdd-8e3a-4733-9d0f-20533f9057a0-kube-api-access-xfrbl\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.563759 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.563728 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tmp\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.572956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.572932 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v57ts"] Jun 06 13:09:20.575048 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.575029 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.577313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.577295 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bmm8f\"" Jun 06 13:09:20.577387 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.577331 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 06 13:09:20.590172 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.590154 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v57ts"] Jun 06 13:09:20.664468 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.664436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrbl\" (UniqueName: \"kubernetes.io/projected/6696dbdd-8e3a-4733-9d0f-20533f9057a0-kube-api-access-xfrbl\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.664628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.664484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tmp\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.664628 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.664539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tls-certs\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.666815 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.666790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tmp\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.666937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.666919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6696dbdd-8e3a-4733-9d0f-20533f9057a0-tls-certs\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.673903 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.673878 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrbl\" (UniqueName: \"kubernetes.io/projected/6696dbdd-8e3a-4733-9d0f-20533f9057a0-kube-api-access-xfrbl\") pod \"kube-auth-proxy-567c54f5f4-nrwl4\" (UID: \"6696dbdd-8e3a-4733-9d0f-20533f9057a0\") " pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.747610 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.747573 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" Jun 06 13:09:20.765956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.765925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn55w\" (UniqueName: \"kubernetes.io/projected/10bf269d-b47a-4a74-bdec-f37e88c04dd2-kube-api-access-fn55w\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.766053 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.766012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10bf269d-b47a-4a74-bdec-f37e88c04dd2-cert\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.867389 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.867359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn55w\" (UniqueName: \"kubernetes.io/projected/10bf269d-b47a-4a74-bdec-f37e88c04dd2-kube-api-access-fn55w\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.867554 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.867470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10bf269d-b47a-4a74-bdec-f37e88c04dd2-cert\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.869818 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.869791 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10bf269d-b47a-4a74-bdec-f37e88c04dd2-cert\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.884632 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.884606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn55w\" (UniqueName: \"kubernetes.io/projected/10bf269d-b47a-4a74-bdec-f37e88c04dd2-kube-api-access-fn55w\") pod \"odh-model-controller-6dc94f689f-v57ts\" (UID: \"10bf269d-b47a-4a74-bdec-f37e88c04dd2\") " pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.884718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.884707 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:20.892062 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:20.892010 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4"] Jun 06 13:09:20.895662 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:20.895639 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6696dbdd_8e3a_4733_9d0f_20533f9057a0.slice/crio-12120bd637a115efcfe51943f022ce7074e5d35e58940b4f0c1f9bf1e5be8ce1 WatchSource:0}: Error finding container 12120bd637a115efcfe51943f022ce7074e5d35e58940b4f0c1f9bf1e5be8ce1: Status 404 returned error can't find the container with id 12120bd637a115efcfe51943f022ce7074e5d35e58940b4f0c1f9bf1e5be8ce1 Jun 06 13:09:21.023263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.023229 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-q85bd"] Jun 06 13:09:21.025754 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:21.025715 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bf269d_b47a_4a74_bdec_f37e88c04dd2.slice/crio-99bf24c2265b577450916275b3fd43ff82d0dd84f6f22c2d91b8c93916962bf2 WatchSource:0}: Error finding container 99bf24c2265b577450916275b3fd43ff82d0dd84f6f22c2d91b8c93916962bf2: Status 404 returned error can't find the container with id 99bf24c2265b577450916275b3fd43ff82d0dd84f6f22c2d91b8c93916962bf2 Jun 06 13:09:21.026639 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.026613 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-v57ts"] Jun 06 13:09:21.026737 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.026717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.029070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.028996 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 06 13:09:21.033304 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.033284 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-q85bd"] Jun 06 13:09:21.081839 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.079899 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" event={"ID":"10bf269d-b47a-4a74-bdec-f37e88c04dd2","Type":"ContainerStarted","Data":"99bf24c2265b577450916275b3fd43ff82d0dd84f6f22c2d91b8c93916962bf2"} Jun 06 13:09:21.082363 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.082338 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" event={"ID":"6696dbdd-8e3a-4733-9d0f-20533f9057a0","Type":"ContainerStarted","Data":"12120bd637a115efcfe51943f022ce7074e5d35e58940b4f0c1f9bf1e5be8ce1"} Jun 06 13:09:21.170797 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.170763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-tls-certs\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.170957 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.170836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjbc\" (UniqueName: \"kubernetes.io/projected/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-kube-api-access-5hjbc\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.271864 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.271833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjbc\" (UniqueName: \"kubernetes.io/projected/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-kube-api-access-5hjbc\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.272028 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.271879 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-tls-certs\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.274271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.274217 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-tls-certs\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.279168 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.279142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjbc\" (UniqueName: \"kubernetes.io/projected/77d4a9ab-6b9d-4eb8-beec-f2e9643e0425-kube-api-access-5hjbc\") pod \"model-serving-api-5dd488fc48-q85bd\" (UID: \"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425\") " pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.339165 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.339137 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:21.475613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:21.475449 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-q85bd"] Jun 06 13:09:21.478015 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:21.477986 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d4a9ab_6b9d_4eb8_beec_f2e9643e0425.slice/crio-4dc2d0988778e9ee1c3804d59d9d31019ec88f68da796e0f248d6249714fd4d9 WatchSource:0}: Error finding container 4dc2d0988778e9ee1c3804d59d9d31019ec88f68da796e0f248d6249714fd4d9: Status 404 returned error can't find the container with id 4dc2d0988778e9ee1c3804d59d9d31019ec88f68da796e0f248d6249714fd4d9 Jun 06 13:09:22.095573 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.095536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" event={"ID":"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425","Type":"ContainerStarted","Data":"4dc2d0988778e9ee1c3804d59d9d31019ec88f68da796e0f248d6249714fd4d9"} Jun 06 13:09:22.202134 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.199965 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf"] Jun 06 13:09:22.203865 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.203845 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.206822 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.206787 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:09:22.207062 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.207029 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:09:22.208983 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.207515 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:09:22.213773 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.213709 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf"] Jun 06 13:09:22.383728 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.383634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.383728 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.383697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrhm\" (UniqueName: \"kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.383955 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.383731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.484522 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.484480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrhm\" (UniqueName: \"kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.484990 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.484539 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.484990 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.484660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.485613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.485522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.485613 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.485569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.496709 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.496679 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrhm\" (UniqueName: \"kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.523495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.523463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:22.734956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:22.734878 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf"] Jun 06 13:09:24.219779 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:24.219746 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70590c8_851c_492a_b9a2_bd4c92517f9c.slice/crio-440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c WatchSource:0}: Error finding container 440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c: Status 404 returned error can't find the container with id 440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c Jun 06 13:09:25.114927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:25.114884 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" event={"ID":"c70590c8-851c-492a-b9a2-bd4c92517f9c","Type":"ContainerStarted","Data":"440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c"} Jun 06 13:09:26.122181 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.122005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" event={"ID":"6696dbdd-8e3a-4733-9d0f-20533f9057a0","Type":"ContainerStarted","Data":"c8703207e570ab699f1d8876e12ff71b8c7456395c5adfa42ff13f6a3a4922ec"} Jun 06 13:09:26.123871 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.123843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" event={"ID":"10bf269d-b47a-4a74-bdec-f37e88c04dd2","Type":"ContainerStarted","Data":"b635bd8d857a6611b2be8c758b804b9dee9b4bbf4ddf08fe7f68dfba4c722f60"} Jun 06 13:09:26.124010 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.123902 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:26.125490 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.125459 2560 generic.go:356] "Generic (PLEG): container finished" podID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerID="a43c3ba8854298b1a0ac301c1e40557a4ec8f43eaa26dfef1b30aa15c9432da0" exitCode=0 Jun 06 13:09:26.125592 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.125523 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" event={"ID":"c70590c8-851c-492a-b9a2-bd4c92517f9c","Type":"ContainerDied","Data":"a43c3ba8854298b1a0ac301c1e40557a4ec8f43eaa26dfef1b30aa15c9432da0"} Jun 06 13:09:26.127368 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.127346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" event={"ID":"77d4a9ab-6b9d-4eb8-beec-f2e9643e0425","Type":"ContainerStarted","Data":"a43fd608365950f66e125f14ef1243c1772f32a7409e3d13bca13471169d3de5"} Jun 06 13:09:26.127535 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.127520 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:26.137479 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.137387 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-567c54f5f4-nrwl4" podStartSLOduration=1.24805135 podStartE2EDuration="6.137339536s" totalImagesPullingTime="4.889288186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:26.136734357 +0000 UTC m=+471.203831717" watchObservedRunningTime="2026-06-06 13:09:26.137339536 +0000 UTC m=+471.204436891" Jun 06 13:09:26.171271 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.171222 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" podStartSLOduration=1.409351136 podStartE2EDuration="6.171208856s" totalImagesPullingTime="4.76185772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:26.169721395 +0000 UTC m=+471.236818743" watchObservedRunningTime="2026-06-06 13:09:26.171208856 +0000 UTC m=+471.238306203" Jun 06 13:09:26.184155 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:26.184089 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" podStartSLOduration=1.871432658 podStartE2EDuration="6.184075277s" totalImagesPullingTime="4.312642619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:26.182976774 +0000 UTC m=+471.250074154" watchObservedRunningTime="2026-06-06 13:09:26.184075277 +0000 UTC m=+471.251172623" Jun 06 13:09:27.134083 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:27.134048 2560 generic.go:356] "Generic (PLEG): container finished" podID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerID="4e15c518089e3ee01f288738093bb34f0346d593a3fcb1c72acb646370c28f5d" exitCode=0 Jun 06 13:09:27.134540 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:27.134145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" event={"ID":"c70590c8-851c-492a-b9a2-bd4c92517f9c","Type":"ContainerDied","Data":"4e15c518089e3ee01f288738093bb34f0346d593a3fcb1c72acb646370c28f5d"} Jun 06 13:09:28.140533 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:28.140492 2560 generic.go:356] "Generic (PLEG): container finished" podID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerID="c728f600d2461c11586fe6552ab594ef3d82cfac1d60281b3b2ec92cf19847d5" exitCode=0 Jun 06 13:09:28.140882 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:28.140575 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" event={"ID":"c70590c8-851c-492a-b9a2-bd4c92517f9c","Type":"ContainerDied","Data":"c728f600d2461c11586fe6552ab594ef3d82cfac1d60281b3b2ec92cf19847d5"} Jun 06 13:09:29.283371 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.283342 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:29.342043 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.342016 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util\") pod \"c70590c8-851c-492a-b9a2-bd4c92517f9c\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " Jun 06 13:09:29.342251 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.342054 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle\") pod \"c70590c8-851c-492a-b9a2-bd4c92517f9c\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " Jun 06 13:09:29.342251 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.342120 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwrhm\" (UniqueName: \"kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm\") pod \"c70590c8-851c-492a-b9a2-bd4c92517f9c\" (UID: \"c70590c8-851c-492a-b9a2-bd4c92517f9c\") " Jun 06 13:09:29.342999 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.342976 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle" (OuterVolumeSpecName: "bundle") pod "c70590c8-851c-492a-b9a2-bd4c92517f9c" (UID: "c70590c8-851c-492a-b9a2-bd4c92517f9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:09:29.344558 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.344529 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm" (OuterVolumeSpecName: "kube-api-access-qwrhm") pod "c70590c8-851c-492a-b9a2-bd4c92517f9c" (UID: "c70590c8-851c-492a-b9a2-bd4c92517f9c"). InnerVolumeSpecName "kube-api-access-qwrhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:09:29.348927 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.348897 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util" (OuterVolumeSpecName: "util") pod "c70590c8-851c-492a-b9a2-bd4c92517f9c" (UID: "c70590c8-851c-492a-b9a2-bd4c92517f9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:09:29.443239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.443164 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:29.443239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.443195 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c70590c8-851c-492a-b9a2-bd4c92517f9c-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:29.443239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.443209 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwrhm\" (UniqueName: \"kubernetes.io/projected/c70590c8-851c-492a-b9a2-bd4c92517f9c-kube-api-access-qwrhm\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:29.740726 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.740697 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rkzdk"] Jun 06 13:09:29.741088 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741071 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="pull" Jun 06 13:09:29.741200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741091 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="pull" Jun 06 13:09:29.741200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741127 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="util" Jun 06 13:09:29.741200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741136 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="util" Jun 06 13:09:29.741200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741144 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="extract" Jun 06 13:09:29.741200 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741152 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="extract" Jun 06 13:09:29.741441 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.741253 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70590c8-851c-492a-b9a2-bd4c92517f9c" containerName="extract" Jun 06 13:09:29.744360 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.744342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.746741 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.746720 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 06 13:09:29.746865 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.746724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p6n82\"" Jun 06 13:09:29.755443 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.755344 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rkzdk"] Jun 06 13:09:29.757715 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.757694 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c"] Jun 06 13:09:29.760800 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.760784 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.763179 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.763161 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 06 13:09:29.763276 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.763163 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-6htdz\"" Jun 06 13:09:29.779888 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.779861 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c"] Jun 06 13:09:29.847406 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.847372 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qftgx\" (UniqueName: \"kubernetes.io/projected/a1d463f9-d904-4971-8d3f-f85dc21a38d8-kube-api-access-qftgx\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.847567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.847434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.847567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.847471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d463f9-d904-4971-8d3f-f85dc21a38d8-cert\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.847567 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.847491 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljn5x\" (UniqueName: \"kubernetes.io/projected/1b68d693-51ba-46e1-8023-1c8a2afddd27-kube-api-access-ljn5x\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.948838 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.948796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qftgx\" (UniqueName: \"kubernetes.io/projected/a1d463f9-d904-4971-8d3f-f85dc21a38d8-kube-api-access-qftgx\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.949010 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.948872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.949010 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.948916 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d463f9-d904-4971-8d3f-f85dc21a38d8-cert\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.949010 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.948944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljn5x\" (UniqueName: \"kubernetes.io/projected/1b68d693-51ba-46e1-8023-1c8a2afddd27-kube-api-access-ljn5x\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.949184 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:09:29.949038 2560 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 06 13:09:29.949184 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:09:29.949120 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert podName:1b68d693-51ba-46e1-8023-1c8a2afddd27 nodeName:}" failed. No retries permitted until 2026-06-06 13:09:30.449085858 +0000 UTC m=+475.516183186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert") pod "llmisvc-controller-manager-864bfd7bc9-8mm8c" (UID: "1b68d693-51ba-46e1-8023-1c8a2afddd27") : secret "llmisvc-webhook-server-cert" not found Jun 06 13:09:29.951461 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.951436 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a1d463f9-d904-4971-8d3f-f85dc21a38d8-cert\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:29.965057 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.963989 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljn5x\" (UniqueName: \"kubernetes.io/projected/1b68d693-51ba-46e1-8023-1c8a2afddd27-kube-api-access-ljn5x\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:29.965057 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:29.963996 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qftgx\" (UniqueName: \"kubernetes.io/projected/a1d463f9-d904-4971-8d3f-f85dc21a38d8-kube-api-access-qftgx\") pod \"kserve-controller-manager-69fc866d76-rkzdk\" (UID: \"a1d463f9-d904-4971-8d3f-f85dc21a38d8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:30.055989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.055900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:30.155962 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.155937 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" Jun 06 13:09:30.155962 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.155948 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06p2bgf" event={"ID":"c70590c8-851c-492a-b9a2-bd4c92517f9c","Type":"ContainerDied","Data":"440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c"} Jun 06 13:09:30.156174 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.156005 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="440f2dbe15c18f34a5680af3e51870cb739e50ebe5e4b4d9adfd96caea5f306c" Jun 06 13:09:30.189807 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.189785 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-rkzdk"] Jun 06 13:09:30.191683 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:30.191659 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d463f9_d904_4971_8d3f_f85dc21a38d8.slice/crio-82a2291eac2531b1160790abdacc9b293848d08e9175c41b3ef0b233c2c35454 WatchSource:0}: Error finding container 82a2291eac2531b1160790abdacc9b293848d08e9175c41b3ef0b233c2c35454: Status 404 returned error can't find the container with id 82a2291eac2531b1160790abdacc9b293848d08e9175c41b3ef0b233c2c35454 Jun 06 13:09:30.453414 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.453281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:30.456122 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.456083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b68d693-51ba-46e1-8023-1c8a2afddd27-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-8mm8c\" (UID: \"1b68d693-51ba-46e1-8023-1c8a2afddd27\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:30.669208 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.669172 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:30.813657 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:30.813626 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c"] Jun 06 13:09:30.814943 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:30.814918 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b68d693_51ba_46e1_8023_1c8a2afddd27.slice/crio-a47f9f080f77a25f7b9d15dab66708173cfad184eabc500ff6bd5d47baf5dce7 WatchSource:0}: Error finding container a47f9f080f77a25f7b9d15dab66708173cfad184eabc500ff6bd5d47baf5dce7: Status 404 returned error can't find the container with id a47f9f080f77a25f7b9d15dab66708173cfad184eabc500ff6bd5d47baf5dce7 Jun 06 13:09:31.162961 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:31.162877 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" event={"ID":"a1d463f9-d904-4971-8d3f-f85dc21a38d8","Type":"ContainerStarted","Data":"82a2291eac2531b1160790abdacc9b293848d08e9175c41b3ef0b233c2c35454"} Jun 06 13:09:31.164327 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:31.164302 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" event={"ID":"1b68d693-51ba-46e1-8023-1c8a2afddd27","Type":"ContainerStarted","Data":"a47f9f080f77a25f7b9d15dab66708173cfad184eabc500ff6bd5d47baf5dce7"} Jun 06 13:09:33.180938 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:33.180836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" event={"ID":"a1d463f9-d904-4971-8d3f-f85dc21a38d8","Type":"ContainerStarted","Data":"1f44f08bae463fd1bce2d9ed689d149d7598a17e156d5aa041abb1571fccc1f5"} Jun 06 13:09:33.181534 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:33.181510 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:09:33.199981 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:33.199921 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" podStartSLOduration=1.6288848040000001 podStartE2EDuration="4.199900789s" totalImagesPullingTime="2.571015985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:33.198809514 +0000 UTC m=+478.265906863" watchObservedRunningTime="2026-06-06 13:09:33.199900789 +0000 UTC m=+478.266998137" Jun 06 13:09:34.188162 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:34.188123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" event={"ID":"1b68d693-51ba-46e1-8023-1c8a2afddd27","Type":"ContainerStarted","Data":"ed2e2d54345720fb9e0df35302d29d50dbbeb3407a75337341c0963e781b644e"} Jun 06 13:09:34.188555 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:34.188207 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:09:34.205467 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:34.205419 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" podStartSLOduration=2.324444538 podStartE2EDuration="5.205404552s" totalImagesPullingTime="2.880960014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:34.20423097 +0000 UTC m=+479.271328318" watchObservedRunningTime="2026-06-06 13:09:34.205404552 +0000 UTC m=+479.272501928" Jun 06 13:09:36.825633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.825594 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q"] Jun 06 13:09:36.831463 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.831440 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:36.835377 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.835359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:09:36.835492 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.835380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:09:36.836464 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.836439 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:09:36.849365 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.849342 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q"] Jun 06 13:09:36.912911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.912878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:36.913085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.913006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:36.913085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:36.913043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ck8v\" (UniqueName: \"kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.013825 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.013787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.013980 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.013938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ck8v\" (UniqueName: \"kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.013980 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.013960 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.014237 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.014215 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.014317 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.014300 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.022804 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.022777 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ck8v\" (UniqueName: \"kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.137095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.137000 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-v57ts" Jun 06 13:09:37.139765 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.139741 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-q85bd" Jun 06 13:09:37.140053 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.140031 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:37.334799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:37.334765 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q"] Jun 06 13:09:37.336818 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:37.336792 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f01f47_afc6_4d23_94fb_8ce83f39dc10.slice/crio-030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b WatchSource:0}: Error finding container 030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b: Status 404 returned error can't find the container with id 030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b Jun 06 13:09:38.209048 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.209016 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-v82bk"] Jun 06 13:09:38.216410 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.216390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.219889 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.219869 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 06 13:09:38.220126 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.220092 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 06 13:09:38.220215 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.220187 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-tzgt7\"" Jun 06 13:09:38.226489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.226466 2560 generic.go:356] "Generic (PLEG): container finished" podID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerID="a47a67866e187d13dce61622f917f28b9f0fe6f2f9d08a34c98830be29bfec02" exitCode=0 Jun 06 13:09:38.226586 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.226523 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerDied","Data":"a47a67866e187d13dce61622f917f28b9f0fe6f2f9d08a34c98830be29bfec02"} Jun 06 13:09:38.226586 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.226557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerStarted","Data":"030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b"} Jun 06 13:09:38.230924 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.230904 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-v82bk"] Jun 06 13:09:38.325238 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.325155 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1944846-3a21-4ef2-97eb-6d30cbf0e443-operator-config\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.325401 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.325247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87h49\" (UniqueName: \"kubernetes.io/projected/e1944846-3a21-4ef2-97eb-6d30cbf0e443-kube-api-access-87h49\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.426011 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.425978 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87h49\" (UniqueName: \"kubernetes.io/projected/e1944846-3a21-4ef2-97eb-6d30cbf0e443-kube-api-access-87h49\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.426190 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.426020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1944846-3a21-4ef2-97eb-6d30cbf0e443-operator-config\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.428533 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.428513 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1944846-3a21-4ef2-97eb-6d30cbf0e443-operator-config\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.436797 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.436764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87h49\" (UniqueName: \"kubernetes.io/projected/e1944846-3a21-4ef2-97eb-6d30cbf0e443-kube-api-access-87h49\") pod \"servicemesh-operator3-57f65f65fb-v82bk\" (UID: \"e1944846-3a21-4ef2-97eb-6d30cbf0e443\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.526692 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.526651 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:38.714944 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:38.714850 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-v82bk"] Jun 06 13:09:38.717998 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:38.717973 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1944846_3a21_4ef2_97eb_6d30cbf0e443.slice/crio-4a5d325f667e1d5bddff3f7811023d052ad7a1b7441a12e8a1c13df05353008d WatchSource:0}: Error finding container 4a5d325f667e1d5bddff3f7811023d052ad7a1b7441a12e8a1c13df05353008d: Status 404 returned error can't find the container with id 4a5d325f667e1d5bddff3f7811023d052ad7a1b7441a12e8a1c13df05353008d Jun 06 13:09:39.233535 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:39.233504 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" event={"ID":"e1944846-3a21-4ef2-97eb-6d30cbf0e443","Type":"ContainerStarted","Data":"4a5d325f667e1d5bddff3f7811023d052ad7a1b7441a12e8a1c13df05353008d"} Jun 06 13:09:39.235313 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:39.235294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerStarted","Data":"c73125d33bee887d161bdaede99c9feb3173c4f54abcc30b0cb783744467116e"} Jun 06 13:09:40.242475 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:40.242444 2560 generic.go:356] "Generic (PLEG): container finished" podID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerID="c73125d33bee887d161bdaede99c9feb3173c4f54abcc30b0cb783744467116e" exitCode=0 Jun 06 13:09:40.242855 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:40.242496 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerDied","Data":"c73125d33bee887d161bdaede99c9feb3173c4f54abcc30b0cb783744467116e"} Jun 06 13:09:41.250463 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:41.250425 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerStarted","Data":"d40a1a8fbb6a5dc2749c16847bde34fed6aa8ce2b87cff25181adc33c8a18428"} Jun 06 13:09:41.268562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:41.268520 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" podStartSLOduration=4.331007692 podStartE2EDuration="5.26850435s" totalImagesPullingTime="937.496658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:41.267379788 +0000 UTC m=+486.334477139" watchObservedRunningTime="2026-06-06 13:09:41.26850435 +0000 UTC m=+486.335601698" Jun 06 13:09:42.257622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:42.257579 2560 generic.go:356] "Generic (PLEG): container finished" podID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerID="d40a1a8fbb6a5dc2749c16847bde34fed6aa8ce2b87cff25181adc33c8a18428" exitCode=0 Jun 06 13:09:42.258204 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:42.257685 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerDied","Data":"d40a1a8fbb6a5dc2749c16847bde34fed6aa8ce2b87cff25181adc33c8a18428"} Jun 06 13:09:42.259602 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:42.259572 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" event={"ID":"e1944846-3a21-4ef2-97eb-6d30cbf0e443","Type":"ContainerStarted","Data":"49fdfaf139fd21b188e85407ec2264b4e0face4c5a260563a46d470fdce4e7bd"} Jun 06 13:09:42.259778 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:42.259634 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:42.294674 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:42.294630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" podStartSLOduration=1.804537101 podStartE2EDuration="4.294616983s" totalImagesPullingTime="2.490079882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:42.292355896 +0000 UTC m=+487.359453246" watchObservedRunningTime="2026-06-06 13:09:42.294616983 +0000 UTC m=+487.361714330" Jun 06 13:09:43.390799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.390776 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:43.471117 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.471071 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util\") pod \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " Jun 06 13:09:43.471117 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.471122 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle\") pod \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " Jun 06 13:09:43.471351 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.471190 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ck8v\" (UniqueName: \"kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v\") pod \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\" (UID: \"25f01f47-afc6-4d23-94fb-8ce83f39dc10\") " Jun 06 13:09:43.472030 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.471997 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle" (OuterVolumeSpecName: "bundle") pod "25f01f47-afc6-4d23-94fb-8ce83f39dc10" (UID: "25f01f47-afc6-4d23-94fb-8ce83f39dc10"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:09:43.473224 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.473203 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v" (OuterVolumeSpecName: "kube-api-access-6ck8v") pod "25f01f47-afc6-4d23-94fb-8ce83f39dc10" (UID: "25f01f47-afc6-4d23-94fb-8ce83f39dc10"). InnerVolumeSpecName "kube-api-access-6ck8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:09:43.475212 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.475192 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util" (OuterVolumeSpecName: "util") pod "25f01f47-afc6-4d23-94fb-8ce83f39dc10" (UID: "25f01f47-afc6-4d23-94fb-8ce83f39dc10"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:09:43.572642 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.572559 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ck8v\" (UniqueName: \"kubernetes.io/projected/25f01f47-afc6-4d23-94fb-8ce83f39dc10-kube-api-access-6ck8v\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:43.572642 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.572583 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:43.572642 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:43.572593 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25f01f47-afc6-4d23-94fb-8ce83f39dc10-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:09:44.272338 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:44.272308 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" Jun 06 13:09:44.272501 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:44.272307 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762amtg5q" event={"ID":"25f01f47-afc6-4d23-94fb-8ce83f39dc10","Type":"ContainerDied","Data":"030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b"} Jun 06 13:09:44.272501 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:44.272437 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="030930e2d21d5a6ba70500b4004647cc818b1c11d9f626220dcb3153eab20c8b" Jun 06 13:09:50.712782 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.712742 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-h6j87"] Jun 06 13:09:50.713321 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713301 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="util" Jun 06 13:09:50.713408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713324 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="util" Jun 06 13:09:50.713408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713334 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="extract" Jun 06 13:09:50.713408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713342 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="extract" Jun 06 13:09:50.713408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713358 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="pull" Jun 06 13:09:50.713408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713367 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="pull" Jun 06 13:09:50.713639 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.713459 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="25f01f47-afc6-4d23-94fb-8ce83f39dc10" containerName="extract" Jun 06 13:09:50.716429 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.716408 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.718916 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.718893 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qnc8c\"" Jun 06 13:09:50.718916 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.718902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 13:09:50.726276 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.726249 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-h6j87"] Jun 06 13:09:50.838209 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.838178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9mj\" (UniqueName: \"kubernetes.io/projected/57405c89-d9cb-43bc-94c8-4ddf066d2735-kube-api-access-bs9mj\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.838382 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.838245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57405c89-d9cb-43bc-94c8-4ddf066d2735-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.939495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.939464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57405c89-d9cb-43bc-94c8-4ddf066d2735-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.939653 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.939527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mj\" (UniqueName: \"kubernetes.io/projected/57405c89-d9cb-43bc-94c8-4ddf066d2735-kube-api-access-bs9mj\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.940242 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.940223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/57405c89-d9cb-43bc-94c8-4ddf066d2735-redirect-config\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:50.946738 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:50.946714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9mj\" (UniqueName: \"kubernetes.io/projected/57405c89-d9cb-43bc-94c8-4ddf066d2735-kube-api-access-bs9mj\") pod \"dashboard-redirect-6cd8c57d44-h6j87\" (UID: \"57405c89-d9cb-43bc-94c8-4ddf066d2735\") " pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:51.028716 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:51.028685 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" Jun 06 13:09:51.155065 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:51.155043 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6cd8c57d44-h6j87"] Jun 06 13:09:51.156958 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:09:51.156930 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57405c89_d9cb_43bc_94c8_4ddf066d2735.slice/crio-a793d60be0ae2aa683ab012c14989410405dd49a45ac2067242dee601e7d2439 WatchSource:0}: Error finding container a793d60be0ae2aa683ab012c14989410405dd49a45ac2067242dee601e7d2439: Status 404 returned error can't find the container with id a793d60be0ae2aa683ab012c14989410405dd49a45ac2067242dee601e7d2439 Jun 06 13:09:51.307353 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:51.307276 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" event={"ID":"57405c89-d9cb-43bc-94c8-4ddf066d2735","Type":"ContainerStarted","Data":"a793d60be0ae2aa683ab012c14989410405dd49a45ac2067242dee601e7d2439"} Jun 06 13:09:53.267465 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:53.267429 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-v82bk" Jun 06 13:09:54.327228 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:54.327188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" event={"ID":"57405c89-d9cb-43bc-94c8-4ddf066d2735","Type":"ContainerStarted","Data":"d1de91664b6e8f728017f7055f57cf9bd638a836e85f4db94aaf7009ad5754af"} Jun 06 13:09:54.356159 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:09:54.356088 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6cd8c57d44-h6j87" podStartSLOduration=2.099742376 podStartE2EDuration="4.356073528s" totalImagesPullingTime="2.256331152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:09:54.354755534 +0000 UTC m=+499.421852882" watchObservedRunningTime="2026-06-06 13:09:54.356073528 +0000 UTC m=+499.423170875" Jun 06 13:10:04.193860 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:04.193831 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-rkzdk" Jun 06 13:10:05.195867 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:05.195836 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-8mm8c" Jun 06 13:10:08.321772 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.321736 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8"] Jun 06 13:10:08.330260 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.330231 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.332789 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.332758 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 06 13:10:08.332922 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.332798 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 06 13:10:08.332922 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.332840 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 13:10:08.333085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.333069 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cg5r9\"" Jun 06 13:10:08.333184 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.333167 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 06 13:10:08.338405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.335461 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8"] Jun 06 13:10:08.489758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489718 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ec52cf0-0411-4350-be19-a7fc9c6fe214-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngvc5\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-kube-api-access-ngvc5\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.489958 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.489946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590655 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590655 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590655 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590639 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ec52cf0-0411-4350-be19-a7fc9c6fe214-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590667 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590741 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngvc5\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-kube-api-access-ngvc5\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.590937 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.590848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.591336 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.591297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.593230 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.593205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.593347 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.593258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.593347 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.593329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ec52cf0-0411-4350-be19-a7fc9c6fe214-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.593501 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.593476 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3ec52cf0-0411-4350-be19-a7fc9c6fe214-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.597716 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.597695 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.598142 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.598123 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngvc5\" (UniqueName: \"kubernetes.io/projected/3ec52cf0-0411-4350-be19-a7fc9c6fe214-kube-api-access-ngvc5\") pod \"istiod-openshift-gateway-75c67f8887-lxgx8\" (UID: \"3ec52cf0-0411-4350-be19-a7fc9c6fe214\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.646315 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.646287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:08.780771 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:08.780744 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8"] Jun 06 13:10:08.783385 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:08.783345 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec52cf0_0411_4350_be19_a7fc9c6fe214.slice/crio-9c05a61df35c559199a1bd1e7c05d67fefa15b9e39cecc9f3b6b004bfbdc801d WatchSource:0}: Error finding container 9c05a61df35c559199a1bd1e7c05d67fefa15b9e39cecc9f3b6b004bfbdc801d: Status 404 returned error can't find the container with id 9c05a61df35c559199a1bd1e7c05d67fefa15b9e39cecc9f3b6b004bfbdc801d Jun 06 13:10:09.400954 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:09.400923 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" event={"ID":"3ec52cf0-0411-4350-be19-a7fc9c6fe214","Type":"ContainerStarted","Data":"9c05a61df35c559199a1bd1e7c05d67fefa15b9e39cecc9f3b6b004bfbdc801d"} Jun 06 13:10:11.978569 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:11.978532 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:10:11.978819 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:11.978607 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 13:10:12.419012 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:12.418933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" event={"ID":"3ec52cf0-0411-4350-be19-a7fc9c6fe214","Type":"ContainerStarted","Data":"cc98b28e858d5ca19d38552d6dcdce18c7ee552d4ffb5666bcf36037604e54aa"} Jun 06 13:10:12.419182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:12.419044 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:12.439348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:12.439306 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" podStartSLOduration=1.246481585 podStartE2EDuration="4.439289827s" totalImagesPullingTime="3.192808242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:12.437855838 +0000 UTC m=+517.504953185" watchObservedRunningTime="2026-06-06 13:10:12.439289827 +0000 UTC m=+517.506387174" Jun 06 13:10:13.426158 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:13.426131 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-lxgx8" Jun 06 13:10:36.725184 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.725096 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc"] Jun 06 13:10:36.736191 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.736163 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.736761 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.736733 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc"] Jun 06 13:10:36.738911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.738762 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 13:10:36.738911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.738786 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 13:10:36.738911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.738882 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-948qg\"" Jun 06 13:10:36.816029 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.815989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.816250 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.816051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.816250 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.816089 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f55h\" (UniqueName: \"kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.916994 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.916956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.917175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.917023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.917175 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.917058 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f55h\" (UniqueName: \"kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.917358 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.917338 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.917420 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.917364 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:36.924522 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:36.924499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f55h\" (UniqueName: \"kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:37.046419 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.046382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:37.176328 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.176302 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc"] Jun 06 13:10:37.177830 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:37.177800 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5ceee0_9e07_4819_a81d_19617c66080e.slice/crio-ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f WatchSource:0}: Error finding container ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f: Status 404 returned error can't find the container with id ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f Jun 06 13:10:37.523578 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.523545 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k"] Jun 06 13:10:37.526839 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.526818 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.535830 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.535807 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k"] Jun 06 13:10:37.548343 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.548317 2560 generic.go:356] "Generic (PLEG): container finished" podID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerID="100d8351d0db3d643fefb2df6bb2c136374e03e9c34040abdcd0bba943307361" exitCode=0 Jun 06 13:10:37.548445 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.548399 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" event={"ID":"5e5ceee0-9e07-4819-a81d-19617c66080e","Type":"ContainerDied","Data":"100d8351d0db3d643fefb2df6bb2c136374e03e9c34040abdcd0bba943307361"} Jun 06 13:10:37.548445 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.548441 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" event={"ID":"5e5ceee0-9e07-4819-a81d-19617c66080e","Type":"ContainerStarted","Data":"ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f"} Jun 06 13:10:37.624837 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.624810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.624950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.624866 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.624989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.624952 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj9p\" (UniqueName: \"kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.725962 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.725934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.726305 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.725994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.726305 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.726032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj9p\" (UniqueName: \"kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.726376 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.726354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.726414 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.726386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.733685 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.733660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj9p\" (UniqueName: \"kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.837839 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.837781 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:37.967184 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:37.967161 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k"] Jun 06 13:10:37.969880 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:37.969850 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001eb25e_4297_4f0d_91ca_c93a953084b1.slice/crio-671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4 WatchSource:0}: Error finding container 671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4: Status 404 returned error can't find the container with id 671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4 Jun 06 13:10:38.326182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.326131 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7"] Jun 06 13:10:38.329773 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.329753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.336780 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.336755 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7"] Jun 06 13:10:38.433045 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.433020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrcqp\" (UniqueName: \"kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.433182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.433078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.433182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.433147 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.533544 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.533467 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.533544 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.533516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrcqp\" (UniqueName: \"kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.533703 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.533631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.533849 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.533833 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.533912 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.533898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.541578 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.541553 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrcqp\" (UniqueName: \"kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.554931 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.554909 2560 generic.go:356] "Generic (PLEG): container finished" podID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerID="88abeb79371a2275f812fa7bbfca6f9e5c2f0c7afd3bcbb2a2273c3df530a89e" exitCode=0 Jun 06 13:10:38.555036 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.554997 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" event={"ID":"5e5ceee0-9e07-4819-a81d-19617c66080e","Type":"ContainerDied","Data":"88abeb79371a2275f812fa7bbfca6f9e5c2f0c7afd3bcbb2a2273c3df530a89e"} Jun 06 13:10:38.556538 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.556513 2560 generic.go:356] "Generic (PLEG): container finished" podID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerID="374d39eb46905418c23efcc0435e1cdd7a4920105dcaab19bb55992ee531e748" exitCode=0 Jun 06 13:10:38.556636 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.556543 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" event={"ID":"001eb25e-4297-4f0d-91ca-c93a953084b1","Type":"ContainerDied","Data":"374d39eb46905418c23efcc0435e1cdd7a4920105dcaab19bb55992ee531e748"} Jun 06 13:10:38.556636 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.556581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" event={"ID":"001eb25e-4297-4f0d-91ca-c93a953084b1","Type":"ContainerStarted","Data":"671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4"} Jun 06 13:10:38.671943 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.671915 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:38.727928 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.727902 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr"] Jun 06 13:10:38.731811 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.731790 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.738559 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.738535 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr"] Jun 06 13:10:38.807005 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.806982 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7"] Jun 06 13:10:38.808434 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:38.808408 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2605a0_6538_471b_8a76_a845a81a97a1.slice/crio-824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19 WatchSource:0}: Error finding container 824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19: Status 404 returned error can't find the container with id 824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19 Jun 06 13:10:38.836616 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.836594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.836724 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.836655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.836724 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.836698 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2gs\" (UniqueName: \"kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.937163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.937133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.937272 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.937165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2gs\" (UniqueName: \"kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.937272 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.937208 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.937430 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.937412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.937488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.937446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:38.945355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:38.945336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2gs\" (UniqueName: \"kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:39.054143 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.054087 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:39.191586 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.189409 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr"] Jun 06 13:10:39.255278 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:39.255246 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d33a33_528f_4376_b8b5_e4e4093bcc32.slice/crio-ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177 WatchSource:0}: Error finding container ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177: Status 404 returned error can't find the container with id ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177 Jun 06 13:10:39.563605 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.563516 2560 generic.go:356] "Generic (PLEG): container finished" podID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerID="206cc35f15b46b7840be3587625812355e18113225b37f80f2346e400161579f" exitCode=0 Jun 06 13:10:39.563605 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.563591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" event={"ID":"e2d33a33-528f-4376-b8b5-e4e4093bcc32","Type":"ContainerDied","Data":"206cc35f15b46b7840be3587625812355e18113225b37f80f2346e400161579f"} Jun 06 13:10:39.563838 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.563627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" event={"ID":"e2d33a33-528f-4376-b8b5-e4e4093bcc32","Type":"ContainerStarted","Data":"ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177"} Jun 06 13:10:39.565118 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.565080 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerID="3cb292e843531662f6d4f99cfc7cc03ce4360e8d5641ef5fc5e50b071edbdc8d" exitCode=0 Jun 06 13:10:39.565210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.565169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" event={"ID":"1e2605a0-6538-471b-8a76-a845a81a97a1","Type":"ContainerDied","Data":"3cb292e843531662f6d4f99cfc7cc03ce4360e8d5641ef5fc5e50b071edbdc8d"} Jun 06 13:10:39.565258 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.565214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" event={"ID":"1e2605a0-6538-471b-8a76-a845a81a97a1","Type":"ContainerStarted","Data":"824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19"} Jun 06 13:10:39.567307 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.567285 2560 generic.go:356] "Generic (PLEG): container finished" podID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerID="7edfcbd7a99a1abb87f0400cb63201a52cf0cdb6c3bdc7cb6f9d1c34881f9e37" exitCode=0 Jun 06 13:10:39.567391 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.567360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" event={"ID":"5e5ceee0-9e07-4819-a81d-19617c66080e","Type":"ContainerDied","Data":"7edfcbd7a99a1abb87f0400cb63201a52cf0cdb6c3bdc7cb6f9d1c34881f9e37"} Jun 06 13:10:39.569167 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.569139 2560 generic.go:356] "Generic (PLEG): container finished" podID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerID="4a8028efb3b81e61c6709c7744c0402b5b55c689a8ae15912870b8285b25a098" exitCode=0 Jun 06 13:10:39.569259 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:39.569193 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" event={"ID":"001eb25e-4297-4f0d-91ca-c93a953084b1","Type":"ContainerDied","Data":"4a8028efb3b81e61c6709c7744c0402b5b55c689a8ae15912870b8285b25a098"} Jun 06 13:10:40.576549 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.576470 2560 generic.go:356] "Generic (PLEG): container finished" podID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerID="c662c6b1e4832f74c70788617a061e28378a8d022ab388693a6d0748157825e4" exitCode=0 Jun 06 13:10:40.576910 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.576554 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" event={"ID":"001eb25e-4297-4f0d-91ca-c93a953084b1","Type":"ContainerDied","Data":"c662c6b1e4832f74c70788617a061e28378a8d022ab388693a6d0748157825e4"} Jun 06 13:10:40.578392 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.578369 2560 generic.go:356] "Generic (PLEG): container finished" podID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerID="a767c50b57a8d3f0ec6281113adc59c512ead5da9095ed1327e9b61e93f9b5fc" exitCode=0 Jun 06 13:10:40.578504 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.578438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" event={"ID":"e2d33a33-528f-4376-b8b5-e4e4093bcc32","Type":"ContainerDied","Data":"a767c50b57a8d3f0ec6281113adc59c512ead5da9095ed1327e9b61e93f9b5fc"} Jun 06 13:10:40.580467 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.580444 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerID="6b44361d18232a09c502617df4e7c7a13c063d144af616e0d41caab78d16be7e" exitCode=0 Jun 06 13:10:40.580592 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.580477 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" event={"ID":"1e2605a0-6538-471b-8a76-a845a81a97a1","Type":"ContainerDied","Data":"6b44361d18232a09c502617df4e7c7a13c063d144af616e0d41caab78d16be7e"} Jun 06 13:10:40.714304 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.714279 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:40.856427 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.856366 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f55h\" (UniqueName: \"kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h\") pod \"5e5ceee0-9e07-4819-a81d-19617c66080e\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " Jun 06 13:10:40.856542 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.856431 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle\") pod \"5e5ceee0-9e07-4819-a81d-19617c66080e\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " Jun 06 13:10:40.856542 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.856491 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util\") pod \"5e5ceee0-9e07-4819-a81d-19617c66080e\" (UID: \"5e5ceee0-9e07-4819-a81d-19617c66080e\") " Jun 06 13:10:40.857012 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.856979 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle" (OuterVolumeSpecName: "bundle") pod "5e5ceee0-9e07-4819-a81d-19617c66080e" (UID: "5e5ceee0-9e07-4819-a81d-19617c66080e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:40.858584 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.858558 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h" (OuterVolumeSpecName: "kube-api-access-6f55h") pod "5e5ceee0-9e07-4819-a81d-19617c66080e" (UID: "5e5ceee0-9e07-4819-a81d-19617c66080e"). InnerVolumeSpecName "kube-api-access-6f55h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:10:40.861981 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.861952 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util" (OuterVolumeSpecName: "util") pod "5e5ceee0-9e07-4819-a81d-19617c66080e" (UID: "5e5ceee0-9e07-4819-a81d-19617c66080e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:40.957360 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.957338 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f55h\" (UniqueName: \"kubernetes.io/projected/5e5ceee0-9e07-4819-a81d-19617c66080e-kube-api-access-6f55h\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:40.957360 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.957359 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:40.957493 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:40.957369 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e5ceee0-9e07-4819-a81d-19617c66080e-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:41.588171 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.588141 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" Jun 06 13:10:41.588579 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.588145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc" event={"ID":"5e5ceee0-9e07-4819-a81d-19617c66080e","Type":"ContainerDied","Data":"ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f"} Jun 06 13:10:41.588579 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.588262 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed2dfa42d2c61860b72e90c20130c95a11e770ebcabaa9729b7dd5ae8376610f" Jun 06 13:10:41.590630 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.590602 2560 generic.go:356] "Generic (PLEG): container finished" podID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerID="25d62a222437c6aaff082e73dead5d821e1a0c0598096d1a014c0bc4047120c1" exitCode=0 Jun 06 13:10:41.590747 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.590698 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" event={"ID":"e2d33a33-528f-4376-b8b5-e4e4093bcc32","Type":"ContainerDied","Data":"25d62a222437c6aaff082e73dead5d821e1a0c0598096d1a014c0bc4047120c1"} Jun 06 13:10:41.592608 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.592588 2560 generic.go:356] "Generic (PLEG): container finished" podID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerID="c54cff7cf151bd1078271593acd243195d75001d0373ecd91930ee64ecf0593b" exitCode=0 Jun 06 13:10:41.592692 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.592669 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" event={"ID":"1e2605a0-6538-471b-8a76-a845a81a97a1","Type":"ContainerDied","Data":"c54cff7cf151bd1078271593acd243195d75001d0373ecd91930ee64ecf0593b"} Jun 06 13:10:41.733078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.733054 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:41.864501 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.864473 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle\") pod \"001eb25e-4297-4f0d-91ca-c93a953084b1\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " Jun 06 13:10:41.864682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.864522 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmj9p\" (UniqueName: \"kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p\") pod \"001eb25e-4297-4f0d-91ca-c93a953084b1\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " Jun 06 13:10:41.864682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.864580 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util\") pod \"001eb25e-4297-4f0d-91ca-c93a953084b1\" (UID: \"001eb25e-4297-4f0d-91ca-c93a953084b1\") " Jun 06 13:10:41.865021 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.864995 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle" (OuterVolumeSpecName: "bundle") pod "001eb25e-4297-4f0d-91ca-c93a953084b1" (UID: "001eb25e-4297-4f0d-91ca-c93a953084b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:41.866665 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.866643 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p" (OuterVolumeSpecName: "kube-api-access-fmj9p") pod "001eb25e-4297-4f0d-91ca-c93a953084b1" (UID: "001eb25e-4297-4f0d-91ca-c93a953084b1"). InnerVolumeSpecName "kube-api-access-fmj9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:10:41.869913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.869890 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util" (OuterVolumeSpecName: "util") pod "001eb25e-4297-4f0d-91ca-c93a953084b1" (UID: "001eb25e-4297-4f0d-91ca-c93a953084b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:41.965669 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.965605 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:41.965669 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.965638 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/001eb25e-4297-4f0d-91ca-c93a953084b1-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:41.965669 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:41.965648 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmj9p\" (UniqueName: \"kubernetes.io/projected/001eb25e-4297-4f0d-91ca-c93a953084b1-kube-api-access-fmj9p\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.600469 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.600433 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" event={"ID":"001eb25e-4297-4f0d-91ca-c93a953084b1","Type":"ContainerDied","Data":"671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4"} Jun 06 13:10:42.600828 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.600484 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="671d2b29b0249c4812b81fc9ed1b828e42aca263074f7f187d04c16c30c876b4" Jun 06 13:10:42.600828 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.600425 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k" Jun 06 13:10:42.767626 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.767594 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:42.792395 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.792366 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:42.871842 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871745 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2gs\" (UniqueName: \"kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs\") pod \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " Jun 06 13:10:42.871842 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871792 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrcqp\" (UniqueName: \"kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp\") pod \"1e2605a0-6538-471b-8a76-a845a81a97a1\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " Jun 06 13:10:42.871842 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871835 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle\") pod \"1e2605a0-6538-471b-8a76-a845a81a97a1\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " Jun 06 13:10:42.872141 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871896 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util\") pod \"1e2605a0-6538-471b-8a76-a845a81a97a1\" (UID: \"1e2605a0-6538-471b-8a76-a845a81a97a1\") " Jun 06 13:10:42.872141 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871949 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util\") pod \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " Jun 06 13:10:42.872141 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.871984 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle\") pod \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\" (UID: \"e2d33a33-528f-4376-b8b5-e4e4093bcc32\") " Jun 06 13:10:42.872595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.872559 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle" (OuterVolumeSpecName: "bundle") pod "e2d33a33-528f-4376-b8b5-e4e4093bcc32" (UID: "e2d33a33-528f-4376-b8b5-e4e4093bcc32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:42.872595 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.872577 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle" (OuterVolumeSpecName: "bundle") pod "1e2605a0-6538-471b-8a76-a845a81a97a1" (UID: "1e2605a0-6538-471b-8a76-a845a81a97a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:42.874072 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.874045 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs" (OuterVolumeSpecName: "kube-api-access-qj2gs") pod "e2d33a33-528f-4376-b8b5-e4e4093bcc32" (UID: "e2d33a33-528f-4376-b8b5-e4e4093bcc32"). InnerVolumeSpecName "kube-api-access-qj2gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:10:42.874358 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.874332 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp" (OuterVolumeSpecName: "kube-api-access-zrcqp") pod "1e2605a0-6538-471b-8a76-a845a81a97a1" (UID: "1e2605a0-6538-471b-8a76-a845a81a97a1"). InnerVolumeSpecName "kube-api-access-zrcqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:10:42.878002 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.877955 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util" (OuterVolumeSpecName: "util") pod "e2d33a33-528f-4376-b8b5-e4e4093bcc32" (UID: "e2d33a33-528f-4376-b8b5-e4e4093bcc32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:42.878263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.878239 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util" (OuterVolumeSpecName: "util") pod "1e2605a0-6538-471b-8a76-a845a81a97a1" (UID: "1e2605a0-6538-471b-8a76-a845a81a97a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:10:42.972894 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972864 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.972894 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972890 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e2605a0-6538-471b-8a76-a845a81a97a1-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.972894 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972900 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.973086 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972909 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2d33a33-528f-4376-b8b5-e4e4093bcc32-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.973086 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972918 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2gs\" (UniqueName: \"kubernetes.io/projected/e2d33a33-528f-4376-b8b5-e4e4093bcc32-kube-api-access-qj2gs\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:42.973086 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:42.972928 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrcqp\" (UniqueName: \"kubernetes.io/projected/1e2605a0-6538-471b-8a76-a845a81a97a1-kube-api-access-zrcqp\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:10:43.607758 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.607725 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" event={"ID":"e2d33a33-528f-4376-b8b5-e4e4093bcc32","Type":"ContainerDied","Data":"ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177"} Jun 06 13:10:43.608210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.607774 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed8edaf001e5418f8359670b19a8ff8713bcb450aa0688a2f8097b67c347e177" Jun 06 13:10:43.608210 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.607733 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr" Jun 06 13:10:43.609669 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.609642 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" Jun 06 13:10:43.609835 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.609648 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7" event={"ID":"1e2605a0-6538-471b-8a76-a845a81a97a1","Type":"ContainerDied","Data":"824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19"} Jun 06 13:10:43.609979 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:43.609851 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="824c3bd1d93e722fd9a9202edfd07c63c64701beeca6be32061992ac47d62a19" Jun 06 13:10:44.115888 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:44.115850 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:10:51.680509 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680478 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx"] Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680841 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="pull" Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680854 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="pull" Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680865 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="pull" Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680871 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="pull" Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680879 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="util" Jun 06 13:10:51.680886 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680884 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680894 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680899 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680913 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680921 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680927 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="pull" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680932 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="pull" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680941 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680946 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680952 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="pull" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680957 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="pull" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680963 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680968 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680974 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680979 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680988 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.680996 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="util" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681004 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681009 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681066 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2605a0-6538-471b-8a76-a845a81a97a1" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681079 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d33a33-528f-4376-b8b5-e4e4093bcc32" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681090 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5ceee0-9e07-4819-a81d-19617c66080e" containerName="extract" Jun 06 13:10:51.681085 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.681111 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="001eb25e-4297-4f0d-91ca-c93a953084b1" containerName="extract" Jun 06 13:10:51.684230 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.684193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:51.686741 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.686717 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 13:10:51.686871 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.686720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 06 13:10:51.686871 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.686725 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 13:10:51.687889 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.687872 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mc4pt\"" Jun 06 13:10:51.693522 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.693500 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx"] Jun 06 13:10:51.755269 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.755236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zl8h\" (UniqueName: \"kubernetes.io/projected/c2329dba-9e85-4379-b099-fca94ea71b37-kube-api-access-8zl8h\") pod \"dns-operator-controller-manager-864dd78c4c-zhjpx\" (UID: \"c2329dba-9e85-4379-b099-fca94ea71b37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:51.856376 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.856345 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zl8h\" (UniqueName: \"kubernetes.io/projected/c2329dba-9e85-4379-b099-fca94ea71b37-kube-api-access-8zl8h\") pod \"dns-operator-controller-manager-864dd78c4c-zhjpx\" (UID: \"c2329dba-9e85-4379-b099-fca94ea71b37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:51.865251 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.865220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zl8h\" (UniqueName: \"kubernetes.io/projected/c2329dba-9e85-4379-b099-fca94ea71b37-kube-api-access-8zl8h\") pod \"dns-operator-controller-manager-864dd78c4c-zhjpx\" (UID: \"c2329dba-9e85-4379-b099-fca94ea71b37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:51.995146 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:51.995120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:52.127449 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:52.127425 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx"] Jun 06 13:10:52.129827 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:52.129803 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2329dba_9e85_4379_b099_fca94ea71b37.slice/crio-e58f16474457094a57fa390ef6696845fd5f6b8458fd8a7f92f309f3a96c7bd7 WatchSource:0}: Error finding container e58f16474457094a57fa390ef6696845fd5f6b8458fd8a7f92f309f3a96c7bd7: Status 404 returned error can't find the container with id e58f16474457094a57fa390ef6696845fd5f6b8458fd8a7f92f309f3a96c7bd7 Jun 06 13:10:52.660288 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:52.660259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" event={"ID":"c2329dba-9e85-4379-b099-fca94ea71b37","Type":"ContainerStarted","Data":"e58f16474457094a57fa390ef6696845fd5f6b8458fd8a7f92f309f3a96c7bd7"} Jun 06 13:10:54.677539 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:54.677497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" event={"ID":"c2329dba-9e85-4379-b099-fca94ea71b37","Type":"ContainerStarted","Data":"23e900890121268d9b7c78f3427091c0043eaf3abee514bca52952ab59e50c8c"} Jun 06 13:10:54.677964 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:54.677711 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:10:54.704755 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:54.704708 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" podStartSLOduration=1.765809769 podStartE2EDuration="3.704693898s" totalImagesPullingTime="1.938884129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:10:54.703047013 +0000 UTC m=+559.770144409" watchObservedRunningTime="2026-06-06 13:10:54.704693898 +0000 UTC m=+559.771791244" Jun 06 13:10:57.621207 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.621164 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc"] Jun 06 13:10:57.625280 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.625249 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:10:57.629850 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.629818 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-49ct2\"" Jun 06 13:10:57.638314 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.637634 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc"] Jun 06 13:10:57.709877 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.709845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59bjd\" (UniqueName: \"kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd\") pod \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" (UID: \"385fa8a1-3147-4d8d-b611-6a4b77080359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:10:57.810382 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.810341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59bjd\" (UniqueName: \"kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd\") pod \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" (UID: \"385fa8a1-3147-4d8d-b611-6a4b77080359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:10:57.820676 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.820648 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59bjd\" (UniqueName: \"kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd\") pod \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" (UID: \"385fa8a1-3147-4d8d-b611-6a4b77080359\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:10:57.943142 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:57.943058 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:10:58.075766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:58.075737 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc"] Jun 06 13:10:58.076963 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:10:58.076938 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385fa8a1_3147_4d8d_b611_6a4b77080359.slice/crio-9433af29a525d982d553fce365f431d7e108225a117a8f57156fce54c95133bc WatchSource:0}: Error finding container 9433af29a525d982d553fce365f431d7e108225a117a8f57156fce54c95133bc: Status 404 returned error can't find the container with id 9433af29a525d982d553fce365f431d7e108225a117a8f57156fce54c95133bc Jun 06 13:10:58.701868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:10:58.701838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" event={"ID":"385fa8a1-3147-4d8d-b611-6a4b77080359","Type":"ContainerStarted","Data":"9433af29a525d982d553fce365f431d7e108225a117a8f57156fce54c95133bc"} Jun 06 13:11:00.714528 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:00.714490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" event={"ID":"385fa8a1-3147-4d8d-b611-6a4b77080359","Type":"ContainerStarted","Data":"a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b"} Jun 06 13:11:00.714913 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:00.714625 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:00.730025 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:00.729980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" podStartSLOduration=2.085903593 podStartE2EDuration="3.729965518s" totalImagesPullingTime="1.644061925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:00.728896157 +0000 UTC m=+565.795993504" watchObservedRunningTime="2026-06-06 13:11:00.729965518 +0000 UTC m=+565.797062864" Jun 06 13:11:05.686066 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:05.686030 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zhjpx" Jun 06 13:11:09.136660 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.136615 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56f6bbdcb4-dv7nm" podUID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" containerName="console" containerID="cri-o://3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d" gracePeriod=15 Jun 06 13:11:09.393680 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.393622 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:11:09.403824 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.403797 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.403910 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.403869 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.403952 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.403909 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.403997 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.403952 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.403997 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.403980 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnf8j\" (UniqueName: \"kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.404091 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404003 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.404091 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404037 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert\") pod \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\" (UID: \"e04821b3-8319-4dfb-bf10-f13cb09eaf81\") " Jun 06 13:11:09.404228 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404132 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config" (OuterVolumeSpecName: "console-config") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:11:09.404352 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404322 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.404473 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404377 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca" (OuterVolumeSpecName: "service-ca") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:11:09.404473 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404391 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:11:09.404656 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.404626 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:11:09.406281 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.406258 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:11:09.406281 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.406251 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j" (OuterVolumeSpecName: "kube-api-access-hnf8j") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "kube-api-access-hnf8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:09.406409 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.406292 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e04821b3-8319-4dfb-bf10-f13cb09eaf81" (UID: "e04821b3-8319-4dfb-bf10-f13cb09eaf81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 13:11:09.504718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504677 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-oauth-config\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.504718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504708 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-service-ca\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.504718 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504721 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-trusted-ca-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.504950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504734 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnf8j\" (UniqueName: \"kubernetes.io/projected/e04821b3-8319-4dfb-bf10-f13cb09eaf81-kube-api-access-hnf8j\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.504950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504746 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04821b3-8319-4dfb-bf10-f13cb09eaf81-console-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.504950 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.504759 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e04821b3-8319-4dfb-bf10-f13cb09eaf81-oauth-serving-cert\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:09.766097 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.766064 2560 generic.go:356] "Generic (PLEG): container finished" podID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" containerID="3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d" exitCode=0 Jun 06 13:11:09.766263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.766125 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6bbdcb4-dv7nm" Jun 06 13:11:09.766263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.766148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6bbdcb4-dv7nm" event={"ID":"e04821b3-8319-4dfb-bf10-f13cb09eaf81","Type":"ContainerDied","Data":"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d"} Jun 06 13:11:09.766263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.766199 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6bbdcb4-dv7nm" event={"ID":"e04821b3-8319-4dfb-bf10-f13cb09eaf81","Type":"ContainerDied","Data":"14ff0d66eac37fd74afea6331e0c956d30071bd844d2503b644943aff473bd6d"} Jun 06 13:11:09.766263 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.766221 2560 scope.go:117] "RemoveContainer" containerID="3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d" Jun 06 13:11:09.775922 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.775908 2560 scope.go:117] "RemoveContainer" containerID="3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d" Jun 06 13:11:09.776179 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:09.776162 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d\": container with ID starting with 3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d not found: ID does not exist" containerID="3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d" Jun 06 13:11:09.776242 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.776185 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d"} err="failed to get container status \"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d\": rpc error: code = NotFound desc = could not find container \"3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d\": container with ID starting with 3b3dca6ea774f28ed825966493b7dcf1255d565b7f0c7c7ee7ab1521b31ff36d not found: ID does not exist" Jun 06 13:11:09.789357 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.789335 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:11:09.793005 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:09.792986 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f6bbdcb4-dv7nm"] Jun 06 13:11:11.373305 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:11.373273 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" path="/var/lib/kubelet/pods/e04821b3-8319-4dfb-bf10-f13cb09eaf81/volumes" Jun 06 13:11:11.722301 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:11.722219 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:13.803293 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.803261 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc"] Jun 06 13:11:13.803768 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.803456 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" containerName="manager" containerID="cri-o://a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b" gracePeriod=2 Jun 06 13:11:13.806320 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:13.806266 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:13.809039 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.808955 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc"] Jun 06 13:11:13.850749 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.850719 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq"] Jun 06 13:11:13.851071 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851059 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" containerName="console" Jun 06 13:11:13.851127 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851073 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" containerName="console" Jun 06 13:11:13.851127 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851082 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" containerName="manager" Jun 06 13:11:13.851127 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851088 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" containerName="manager" Jun 06 13:11:13.851220 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851170 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e04821b3-8319-4dfb-bf10-f13cb09eaf81" containerName="console" Jun 06 13:11:13.851220 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.851179 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" containerName="manager" Jun 06 13:11:13.854381 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.854364 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:13.879480 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.878470 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq"] Jun 06 13:11:13.907719 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:13.907676 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:13.937931 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:13.937903 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snw6\" (UniqueName: \"kubernetes.io/projected/d96f69b4-06c7-42de-93a2-e27c5e817957-kube-api-access-8snw6\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2rq\" (UID: \"d96f69b4-06c7-42de-93a2-e27c5e817957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:14.038409 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.038376 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snw6\" (UniqueName: \"kubernetes.io/projected/d96f69b4-06c7-42de-93a2-e27c5e817957-kube-api-access-8snw6\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2rq\" (UID: \"d96f69b4-06c7-42de-93a2-e27c5e817957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:14.043608 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.043587 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:14.045589 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:14.045565 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:14.051624 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.051605 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snw6\" (UniqueName: \"kubernetes.io/projected/d96f69b4-06c7-42de-93a2-e27c5e817957-kube-api-access-8snw6\") pod \"limitador-operator-controller-manager-859d7b78bd-cs2rq\" (UID: \"d96f69b4-06c7-42de-93a2-e27c5e817957\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:14.139584 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.139500 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59bjd\" (UniqueName: \"kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd\") pod \"385fa8a1-3147-4d8d-b611-6a4b77080359\" (UID: \"385fa8a1-3147-4d8d-b611-6a4b77080359\") " Jun 06 13:11:14.141542 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.141516 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd" (OuterVolumeSpecName: "kube-api-access-59bjd") pod "385fa8a1-3147-4d8d-b611-6a4b77080359" (UID: "385fa8a1-3147-4d8d-b611-6a4b77080359"). InnerVolumeSpecName "kube-api-access-59bjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:11:14.188541 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.188502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:14.240710 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.240676 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59bjd\" (UniqueName: \"kubernetes.io/projected/385fa8a1-3147-4d8d-b611-6a4b77080359-kube-api-access-59bjd\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:11:14.320982 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.320956 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq"] Jun 06 13:11:14.322688 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:11:14.322658 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96f69b4_06c7_42de_93a2_e27c5e817957.slice/crio-f29c38c9471f534c4267d2220cfcee870ce3e8ee6db34e6df472384635503c44 WatchSource:0}: Error finding container f29c38c9471f534c4267d2220cfcee870ce3e8ee6db34e6df472384635503c44: Status 404 returned error can't find the container with id f29c38c9471f534c4267d2220cfcee870ce3e8ee6db34e6df472384635503c44 Jun 06 13:11:14.796798 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.796761 2560 generic.go:356] "Generic (PLEG): container finished" podID="385fa8a1-3147-4d8d-b611-6a4b77080359" containerID="a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b" exitCode=0 Jun 06 13:11:14.796989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.796808 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:14.796989 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.796872 2560 scope.go:117] "RemoveContainer" containerID="a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b" Jun 06 13:11:14.798641 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.798609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" event={"ID":"d96f69b4-06c7-42de-93a2-e27c5e817957","Type":"ContainerStarted","Data":"5ea1c2a85f10e5c359bd13b838b408f72f5d216a3cac87b3fd4f7c4c4b203067"} Jun 06 13:11:14.798760 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.798680 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:14.798760 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.798706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" event={"ID":"d96f69b4-06c7-42de-93a2-e27c5e817957","Type":"ContainerStarted","Data":"f29c38c9471f534c4267d2220cfcee870ce3e8ee6db34e6df472384635503c44"} Jun 06 13:11:14.799216 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:14.799093 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:14.807239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.807056 2560 scope.go:117] "RemoveContainer" containerID="a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b" Jun 06 13:11:14.807458 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:14.807348 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b\": container with ID starting with a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b not found: ID does not exist" containerID="a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b" Jun 06 13:11:14.807458 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.807375 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b"} err="failed to get container status \"a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b\": rpc error: code = NotFound desc = could not find container \"a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b\": container with ID starting with a007303eb98e3a81e2581d7d9ff0752d403247e1427070f2a98e5dadb6873f6b not found: ID does not exist" Jun 06 13:11:14.822711 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:14.822678 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:14.823082 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:14.823045 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" podStartSLOduration=1.8230337840000002 podStartE2EDuration="1.823033784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:11:14.820688979 +0000 UTC m=+579.887786326" watchObservedRunningTime="2026-06-06 13:11:14.823033784 +0000 UTC m=+579.890131130" Jun 06 13:11:14.824835 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:14.824810 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:15.373226 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:11:15.373190 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-r2hkc\" is forbidden: User \"system:node:ip-10-0-140-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-166.ec2.internal' and this object" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r2hkc" Jun 06 13:11:15.373905 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:15.373884 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385fa8a1-3147-4d8d-b611-6a4b77080359" path="/var/lib/kubelet/pods/385fa8a1-3147-4d8d-b611-6a4b77080359/volumes" Jun 06 13:11:25.808136 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:25.808086 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cs2rq" Jun 06 13:11:35.372827 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:35.372800 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:11:35.374247 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:35.374226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:11:35.381254 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:35.381237 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:11:35.382296 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:35.382276 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:11:59.485919 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.485844 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:11:59.489185 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.489166 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.491623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.491601 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 13:11:59.491623 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.491620 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-948qg\"" Jun 06 13:11:59.498115 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.498075 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:11:59.585170 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.585136 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:11:59.626075 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.626035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4w9\" (UniqueName: \"kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.626241 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.626091 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.727427 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.727393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.727612 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.727554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4w9\" (UniqueName: \"kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.728057 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.728034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.736299 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.736244 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4w9\" (UniqueName: \"kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9\") pod \"limitador-limitador-64c94fd64f-gh4hr\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.800825 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.800799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:11:59.935868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:11:59.935842 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:11:59.937549 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:11:59.937524 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171d62be_0dc5_4d27_a967_633a957757af.slice/crio-9246b02e5182fbcaae9dd457d281ee57c5f9a719b7f807d711227339fc2996de WatchSource:0}: Error finding container 9246b02e5182fbcaae9dd457d281ee57c5f9a719b7f807d711227339fc2996de: Status 404 returned error can't find the container with id 9246b02e5182fbcaae9dd457d281ee57c5f9a719b7f807d711227339fc2996de Jun 06 13:12:00.041641 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:00.041555 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" event={"ID":"171d62be-0dc5-4d27-a967-633a957757af","Type":"ContainerStarted","Data":"9246b02e5182fbcaae9dd457d281ee57c5f9a719b7f807d711227339fc2996de"} Jun 06 13:12:03.061969 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:03.061937 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" event={"ID":"171d62be-0dc5-4d27-a967-633a957757af","Type":"ContainerStarted","Data":"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a"} Jun 06 13:12:03.062349 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:03.061999 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:12:03.077813 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:03.077771 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" podStartSLOduration=1.462591701 podStartE2EDuration="4.077757038s" totalImagesPullingTime="2.615165337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:12:03.077284529 +0000 UTC m=+628.144381876" watchObservedRunningTime="2026-06-06 13:12:03.077757038 +0000 UTC m=+628.144854385" Jun 06 13:12:14.069015 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:14.068986 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:12:16.128381 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:16.128351 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:12:16.128819 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:16.128524 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" podUID="171d62be-0dc5-4d27-a967-633a957757af" containerName="limitador" containerID="cri-o://b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a" gracePeriod=30 Jun 06 13:12:17.076676 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.076649 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:12:17.145706 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.145678 2560 generic.go:356] "Generic (PLEG): container finished" podID="171d62be-0dc5-4d27-a967-633a957757af" containerID="b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a" exitCode=0 Jun 06 13:12:17.146078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.145715 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" Jun 06 13:12:17.146078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.145715 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" event={"ID":"171d62be-0dc5-4d27-a967-633a957757af","Type":"ContainerDied","Data":"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a"} Jun 06 13:12:17.146078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.145805 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gh4hr" event={"ID":"171d62be-0dc5-4d27-a967-633a957757af","Type":"ContainerDied","Data":"9246b02e5182fbcaae9dd457d281ee57c5f9a719b7f807d711227339fc2996de"} Jun 06 13:12:17.146078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.145868 2560 scope.go:117] "RemoveContainer" containerID="b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a" Jun 06 13:12:17.154741 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.154723 2560 scope.go:117] "RemoveContainer" containerID="b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a" Jun 06 13:12:17.155003 ip-10-0-140-166 kubenswrapper[2560]: E0606 13:12:17.154980 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a\": container with ID starting with b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a not found: ID does not exist" containerID="b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a" Jun 06 13:12:17.155066 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.155023 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a"} err="failed to get container status \"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a\": rpc error: code = NotFound desc = could not find container \"b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a\": container with ID starting with b0a1817a793c26c95022615f49c31b277671219366ecabc4e676ea267862c24a not found: ID does not exist" Jun 06 13:12:17.167394 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.167376 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file\") pod \"171d62be-0dc5-4d27-a967-633a957757af\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " Jun 06 13:12:17.167512 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.167497 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz4w9\" (UniqueName: \"kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9\") pod \"171d62be-0dc5-4d27-a967-633a957757af\" (UID: \"171d62be-0dc5-4d27-a967-633a957757af\") " Jun 06 13:12:17.167695 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.167675 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file" (OuterVolumeSpecName: "config-file") pod "171d62be-0dc5-4d27-a967-633a957757af" (UID: "171d62be-0dc5-4d27-a967-633a957757af"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 13:12:17.169310 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.169290 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9" (OuterVolumeSpecName: "kube-api-access-jz4w9") pod "171d62be-0dc5-4d27-a967-633a957757af" (UID: "171d62be-0dc5-4d27-a967-633a957757af"). InnerVolumeSpecName "kube-api-access-jz4w9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:12:17.268455 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.268430 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz4w9\" (UniqueName: \"kubernetes.io/projected/171d62be-0dc5-4d27-a967-633a957757af-kube-api-access-jz4w9\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:12:17.268455 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.268454 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/171d62be-0dc5-4d27-a967-633a957757af-config-file\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:12:17.461354 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.461327 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:12:17.469000 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:17.468974 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gh4hr"] Jun 06 13:12:18.570690 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.570655 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn"] Jun 06 13:12:18.571182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.570998 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="171d62be-0dc5-4d27-a967-633a957757af" containerName="limitador" Jun 06 13:12:18.571182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.571009 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="171d62be-0dc5-4d27-a967-633a957757af" containerName="limitador" Jun 06 13:12:18.571182 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.571068 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="171d62be-0dc5-4d27-a967-633a957757af" containerName="limitador" Jun 06 13:12:18.575408 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.575389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.577816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.577798 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 06 13:12:18.577816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.577810 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 06 13:12:18.578003 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.577913 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-xzjpv\"" Jun 06 13:12:18.578915 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.578887 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 06 13:12:18.582239 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.582220 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn"] Jun 06 13:12:18.681142 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.681093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rxsb\" (UniqueName: \"kubernetes.io/projected/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-kube-api-access-8rxsb\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.681339 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.681203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-data\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.782031 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.781994 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rxsb\" (UniqueName: \"kubernetes.io/projected/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-kube-api-access-8rxsb\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.782245 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.782051 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-data\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.782439 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.782422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-data\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.790186 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.790155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rxsb\" (UniqueName: \"kubernetes.io/projected/e9f9da4a-8db6-4344-bfdc-8ff4688145e4-kube-api-access-8rxsb\") pod \"postgres-69fb4594cf-pj6hn\" (UID: \"e9f9da4a-8db6-4344-bfdc-8ff4688145e4\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:18.887020 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:18.886947 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:19.014813 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:19.014788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn"] Jun 06 13:12:19.016413 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:12:19.016382 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f9da4a_8db6_4344_bfdc_8ff4688145e4.slice/crio-851af658093f71c5a440babde983924033b47884fe9a0fa63b4219c6bb89f8a0 WatchSource:0}: Error finding container 851af658093f71c5a440babde983924033b47884fe9a0fa63b4219c6bb89f8a0: Status 404 returned error can't find the container with id 851af658093f71c5a440babde983924033b47884fe9a0fa63b4219c6bb89f8a0 Jun 06 13:12:19.161194 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:19.161083 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" event={"ID":"e9f9da4a-8db6-4344-bfdc-8ff4688145e4","Type":"ContainerStarted","Data":"851af658093f71c5a440babde983924033b47884fe9a0fa63b4219c6bb89f8a0"} Jun 06 13:12:19.375113 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:19.375078 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="171d62be-0dc5-4d27-a967-633a957757af" path="/var/lib/kubelet/pods/171d62be-0dc5-4d27-a967-633a957757af/volumes" Jun 06 13:12:26.202346 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:26.202311 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" event={"ID":"e9f9da4a-8db6-4344-bfdc-8ff4688145e4","Type":"ContainerStarted","Data":"a614a523ee3c2cbda010c533087333342185d9195ae9e2779ed3690aee1f7628"} Jun 06 13:12:26.202720 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:26.202432 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:26.218410 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:26.218365 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" podStartSLOduration=1.715954081 podStartE2EDuration="8.218350332s" totalImagesPullingTime="6.502396251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:12:26.215997765 +0000 UTC m=+651.283095121" watchObservedRunningTime="2026-06-06 13:12:26.218350332 +0000 UTC m=+651.285447678" Jun 06 13:12:32.242173 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:32.242073 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-pj6hn" Jun 06 13:12:33.560938 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.560903 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx"] Jun 06 13:12:33.567720 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.567700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.571163 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.571139 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 06 13:12:33.571292 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.571159 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 06 13:12:33.571292 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.571140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jgn7x\"" Jun 06 13:12:33.573308 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.573286 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx"] Jun 06 13:12:33.717572 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.717544 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.717754 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.717586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs9lm\" (UniqueName: \"kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.717754 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.717609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.818868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.818788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.818868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.818833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs9lm\" (UniqueName: \"kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.818868 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.818855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.819233 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.819212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.819282 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.819244 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.827562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.827532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs9lm\" (UniqueName: \"kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:33.878367 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:33.878342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:34.011479 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:34.011453 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx"] Jun 06 13:12:34.012493 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:12:34.012471 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea003a6_8a3f_481c_be1c_f7514c17c2de.slice/crio-2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8 WatchSource:0}: Error finding container 2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8: Status 404 returned error can't find the container with id 2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8 Jun 06 13:12:34.253634 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:34.253599 2560 generic.go:356] "Generic (PLEG): container finished" podID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerID="9d40451678b2f0bdf8307b32d0aee9d98e8c7133283d6c8f9891963c4e73a88d" exitCode=0 Jun 06 13:12:34.253802 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:34.253684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" event={"ID":"3ea003a6-8a3f-481c-be1c-f7514c17c2de","Type":"ContainerDied","Data":"9d40451678b2f0bdf8307b32d0aee9d98e8c7133283d6c8f9891963c4e73a88d"} Jun 06 13:12:34.253802 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:34.253734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" event={"ID":"3ea003a6-8a3f-481c-be1c-f7514c17c2de","Type":"ContainerStarted","Data":"2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8"} Jun 06 13:12:35.261495 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:35.261463 2560 generic.go:356] "Generic (PLEG): container finished" podID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerID="4d5bd66bd11f9fb3b65d46bb14adaa8a81065465d0e2cdc9248ec43c8f9c861e" exitCode=0 Jun 06 13:12:35.261846 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:35.261533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" event={"ID":"3ea003a6-8a3f-481c-be1c-f7514c17c2de","Type":"ContainerDied","Data":"4d5bd66bd11f9fb3b65d46bb14adaa8a81065465d0e2cdc9248ec43c8f9c861e"} Jun 06 13:12:36.269609 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:36.269572 2560 generic.go:356] "Generic (PLEG): container finished" podID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerID="bdd9588400b0ab6bc9657918b030ab52645363e1fc8e99425c90c54cb04da60c" exitCode=0 Jun 06 13:12:36.269981 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:36.269664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" event={"ID":"3ea003a6-8a3f-481c-be1c-f7514c17c2de","Type":"ContainerDied","Data":"bdd9588400b0ab6bc9657918b030ab52645363e1fc8e99425c90c54cb04da60c"} Jun 06 13:12:37.414550 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.414525 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:37.550576 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.550482 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle\") pod \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " Jun 06 13:12:37.550576 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.550536 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs9lm\" (UniqueName: \"kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm\") pod \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " Jun 06 13:12:37.550792 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.550608 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util\") pod \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\" (UID: \"3ea003a6-8a3f-481c-be1c-f7514c17c2de\") " Jun 06 13:12:37.551078 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.551044 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle" (OuterVolumeSpecName: "bundle") pod "3ea003a6-8a3f-481c-be1c-f7514c17c2de" (UID: "3ea003a6-8a3f-481c-be1c-f7514c17c2de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:12:37.552660 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.552622 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm" (OuterVolumeSpecName: "kube-api-access-cs9lm") pod "3ea003a6-8a3f-481c-be1c-f7514c17c2de" (UID: "3ea003a6-8a3f-481c-be1c-f7514c17c2de"). InnerVolumeSpecName "kube-api-access-cs9lm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 13:12:37.558358 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.558311 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util" (OuterVolumeSpecName: "util") pod "3ea003a6-8a3f-481c-be1c-f7514c17c2de" (UID: "3ea003a6-8a3f-481c-be1c-f7514c17c2de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 13:12:37.651471 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.651438 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-bundle\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:12:37.651471 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.651462 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs9lm\" (UniqueName: \"kubernetes.io/projected/3ea003a6-8a3f-481c-be1c-f7514c17c2de-kube-api-access-cs9lm\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:12:37.651471 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:37.651473 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ea003a6-8a3f-481c-be1c-f7514c17c2de-util\") on node \"ip-10-0-140-166.ec2.internal\" DevicePath \"\"" Jun 06 13:12:38.282862 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:38.282836 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" Jun 06 13:12:38.283028 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:38.282870 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748jgwjx" event={"ID":"3ea003a6-8a3f-481c-be1c-f7514c17c2de","Type":"ContainerDied","Data":"2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8"} Jun 06 13:12:38.283028 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:38.282914 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2182a3c23debf96ddd1f93c41c778ffd5148cf1304d4fa55df0f89a0101f34f8" Jun 06 13:12:40.787489 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787455 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfcn5"] Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787801 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="pull" Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787811 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="pull" Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787829 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="extract" Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787834 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="extract" Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787843 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="util" Jun 06 13:12:40.787848 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787849 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="util" Jun 06 13:12:40.788037 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.787907 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea003a6-8a3f-481c-be1c-f7514c17c2de" containerName="extract" Jun 06 13:12:40.789983 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.789967 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" Jun 06 13:12:40.792717 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.792688 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 13:12:40.793522 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.793504 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 13:12:40.793599 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.793519 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-xpv6k\"" Jun 06 13:12:40.797948 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.797930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfcn5"] Jun 06 13:12:40.880345 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.880315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfxr\" (UniqueName: \"kubernetes.io/projected/593bc9b3-01b8-437d-a7f3-b5de2f77f2c4-kube-api-access-tkfxr\") pod \"keycloak-operator-d67dbbb48-gfcn5\" (UID: \"593bc9b3-01b8-437d-a7f3-b5de2f77f2c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" Jun 06 13:12:40.981289 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.981254 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfxr\" (UniqueName: \"kubernetes.io/projected/593bc9b3-01b8-437d-a7f3-b5de2f77f2c4-kube-api-access-tkfxr\") pod \"keycloak-operator-d67dbbb48-gfcn5\" (UID: \"593bc9b3-01b8-437d-a7f3-b5de2f77f2c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" Jun 06 13:12:40.991719 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:40.991694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfxr\" (UniqueName: \"kubernetes.io/projected/593bc9b3-01b8-437d-a7f3-b5de2f77f2c4-kube-api-access-tkfxr\") pod \"keycloak-operator-d67dbbb48-gfcn5\" (UID: \"593bc9b3-01b8-437d-a7f3-b5de2f77f2c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" Jun 06 13:12:41.101290 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:41.101207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" Jun 06 13:12:41.439348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:41.439321 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfcn5"] Jun 06 13:12:41.440652 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:12:41.440628 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593bc9b3_01b8_437d_a7f3_b5de2f77f2c4.slice/crio-1c65fa243d50ae2db94df87835c3d8f3e98c9d0f13ca4aa813959a7cfa99f51e WatchSource:0}: Error finding container 1c65fa243d50ae2db94df87835c3d8f3e98c9d0f13ca4aa813959a7cfa99f51e: Status 404 returned error can't find the container with id 1c65fa243d50ae2db94df87835c3d8f3e98c9d0f13ca4aa813959a7cfa99f51e Jun 06 13:12:42.307799 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:42.307759 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" event={"ID":"593bc9b3-01b8-437d-a7f3-b5de2f77f2c4","Type":"ContainerStarted","Data":"1c65fa243d50ae2db94df87835c3d8f3e98c9d0f13ca4aa813959a7cfa99f51e"} Jun 06 13:12:47.338987 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:47.338939 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" event={"ID":"593bc9b3-01b8-437d-a7f3-b5de2f77f2c4","Type":"ContainerStarted","Data":"59689f4dc7fb455487976e17baf899026ff4e5741a4912fadd094080eb24274b"} Jun 06 13:12:47.356625 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:12:47.356579 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-gfcn5" podStartSLOduration=1.85784716 podStartE2EDuration="7.356563722s" totalImagesPullingTime="5.498716562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:12:47.354754321 +0000 UTC m=+672.421851681" watchObservedRunningTime="2026-06-06 13:12:47.356563722 +0000 UTC m=+672.423661068" Jun 06 13:14:06.035311 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.035268 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5n86l"] Jun 06 13:14:06.038191 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.038167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:06.040882 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.040860 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bkjn7\"" Jun 06 13:14:06.041051 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.041035 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 06 13:14:06.047851 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.047823 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5n86l"] Jun 06 13:14:06.090584 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.090548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2d4\" (UniqueName: \"kubernetes.io/projected/8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f-kube-api-access-zj2d4\") pod \"payload-pre-processing-67d7689b65-5n86l\" (UID: \"8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:06.191644 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.191609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2d4\" (UniqueName: \"kubernetes.io/projected/8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f-kube-api-access-zj2d4\") pod \"payload-pre-processing-67d7689b65-5n86l\" (UID: \"8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:06.199337 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.199308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2d4\" (UniqueName: \"kubernetes.io/projected/8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f-kube-api-access-zj2d4\") pod \"payload-pre-processing-67d7689b65-5n86l\" (UID: \"8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:06.350598 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.350505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:06.481505 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.481481 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-5n86l"] Jun 06 13:14:06.482860 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:14:06.482831 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3e5cd9_3ed6_4fbf_8c8a_9171880b334f.slice/crio-a58cf2765be510858d67ff2e97450c54485b7e56e7bec7876ca0f4c46da35a2a WatchSource:0}: Error finding container a58cf2765be510858d67ff2e97450c54485b7e56e7bec7876ca0f4c46da35a2a: Status 404 returned error can't find the container with id a58cf2765be510858d67ff2e97450c54485b7e56e7bec7876ca0f4c46da35a2a Jun 06 13:14:06.484707 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.484686 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 13:14:06.789262 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:06.789228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" event={"ID":"8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f","Type":"ContainerStarted","Data":"a58cf2765be510858d67ff2e97450c54485b7e56e7bec7876ca0f4c46da35a2a"} Jun 06 13:14:08.803428 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:08.803398 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" event={"ID":"8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f","Type":"ContainerStarted","Data":"01ffb8ac822d0964f7ef11a9870ba60230187d4fcd42414076d5c84320bfb66a"} Jun 06 13:14:08.803831 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:08.803489 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:14:08.818650 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:08.818613 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" podStartSLOduration=0.579646975 podStartE2EDuration="2.818600736s" totalImagesPullingTime="2.238953761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:14:08.816784967 +0000 UTC m=+753.883882315" watchObservedRunningTime="2026-06-06 13:14:08.818600736 +0000 UTC m=+753.885698138" Jun 06 13:14:19.811588 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:14:19.811553 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-5n86l" Jun 06 13:16:35.411319 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:16:35.411235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:16:35.415501 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:16:35.415480 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:16:35.425355 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:16:35.425328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:16:35.430151 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:16:35.430128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:18:50.521392 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.521362 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c58988875-mmld8"] Jun 06 13:18:50.525007 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.524986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.527682 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.527632 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 06 13:18:50.528842 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.528659 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 06 13:18:50.528842 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.528694 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vsf55\"" Jun 06 13:18:50.531872 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.531853 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c58988875-mmld8"] Jun 06 13:18:50.610015 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.609984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26e1b99-6c46-4460-b877-93421b96234b-webhook-cert\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.610202 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.610035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfx86\" (UniqueName: \"kubernetes.io/projected/e26e1b99-6c46-4460-b877-93421b96234b-kube-api-access-sfx86\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.711317 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.711284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfx86\" (UniqueName: \"kubernetes.io/projected/e26e1b99-6c46-4460-b877-93421b96234b-kube-api-access-sfx86\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.711482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.711380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26e1b99-6c46-4460-b877-93421b96234b-webhook-cert\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.713785 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.713756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e26e1b99-6c46-4460-b877-93421b96234b-webhook-cert\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.718591 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.718565 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfx86\" (UniqueName: \"kubernetes.io/projected/e26e1b99-6c46-4460-b877-93421b96234b-kube-api-access-sfx86\") pod \"maas-controller-5c58988875-mmld8\" (UID: \"e26e1b99-6c46-4460-b877-93421b96234b\") " pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.837839 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.837753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:50.970036 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:50.970013 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c58988875-mmld8"] Jun 06 13:18:50.972631 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:18:50.972604 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26e1b99_6c46_4460_b877_93421b96234b.slice/crio-a296bbc51c17e6cc128f864c385182fa49d8d4839e27526e0c35ea15b279080b WatchSource:0}: Error finding container a296bbc51c17e6cc128f864c385182fa49d8d4839e27526e0c35ea15b279080b: Status 404 returned error can't find the container with id a296bbc51c17e6cc128f864c385182fa49d8d4839e27526e0c35ea15b279080b Jun 06 13:18:51.400578 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:51.400547 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-mmld8" event={"ID":"e26e1b99-6c46-4460-b877-93421b96234b","Type":"ContainerStarted","Data":"a296bbc51c17e6cc128f864c385182fa49d8d4839e27526e0c35ea15b279080b"} Jun 06 13:18:53.415568 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:53.415530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c58988875-mmld8" event={"ID":"e26e1b99-6c46-4460-b877-93421b96234b","Type":"ContainerStarted","Data":"7527dc34b78acbab820c2c4ad67b0f9dafc8e0969804f8d509d565b5c7e89ebb"} Jun 06 13:18:53.416018 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:53.415606 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:18:53.431096 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:18:53.431051 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c58988875-mmld8" podStartSLOduration=1.716857275 podStartE2EDuration="3.431037245s" totalImagesPullingTime="1.71417997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 13:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:18:53.429736885 +0000 UTC m=+1038.496834231" watchObservedRunningTime="2026-06-06 13:18:53.431037245 +0000 UTC m=+1038.498134593" Jun 06 13:19:04.426490 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:19:04.426455 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c58988875-mmld8" Jun 06 13:21:35.454759 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:35.454726 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:21:35.462311 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:35.462285 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:21:35.463562 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:35.463540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:21:35.472084 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:35.472065 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l9qqc_22488cff-e21d-48b4-a2c0-218fc783318b/ovn-acl-logging/0.log" Jun 06 13:21:56.438622 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:56.438588 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cd8c57d44-h6j87_57405c89-d9cb-43bc-94c8-4ddf066d2735/nginx/0.log" Jun 06 13:21:56.557693 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:56.557647 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rkzdk_a1d463f9-d904-4971-8d3f-f85dc21a38d8/manager/0.log" Jun 06 13:21:56.676414 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:56.676375 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8mm8c_1b68d693-51ba-46e1-8023-1c8a2afddd27/manager/0.log" Jun 06 13:21:56.799790 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:56.799764 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c58988875-mmld8_e26e1b99-6c46-4460-b877-93421b96234b/manager/0.log" Jun 06 13:21:56.927479 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:56.927454 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-q85bd_77d4a9ab-6b9d-4eb8-beec-f2e9643e0425/server/0.log" Jun 06 13:21:57.045784 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:57.045754 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-v57ts_10bf269d-b47a-4a74-bdec-f37e88c04dd2/manager/0.log" Jun 06 13:21:57.287185 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:57.287159 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-kqxp8_bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa/manager/0.log" Jun 06 13:21:57.292538 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:57.292516 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-kqxp8_bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa/copy-manifests/0.log" Jun 06 13:21:58.234973 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.234941 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/util/0.log" Jun 06 13:21:58.240740 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.240703 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/pull/0.log" Jun 06 13:21:58.245934 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.245914 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/extract/0.log" Jun 06 13:21:58.358126 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.358080 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/util/0.log" Jun 06 13:21:58.363665 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.363645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/pull/0.log" Jun 06 13:21:58.369119 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.369085 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/extract/0.log" Jun 06 13:21:58.473734 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.473711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/util/0.log" Jun 06 13:21:58.479350 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.479325 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/pull/0.log" Jun 06 13:21:58.485248 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.485184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/extract/0.log" Jun 06 13:21:58.592649 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.592617 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/pull/0.log" Jun 06 13:21:58.599038 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.599019 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/extract/0.log" Jun 06 13:21:58.604273 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.604251 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/util/0.log" Jun 06 13:21:58.956409 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:58.956328 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zhjpx_c2329dba-9e85-4379-b099-fca94ea71b37/manager/0.log" Jun 06 13:21:59.536001 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:21:59.535963 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cs2rq_d96f69b4-06c7-42de-93a2-e27c5e817957/manager/0.log" Jun 06 13:22:00.010209 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:00.010176 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lxgx8_3ec52cf0-0411-4350-be19-a7fc9c6fe214/discovery/0.log" Jun 06 13:22:00.127741 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:00.127713 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c54f5f4-nrwl4_6696dbdd-8e3a-4733-9d0f-20533f9057a0/kube-auth-proxy/0.log" Jun 06 13:22:00.469698 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:00.469616 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5n86l_8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f/payload-pre-processing/0.log" Jun 06 13:22:00.689027 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:00.688999 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log" Jun 06 13:22:09.213488 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:09.213452 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rpdcb_69d08e50-2ea5-4861-9048-f6d616307aa6/global-pull-secret-syncer/0.log" Jun 06 13:22:09.359046 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:09.359016 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zs7vm_4df01c08-53a8-448c-bede-b1bdf3011c0e/konnectivity-agent/0.log" Jun 06 13:22:09.422181 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:09.422147 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-166.ec2.internal_4574fa384fd3b7e76e4c8c36e9cfabee/haproxy/0.log" Jun 06 13:22:12.626633 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:12.626603 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-v82bk_e1944846-3a21-4ef2-97eb-6d30cbf0e443/sail-operator/0.log" Jun 06 13:22:13.948442 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:13.948358 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/extract/0.log" Jun 06 13:22:13.972193 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:13.972163 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/util/0.log" Jun 06 13:22:13.994924 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:13.994902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dckmr_e2d33a33-528f-4376-b8b5-e4e4093bcc32/pull/0.log" Jun 06 13:22:14.036231 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.036205 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/extract/0.log" Jun 06 13:22:14.072640 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.072616 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/util/0.log" Jun 06 13:22:14.092157 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.092137 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0b7js7_1e2605a0-6538-471b-8a76-a845a81a97a1/pull/0.log" Jun 06 13:22:14.116525 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.116503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/extract/0.log" Jun 06 13:22:14.138242 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.138220 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/util/0.log" Jun 06 13:22:14.162860 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.162833 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d4cdc_5e5ceee0-9e07-4819-a81d-19617c66080e/pull/0.log" Jun 06 13:22:14.187789 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.187761 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/extract/0.log" Jun 06 13:22:14.213638 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.213579 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/util/0.log" Jun 06 13:22:14.235149 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.235127 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1svl8k_001eb25e-4297-4f0d-91ca-c93a953084b1/pull/0.log" Jun 06 13:22:14.379674 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.379643 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zhjpx_c2329dba-9e85-4379-b099-fca94ea71b37/manager/0.log" Jun 06 13:22:14.549124 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:14.549081 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cs2rq_d96f69b4-06c7-42de-93a2-e27c5e817957/manager/0.log" Jun 06 13:22:16.443572 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.443543 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-state-metrics/0.log" Jun 06 13:22:16.462516 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.462487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-rbac-proxy-main/0.log" Jun 06 13:22:16.481596 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.481564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-v4vs9_436d359b-65ea-43e2-a39f-0f7ec3808d75/kube-rbac-proxy-self/0.log" Jun 06 13:22:16.524445 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.524370 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-664c864c94-82ksd_00c0ac0b-3c64-4ba9-ab2a-8a0f24833bdf/metrics-server/0.log" Jun 06 13:22:16.663189 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.663156 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/node-exporter/0.log" Jun 06 13:22:16.684909 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.684874 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/kube-rbac-proxy/0.log" Jun 06 13:22:16.703729 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.703704 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgdxv_9de57963-c152-4830-8ccb-0acace388179/init-textfile/0.log" Jun 06 13:22:16.802637 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.802555 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/kube-rbac-proxy-main/0.log" Jun 06 13:22:16.827854 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.827830 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/kube-rbac-proxy-self/0.log" Jun 06 13:22:16.846482 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:16.846453 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-z66vv_9d1ac40a-0b2d-4069-bc3e-aaf0015381db/openshift-state-metrics/0.log" Jun 06 13:22:18.563325 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:18.563233 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c2gn7_63a99380-0a01-42b8-9b32-7c4c173abbf1/networking-console-plugin/0.log" Jun 06 13:22:19.185997 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.185960 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/1.log" Jun 06 13:22:19.196145 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.196094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-z7t94_36fb4002-c77e-4980-bb45-8751dcbe7755/console-operator/2.log" Jun 06 13:22:19.604065 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.604031 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45"] Jun 06 13:22:19.607497 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.607481 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.609754 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.609733 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m7bjs\"/\"default-dockercfg-7sktr\"" Jun 06 13:22:19.609893 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.609797 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m7bjs\"/\"kube-root-ca.crt\"" Jun 06 13:22:19.610735 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.610719 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m7bjs\"/\"openshift-service-ca.crt\"" Jun 06 13:22:19.615596 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.615575 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45"] Jun 06 13:22:19.712348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.712316 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-lib-modules\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.712532 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.712360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-proc\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.712532 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.712381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-podres\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.712532 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.712399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-sys\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.712532 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.712429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjq6s\" (UniqueName: \"kubernetes.io/projected/20d71185-34ca-4cec-99c2-7b5ce33b84d3-kube-api-access-jjq6s\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813338 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-lib-modules\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813508 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813353 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-proc\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813508 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813404 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-podres\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813508 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-proc\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813508 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-sys\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjq6s\" (UniqueName: \"kubernetes.io/projected/20d71185-34ca-4cec-99c2-7b5ce33b84d3-kube-api-access-jjq6s\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-sys\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-lib-modules\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.813643 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.813546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20d71185-34ca-4cec-99c2-7b5ce33b84d3-podres\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.820417 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.820388 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjq6s\" (UniqueName: \"kubernetes.io/projected/20d71185-34ca-4cec-99c2-7b5ce33b84d3-kube-api-access-jjq6s\") pod \"perf-node-gather-daemonset-rbn45\" (UID: \"20d71185-34ca-4cec-99c2-7b5ce33b84d3\") " pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:19.918956 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:19.918880 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:20.048911 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.048884 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45"] Jun 06 13:22:20.051184 ip-10-0-140-166 kubenswrapper[2560]: W0606 13:22:20.051156 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod20d71185_34ca_4cec_99c2_7b5ce33b84d3.slice/crio-a80f3b2df25f4a2c0f3df4ee750847b43fc294e3a9937d1b563b61338eb4a589 WatchSource:0}: Error finding container a80f3b2df25f4a2c0f3df4ee750847b43fc294e3a9937d1b563b61338eb4a589: Status 404 returned error can't find the container with id a80f3b2df25f4a2c0f3df4ee750847b43fc294e3a9937d1b563b61338eb4a589 Jun 06 13:22:20.475326 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.475289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hj9qw_36c0c4e5-bc25-4bcc-8500-7e8c3f9de55b/volume-data-source-validator/0.log" Jun 06 13:22:20.584899 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.584860 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" event={"ID":"20d71185-34ca-4cec-99c2-7b5ce33b84d3","Type":"ContainerStarted","Data":"1a97a7ef32835bb729a1f1264fe1dafd8d0bb3ebf1f06336a975c73a2bb6cfa9"} Jun 06 13:22:20.585070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.584953 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:20.585070 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.584977 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" event={"ID":"20d71185-34ca-4cec-99c2-7b5ce33b84d3","Type":"ContainerStarted","Data":"a80f3b2df25f4a2c0f3df4ee750847b43fc294e3a9937d1b563b61338eb4a589"} Jun 06 13:22:20.598945 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:20.598883 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" podStartSLOduration=1.598864267 podStartE2EDuration="1.598864267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 13:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 13:22:20.598326279 +0000 UTC m=+1245.665423625" watchObservedRunningTime="2026-06-06 13:22:20.598864267 +0000 UTC m=+1245.665961617" Jun 06 13:22:21.683057 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:21.683021 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wl8b6_3c629622-118c-4d37-b8de-9776c6bc2ce9/dns/0.log" Jun 06 13:22:21.703261 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:21.703225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wl8b6_3c629622-118c-4d37-b8de-9776c6bc2ce9/kube-rbac-proxy/0.log" Jun 06 13:22:21.766216 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:21.766186 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lrvwh_37551d62-2bb9-4b80-bcb0-a349529e9c41/dns-node-resolver/0.log" Jun 06 13:22:22.302565 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:22.302531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nchz_b9b4178c-f6e9-4b57-bd69-2ebc27923c2e/node-ca/0.log" Jun 06 13:22:23.315780 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:23.315747 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lxgx8_3ec52cf0-0411-4350-be19-a7fc9c6fe214/discovery/0.log" Jun 06 13:22:23.335869 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:23.335847 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c54f5f4-nrwl4_6696dbdd-8e3a-4733-9d0f-20533f9057a0/kube-auth-proxy/0.log" Jun 06 13:22:23.426925 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:23.426893 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5n86l_8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f/payload-pre-processing/0.log" Jun 06 13:22:23.482979 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:23.482959 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log" Jun 06 13:22:24.084766 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:24.084715 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9gg4_be491cdc-5209-406a-a52d-4ef3da74d838/serve-healthcheck-canary/0.log" Jun 06 13:22:24.661608 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:24.661578 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdpbv_f13133f6-2165-4cf9-9e58-421148bb9518/kube-rbac-proxy/0.log" Jun 06 13:22:24.680316 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:24.680292 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdpbv_f13133f6-2165-4cf9-9e58-421148bb9518/exporter/0.log" Jun 06 13:22:24.702174 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:24.702149 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sdpbv_f13133f6-2165-4cf9-9e58-421148bb9518/extractor/0.log" Jun 06 13:22:26.601351 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:26.601316 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m7bjs/perf-node-gather-daemonset-rbn45" Jun 06 13:22:26.973195 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:26.973091 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6cd8c57d44-h6j87_57405c89-d9cb-43bc-94c8-4ddf066d2735/nginx/0.log" Jun 06 13:22:27.000816 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.000788 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-rkzdk_a1d463f9-d904-4971-8d3f-f85dc21a38d8/manager/0.log" Jun 06 13:22:27.062090 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.062054 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-8mm8c_1b68d693-51ba-46e1-8023-1c8a2afddd27/manager/0.log" Jun 06 13:22:27.091559 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.091530 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c58988875-mmld8_e26e1b99-6c46-4460-b877-93421b96234b/manager/0.log" Jun 06 13:22:27.108774 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.108746 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-q85bd_77d4a9ab-6b9d-4eb8-beec-f2e9643e0425/server/0.log" Jun 06 13:22:27.174760 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.174733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-v57ts_10bf269d-b47a-4a74-bdec-f37e88c04dd2/manager/0.log" Jun 06 13:22:27.273253 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.273225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-kqxp8_bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa/manager/0.log" Jun 06 13:22:27.290924 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:27.290899 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58dc9788b4-kqxp8_bda2c87e-5e92-43a8-a1c6-5127b6eeb7aa/copy-manifests/0.log" Jun 06 13:22:33.466529 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.466501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lxgx8_3ec52cf0-0411-4350-be19-a7fc9c6fe214/discovery/0.log" Jun 06 13:22:33.479305 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.479283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c54f5f4-nrwl4_6696dbdd-8e3a-4733-9d0f-20533f9057a0/kube-auth-proxy/0.log" Jun 06 13:22:33.548966 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.548939 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5n86l_8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f/payload-pre-processing/0.log" Jun 06 13:22:33.594426 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.594400 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log" Jun 06 13:22:33.944853 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.944815 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sctb9_d28883ef-f3e2-4c58-a2a7-caad82cd3279/migrator/0.log" Jun 06 13:22:33.965123 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:33.965073 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sctb9_d28883ef-f3e2-4c58-a2a7-caad82cd3279/graceful-termination/0.log" Jun 06 13:22:34.678953 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:34.678921 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lxgx8_3ec52cf0-0411-4350-be19-a7fc9c6fe214/discovery/0.log" Jun 06 13:22:34.692894 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:34.692871 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c54f5f4-nrwl4_6696dbdd-8e3a-4733-9d0f-20533f9057a0/kube-auth-proxy/0.log" Jun 06 13:22:34.759329 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:34.759300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5n86l_8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f/payload-pre-processing/0.log" Jun 06 13:22:34.798592 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:34.798570 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log" Jun 06 13:22:35.411817 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.411788 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/kube-multus-additional-cni-plugins/0.log" Jun 06 13:22:35.432348 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.432322 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/egress-router-binary-copy/0.log" Jun 06 13:22:35.451917 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.451891 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/cni-plugins/0.log" Jun 06 13:22:35.470674 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.470654 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/bond-cni-plugin/0.log" Jun 06 13:22:35.490095 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.490076 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/routeoverride-cni/0.log" Jun 06 13:22:35.509879 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.509855 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/whereabouts-cni-bincopy/0.log" Jun 06 13:22:35.530666 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.530641 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvsxw_ed3c912c-e5fc-42d3-8974-7c0d16ad9ac1/whereabouts-cni/0.log" Jun 06 13:22:35.915091 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:35.915058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z9mxl_509cd412-0eb0-43db-aec3-4c8455909278/kube-multus/0.log" Jun 06 13:22:36.021684 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.021658 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mqp5b_c9383e3e-7bec-4060-bdce-025583c4600e/network-metrics-daemon/0.log" Jun 06 13:22:36.040282 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.040259 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mqp5b_c9383e3e-7bec-4060-bdce-025583c4600e/kube-rbac-proxy/0.log" Jun 06 13:22:36.363976 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.363947 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-lxgx8_3ec52cf0-0411-4350-be19-a7fc9c6fe214/discovery/0.log" Jun 06 13:22:36.373582 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.373551 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-567c54f5f4-nrwl4_6696dbdd-8e3a-4733-9d0f-20533f9057a0/kube-auth-proxy/0.log" Jun 06 13:22:36.437739 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.437706 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-5n86l_8f3e5cd9-3ed6-4fbf-8c8a-9171880b334f/payload-pre-processing/0.log" Jun 06 13:22:36.476405 ip-10-0-140-166 kubenswrapper[2560]: I0606 13:22:36.476386 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7959bd76fc-gp9zz_5587c9a1-e695-4ff2-8d23-e5e0a186d0d3/router/0.log"