Jun 05 20:56:07.387457 ip-10-0-140-154 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 20:56:07.387467 ip-10-0-140-154 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 20:56:07.387474 ip-10-0-140-154 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 20:56:07.387694 ip-10-0-140-154 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 20:56:17.432457 ip-10-0-140-154 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 20:56:17.432475 ip-10-0-140-154 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 17a08378ef8246778dd72b423d652234 -- Jun 05 20:58:49.806835 ip-10-0-140-154 systemd[1]: Starting Kubernetes Kubelet... Jun 05 20:58:50.224386 ip-10-0-140-154 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:50.224386 ip-10-0-140-154 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 20:58:50.224386 ip-10-0-140-154 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:50.224386 ip-10-0-140-154 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 20:58:50.224386 ip-10-0-140-154 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:58:50.225690 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.225538 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 20:58:50.229251 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229234 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.229251 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229250 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229255 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229259 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229263 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229265 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229268 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229271 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229273 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229281 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229284 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229287 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229290 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229292 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229295 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229298 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229301 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229303 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229306 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229309 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229312 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.229328 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229314 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229317 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229320 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229322 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229325 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229328 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229331 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229334 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229337 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229340 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229343 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229345 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229348 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229351 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229355 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229358 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229360 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229363 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229366 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229368 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.229863 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229371 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229373 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229376 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229378 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229381 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229384 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229386 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229389 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229391 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229394 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229397 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229399 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229401 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229404 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229408 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229411 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229414 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229417 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229445 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229449 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.230361 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229452 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229456 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229458 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229461 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229464 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229467 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229470 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229473 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229475 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229478 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229488 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229493 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229496 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229499 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229501 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229504 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229519 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229523 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.230874 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229527 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229531 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229534 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229538 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229541 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229545 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229548 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229553 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229556 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229559 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229562 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229565 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229567 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229570 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229573 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229575 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229578 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229581 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229583 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.231309 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.229586 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230295 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230303 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230306 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230309 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230312 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230315 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230318 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230321 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230323 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230326 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230329 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230332 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230334 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230337 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230340 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230342 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230345 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230348 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230350 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.231775 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230354 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230357 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230359 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230362 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230365 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230368 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230370 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230373 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230376 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230379 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230382 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230385 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230387 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230390 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230393 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230396 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230398 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230401 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230403 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.232303 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230407 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230410 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230413 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230416 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230419 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230422 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230425 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230428 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230430 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230435 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230439 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230441 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230445 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230448 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230451 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230454 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230457 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230459 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230462 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230464 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.232794 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230467 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230470 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230472 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230475 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230477 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230480 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230483 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230485 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230488 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230490 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230493 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230495 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230501 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230504 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230524 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230528 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230530 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230533 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230536 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.233286 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230539 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230541 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230544 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230547 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230549 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230552 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230558 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230561 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230563 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230566 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230568 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230571 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230574 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230576 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230579 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230582 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230584 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230588 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230591 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230594 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.233786 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230596 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230599 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230970 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230975 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230978 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230981 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230985 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230988 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230991 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230994 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230996 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.230999 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231002 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231005 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231008 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231011 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231013 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231017 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231024 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231027 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.234280 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231030 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231032 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231035 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231038 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231040 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231043 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231046 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231049 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231051 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231054 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231057 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231059 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231062 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231065 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231067 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231070 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231073 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231076 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231078 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231081 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.234785 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231084 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231087 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231089 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231092 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231094 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231097 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231100 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231102 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231105 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231108 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231112 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231114 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231117 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231119 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231122 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231124 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231127 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231130 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231132 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231135 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.235271 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231137 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231140 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231143 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231146 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231148 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231151 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231153 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231156 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231159 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231162 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231165 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231167 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231170 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231173 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231176 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231179 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231183 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231186 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231190 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.235771 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231194 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231197 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231199 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231204 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231206 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231209 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231212 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231215 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231218 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231223 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231226 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231229 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231232 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231235 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231238 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231241 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231244 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231247 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231250 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.236252 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231252 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231255 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231258 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231334 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231341 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231348 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231352 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231358 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231361 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231365 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231371 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231374 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231377 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231381 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231384 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231388 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231393 2555 flags.go:64] FLAG: --cgroup-root="" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231396 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231399 2555 flags.go:64] FLAG: --client-ca-file="" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231402 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231405 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231409 2555 flags.go:64] FLAG: --cluster-domain="" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231412 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 20:58:50.236728 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231415 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231419 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231422 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231426 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231429 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231432 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231436 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231439 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231442 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231445 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231449 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231452 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231456 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231459 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231463 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231466 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231469 2555 flags.go:64] FLAG: --enable-server="true" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231473 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231479 2555 flags.go:64] FLAG: --event-burst="100" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231482 2555 flags.go:64] FLAG: --event-qps="50" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231485 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231488 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231491 2555 flags.go:64] FLAG: --eviction-hard="" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231495 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 20:58:50.237286 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231498 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231503 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231520 2555 flags.go:64] FLAG: --eviction-soft="" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231523 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231526 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231529 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231533 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231536 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231539 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231542 2555 flags.go:64] FLAG: --feature-gates="" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231546 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231550 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231553 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231556 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231559 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231562 2555 flags.go:64] FLAG: --help="false" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231565 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231569 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231575 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231578 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231581 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231585 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231588 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 20:58:50.237933 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231591 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231594 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231597 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231601 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231604 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231608 2555 flags.go:64] FLAG: --kube-reserved="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231611 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231614 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231617 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231620 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231624 2555 flags.go:64] FLAG: --lock-file="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231627 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231630 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231633 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231639 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231642 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231645 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231648 2555 flags.go:64] FLAG: --logging-format="text" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231651 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231654 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231657 2555 flags.go:64] FLAG: --manifest-url="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231660 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231664 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231667 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231671 2555 flags.go:64] FLAG: --max-pods="110" Jun 05 20:58:50.238687 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231674 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231677 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231681 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231684 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231687 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231690 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231693 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231705 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231709 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231712 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231715 2555 flags.go:64] FLAG: --pod-cidr="" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231719 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231725 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231728 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231731 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231734 2555 flags.go:64] FLAG: --port="10250" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231737 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231742 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064b50f7769e8e9cf" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231746 2555 flags.go:64] FLAG: --qos-reserved="" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231749 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231752 2555 flags.go:64] FLAG: --register-node="true" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231755 2555 flags.go:64] FLAG: --register-with-taints="" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231758 2555 flags.go:64] FLAG: --registry-burst="10" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231761 2555 flags.go:64] FLAG: --registry-qps="5" Jun 05 20:58:50.239417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231764 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231767 2555 flags.go:64] FLAG: --reserved-memory="" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231770 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231774 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231777 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231780 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231783 2555 flags.go:64] FLAG: --runonce="false" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231786 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231789 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231792 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231796 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231800 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231803 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231806 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231809 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231812 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231815 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231818 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231821 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231824 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231830 2555 flags.go:64] FLAG: --system-cgroups="" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231833 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231839 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231841 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231844 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 20:58:50.240125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231849 2555 flags.go:64] FLAG: --tls-min-version="" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231852 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231855 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231858 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231861 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231864 2555 flags.go:64] FLAG: --v="2" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231868 2555 flags.go:64] FLAG: --version="false" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231872 2555 flags.go:64] FLAG: --vmodule="" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231876 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.231879 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.231999 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232002 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232006 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232009 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232012 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232015 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232018 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232021 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232025 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232028 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232031 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232034 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.240889 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232036 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232039 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232042 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232045 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232048 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232050 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232054 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232057 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232059 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232062 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232065 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232068 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232070 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232073 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232076 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232078 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232081 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232083 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232086 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232089 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.241489 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232092 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232094 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232097 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232100 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232103 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232105 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232108 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232110 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232115 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232118 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232121 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232123 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232126 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232129 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232132 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232134 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232137 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232139 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232142 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232147 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.242071 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232150 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232153 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232157 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232159 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232162 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232166 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232170 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232173 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232175 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232178 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232181 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232183 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232186 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232188 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232191 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232194 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232196 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232199 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232202 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.242713 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232204 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232209 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232212 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232215 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232218 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232221 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232223 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232226 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232228 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232231 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232234 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232236 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232239 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232242 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232244 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232247 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232250 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232252 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232255 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.243188 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232258 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232260 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232263 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232265 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232269 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232273 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232276 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232278 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.232282 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.232971 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.242203 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.242221 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.243086 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.243098 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 20:58:50.243676 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243166 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243171 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243175 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243178 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243181 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243184 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243187 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243191 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243194 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243197 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243200 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243204 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243207 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243209 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243212 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243215 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243217 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243221 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243224 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243227 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.244035 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243229 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243232 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243235 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243237 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243240 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243244 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243248 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243251 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243254 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243257 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243261 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243263 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243266 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243269 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243272 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243274 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243277 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243280 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243282 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.244529 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243285 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243288 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243290 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243293 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243295 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243298 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243302 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243305 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243309 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243312 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243315 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243318 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243321 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243324 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243327 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243330 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243332 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243335 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243338 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.245008 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243341 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243344 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243347 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243351 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243354 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243357 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243360 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243363 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243366 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243369 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243371 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243374 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243377 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243379 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243382 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243385 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243387 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243390 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243392 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243395 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.245471 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243398 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243406 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243409 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243412 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243414 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243417 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243421 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243425 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243427 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243430 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243433 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243435 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243438 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243441 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243444 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243447 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243449 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243452 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243455 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243458 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.245969 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243460 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.243465 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243643 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243653 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243657 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243661 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243665 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243669 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243673 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243677 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243680 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243684 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243689 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243693 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243704 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:58:50.246459 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243708 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243712 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243715 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243719 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243723 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243727 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243731 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243736 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243743 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243747 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243750 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243753 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243755 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243758 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243761 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243764 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243766 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243769 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243772 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:58:50.246931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243774 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243777 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243780 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243783 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243785 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243788 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243792 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243795 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243799 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243801 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243804 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243807 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243810 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243820 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243823 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243826 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243830 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243832 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243835 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:58:50.247397 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243838 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243841 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243844 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243847 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243850 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243852 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243855 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243858 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243860 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243863 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243865 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243868 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243871 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243873 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243876 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243878 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243881 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243884 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243886 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:58:50.247931 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243889 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243891 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243894 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243896 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243899 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243902 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243905 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243908 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243916 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243919 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243921 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243924 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243926 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243929 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243932 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243934 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243937 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243939 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243942 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:58:50.248384 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243945 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243947 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243950 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243953 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243955 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243958 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243960 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243963 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243966 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:50.243968 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.243973 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.244115 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 20:58:50.248865 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.248192 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 20:58:50.249673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.249661 2555 server.go:1019] "Starting client certificate rotation" Jun 05 20:58:50.249786 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.249769 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:58:50.249815 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.249802 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:58:50.252333 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.252319 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:58:50.253678 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.253660 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:58:50.266762 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.266742 2555 log.go:25] "Validated CRI v1 runtime API" Jun 05 20:58:50.269297 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.269281 2555 log.go:25] "Validated CRI v1 image API" Jun 05 20:58:50.271093 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.271079 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 20:58:50.274827 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.274811 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:58:50.275594 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.275576 2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b28d0d16-62ed-4f84-b964-bfc4fc246c6b:/dev/nvme0n1p3 f7c09d77-5459-4d5b-acfd-b9bb147d73f8:/dev/nvme0n1p4] Jun 05 20:58:50.275650 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.275594 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 20:58:50.282436 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.282063 2555 manager.go:216] Machine: {Timestamp:2026-06-05 20:58:50.280410004 +0000 UTC m=+0.352670364 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100790 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b8ad29ed4aec5ea4fc6af2fd495f1 SystemUUID:ec2b8ad2-9ed4-aec5-ea4f-c6af2fd495f1 BootID:17a08378-ef82-4677-8dd7-2b423d652234 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5e:34:de:cb:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5e:34:de:cb:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:3e:6d:31:c5:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 20:58:50.282436 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.282424 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 20:58:50.282585 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.282535 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 20:58:50.285829 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.285802 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 20:58:50.285971 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.285831 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-154.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 20:58:50.286669 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.286658 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 20:58:50.286706 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.286672 2555 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 20:58:50.286706 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.286680 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:58:50.287347 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.287337 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:58:50.288540 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.288530 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 20:58:50.291389 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291375 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:58:50.291536 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291524 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 20:58:50.291570 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291558 2555 kubelet.go:486] "Attempting to sync node with API server" Jun 05 20:58:50.291570 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291568 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 20:58:50.291621 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291585 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 20:58:50.291621 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291594 2555 kubelet.go:398] "Adding apiserver pod source" Jun 05 20:58:50.291621 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291602 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 20:58:50.291981 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291969 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:58:50.292018 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.291993 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:58:50.294381 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.294359 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhcnp" Jun 05 20:58:50.295182 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.295168 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 20:58:50.296586 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.296571 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 20:58:50.296669 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.296602 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 20:58:50.297692 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297680 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 20:58:50.297734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297697 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 20:58:50.297734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297704 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 20:58:50.297734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297709 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 20:58:50.297734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297718 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 20:58:50.297734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297725 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297737 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297742 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297749 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297755 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297763 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 20:58:50.297870 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.297768 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 20:58:50.299250 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.299239 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 20:58:50.299250 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.299249 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 20:58:50.301016 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.300994 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 20:58:50.301016 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.301002 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-154.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 20:58:50.301124 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.301014 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 20:58:50.301833 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.301816 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhcnp" Jun 05 20:58:50.303128 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.303111 2555 server.go:1268] "Started kubelet" Jun 05 20:58:50.303328 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.303234 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 20:58:50.303328 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.303245 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 20:58:50.303328 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.303313 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 20:58:50.304041 ip-10-0-140-154 systemd[1]: Started Kubernetes Kubelet. Jun 05 20:58:50.304882 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.304836 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 20:58:50.306296 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.306279 2555 server.go:310] "Adding debug handlers to kubelet server" Jun 05 20:58:50.308916 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.307833 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-154.ec2.internal.18b64af7adb0f81d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-154.ec2.internal,UID:ip-10-0-140-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-154.ec2.internal,},FirstTimestamp:2026-06-05 20:58:50.303043613 +0000 UTC m=+0.375303971,LastTimestamp:2026-06-05 20:58:50.303043613 +0000 UTC m=+0.375303971,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-154.ec2.internal,}" Jun 05 20:58:50.309022 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.308955 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 20:58:50.309092 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.308996 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 20:58:50.309200 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.309183 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.309685 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.309671 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 20:58:50.309801 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.309790 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 20:58:50.309942 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.309816 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 20:58:50.309942 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.309940 2555 factory.go:55] Registering systemd factory Jun 05 20:58:50.310074 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.309957 2555 factory.go:223] Registration of the systemd container factory successfully Jun 05 20:58:50.310074 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.309685 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 20:58:50.310074 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310047 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 05 20:58:50.310074 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310067 2555 reconciler.go:29] "Reconciler: start to sync state" Jun 05 20:58:50.310300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310199 2555 factory.go:153] Registering CRI-O factory Jun 05 20:58:50.310300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310212 2555 factory.go:223] Registration of the crio container factory successfully Jun 05 20:58:50.310300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310259 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 20:58:50.310300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310283 2555 factory.go:103] Registering Raw factory Jun 05 20:58:50.310300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310298 2555 manager.go:1196] Started watching for new ooms in manager Jun 05 20:58:50.310871 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.310854 2555 manager.go:349] Starting recovery of all containers Jun 05 20:58:50.319019 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.318997 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:50.322123 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.321949 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-154.ec2.internal\" not found" node="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.323721 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.323623 2555 manager.go:354] Recovery completed Jun 05 20:58:50.327888 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.327877 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.329611 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.329593 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.329671 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.329629 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.329671 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.329646 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.330323 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.330309 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 20:58:50.330323 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.330321 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.330429 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.330321 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 20:58:50.330429 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.330368 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:58:50.331181 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331165 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.331256 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331196 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.331256 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331210 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.331559 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331547 2555 policy_none.go:49] "None policy: Start" Jun 05 20:58:50.331603 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331562 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 20:58:50.331603 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.331573 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 20:58:50.332461 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.332451 2555 policy_none.go:47] "Start" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374087 2555 manager.go:337] "Starting Device Plugin manager" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.374122 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374144 2555 server.go:87] "Starting device plugin registration server" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374477 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374493 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374563 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374644 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.374653 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.375307 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.375347 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.378914 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.380195 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.380225 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.380349 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 20:58:50.381244 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.380387 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 20:58:50.382618 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.382602 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:50.475369 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.475324 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.477101 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.477074 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.477214 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.477107 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.477214 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.477121 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.477214 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.477159 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.480751 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.480731 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal"] Jun 05 20:58:50.480840 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.480794 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.482217 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.482200 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.482313 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.482232 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.482313 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.482250 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.483833 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.483821 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.483993 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.483980 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.484061 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.484015 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.484658 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.484643 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.484743 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.484671 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.484743 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.484681 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.484997 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.484984 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.485043 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.485008 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.485043 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.485018 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.485644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.485626 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.485722 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.485653 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-154.ec2.internal\": node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.485997 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.485984 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.486060 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.486008 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:58:50.486675 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.486659 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:58:50.486764 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.486683 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:58:50.486764 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.486693 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:58:50.498886 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.498870 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.504037 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.504020 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-154.ec2.internal\" not found" node="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.507483 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.507466 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-154.ec2.internal\" not found" node="ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.599057 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.598979 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.611381 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.611352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.611471 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.611391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.611471 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.611408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8bd4781153f9532bb6d7b3eec5a58d8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-154.ec2.internal\" (UID: \"a8bd4781153f9532bb6d7b3eec5a58d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.699129 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.699079 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.712461 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.712575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.712575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8bd4781153f9532bb6d7b3eec5a58d8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-154.ec2.internal\" (UID: \"a8bd4781153f9532bb6d7b3eec5a58d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.712575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.712575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712550 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0648a4a6dbc7ab1c75e796b03072f2b9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal\" (UID: \"0648a4a6dbc7ab1c75e796b03072f2b9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.712695 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.712579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8bd4781153f9532bb6d7b3eec5a58d8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-154.ec2.internal\" (UID: \"a8bd4781153f9532bb6d7b3eec5a58d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.799930 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.799876 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:50.808034 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.808012 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.811138 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:50.811119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:50.900265 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:50.900170 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.000671 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.000622 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.101237 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.101204 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.201662 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.201628 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.249166 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.249140 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 20:58:51.249941 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.249308 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:58:51.249941 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.249308 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:58:51.262919 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:51.262889 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bd4781153f9532bb6d7b3eec5a58d8.slice/crio-d46ff17e50c11b0b5d5f8a4268c9e4ea425c415cd845407b8a69ba95e06b12ab WatchSource:0}: Error finding container d46ff17e50c11b0b5d5f8a4268c9e4ea425c415cd845407b8a69ba95e06b12ab: Status 404 returned error can't find the container with id d46ff17e50c11b0b5d5f8a4268c9e4ea425c415cd845407b8a69ba95e06b12ab Jun 05 20:58:51.263148 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:51.263126 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0648a4a6dbc7ab1c75e796b03072f2b9.slice/crio-24781d19ffd08eaed92fa3aa0beb4749af326a4dae2e9860617457d6e43964c7 WatchSource:0}: Error finding container 24781d19ffd08eaed92fa3aa0beb4749af326a4dae2e9860617457d6e43964c7: Status 404 returned error can't find the container with id 24781d19ffd08eaed92fa3aa0beb4749af326a4dae2e9860617457d6e43964c7 Jun 05 20:58:51.269294 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.269277 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 20:58:51.302525 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.302480 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.306433 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.306405 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 20:53:50 +0000 UTC" deadline="2028-01-04 05:38:49.172895862 +0000 UTC" Jun 05 20:58:51.306433 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.306431 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13856h39m57.866467841s" Jun 05 20:58:51.384288 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.384237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" event={"ID":"a8bd4781153f9532bb6d7b3eec5a58d8","Type":"ContainerStarted","Data":"d46ff17e50c11b0b5d5f8a4268c9e4ea425c415cd845407b8a69ba95e06b12ab"} Jun 05 20:58:51.385129 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.385106 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" event={"ID":"0648a4a6dbc7ab1c75e796b03072f2b9","Type":"ContainerStarted","Data":"24781d19ffd08eaed92fa3aa0beb4749af326a4dae2e9860617457d6e43964c7"} Jun 05 20:58:51.403272 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.403247 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.443650 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.443580 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:51.504234 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:51.504202 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-154.ec2.internal\" not found" Jun 05 20:58:51.556763 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.556738 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:51.609240 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.609210 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" Jun 05 20:58:51.619564 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.619536 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:58:51.620806 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.620783 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" Jun 05 20:58:51.625704 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:51.625679 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:58:52.231735 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.231703 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:52.286876 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.286847 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:58:52.293181 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.293159 2555 apiserver.go:52] "Watching apiserver" Jun 05 20:58:52.297746 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.297727 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 20:58:52.299238 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.299211 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf","openshift-cluster-node-tuning-operator/tuned-n2rcj","openshift-dns/node-resolver-lnp9x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal","openshift-multus/multus-t5k52","openshift-multus/network-metrics-daemon-xr8q4","kube-system/global-pull-secret-syncer-mdkxv","openshift-image-registry/node-ca-lhbrn","openshift-multus/multus-additional-cni-plugins-478zd","openshift-network-diagnostics/network-check-target-mcs5d","openshift-network-operator/iptables-alerter-s46dr","openshift-ovn-kubernetes/ovnkube-node-gxpz9","kube-system/konnectivity-agent-zvsll","kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal"] Jun 05 20:58:52.300833 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.300814 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:52.300921 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.300897 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:58:52.301920 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.301897 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.303115 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.303098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.303602 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.303581 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 20:58:52.303850 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.303821 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 20:58:52.303924 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.303832 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rwv5b\"" Jun 05 20:58:52.304300 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.304281 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.304765 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.304747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fphjz\"" Jun 05 20:58:52.304884 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.304814 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.304884 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.304756 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.305362 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.305343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.306120 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306102 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.306199 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306102 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 20:58:52.306199 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306160 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.306417 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306402 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tdqsl\"" Jun 05 20:58:52.306503 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.306610 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.306565 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:58:52.306790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306773 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.306927 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306911 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 20:58:52.306972 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.306940 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.307311 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.307241 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 20:58:52.307393 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.307359 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wfq79\"" Jun 05 20:58:52.308622 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.308604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.309551 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.309532 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 20:58:52.310008 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.309988 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qfn6w\"" Jun 05 20:58:52.310204 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.310187 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 20:58:52.310279 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.310212 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 20:58:52.312021 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.311998 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.312107 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.312092 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:58:52.313121 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.313099 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.314351 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.314330 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.314879 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.314861 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.314958 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.314905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lxvcd\"" Jun 05 20:58:52.314958 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.314928 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.316042 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.316009 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 20:58:52.316188 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.316014 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.316188 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.316129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.316313 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.316251 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.316536 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.316502 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fccrr\"" Jun 05 20:58:52.317581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.317561 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.318103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.317946 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 20:58:52.318103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.318004 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.318103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.318022 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.318103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.318071 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxffv\"" Jun 05 20:58:52.319643 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.319542 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 20:58:52.319643 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.319582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 20:58:52.319988 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.319969 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xwv57\"" Jun 05 20:58:52.320042 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.319993 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 20:58:52.320218 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.320182 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 20:58:52.320382 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.320367 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 20:58:52.320670 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.320582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 20:58:52.321437 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321404 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-kubelet\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321437 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321432 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321452 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-hosts-file\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-serviceca\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321474 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7040bea4-eecd-40ee-a8a2-b603ddde13fb-agent-certs\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321557 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-daemon-config\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321581 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-system-cni-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.321629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-cnibin\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-binary-copy\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321662 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-multus-certs\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321759 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-multus\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321779 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-hostroot\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m992\" (UniqueName: \"kubernetes.io/projected/3f9af940-ea64-4ad7-845c-22aa9276b4a3-kube-api-access-5m992\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321860 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jnzr\" (UniqueName: \"kubernetes.io/projected/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-kube-api-access-5jnzr\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-host\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-os-release\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.321957 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-k8s-cni-cncf-io\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.321995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-etc-kubernetes\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7040bea4-eecd-40ee-a8a2-b603ddde13fb-konnectivity-ca\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322047 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-tmp-dir\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-os-release\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322148 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-socket-dir-parent\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl6tt\" (UniqueName: \"kubernetes.io/projected/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-kube-api-access-kl6tt\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-conf-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzq2t\" (UniqueName: \"kubernetes.io/projected/b0b33df5-d88f-49aa-a45b-829c76b39db8-kube-api-access-lzq2t\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-system-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cnibin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cni-binary-copy\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322403 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7k62\" (UniqueName: \"kubernetes.io/projected/5520ee00-2d7d-4b09-bc08-6ac993d146e5-kube-api-access-g7k62\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.322581 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322424 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-netns\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.323323 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322450 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-bin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.323323 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-kubelet-config\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.323323 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.322487 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-dbus\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.336988 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.336968 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-496nx" Jun 05 20:58:52.344238 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.344219 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-496nx" Jun 05 20:58:52.411263 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.411231 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 20:58:52.423389 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423352 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96bx\" (UniqueName: \"kubernetes.io/projected/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kube-api-access-v96bx\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.423532 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-etc-kubernetes\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.423532 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7040bea4-eecd-40ee-a8a2-b603ddde13fb-konnectivity-ca\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.423640 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423553 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a6160b-69e9-4153-b968-e46e0f85527c-host-slash\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.423640 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-systemd-units\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.423640 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423580 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-etc-kubernetes\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.423640 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423601 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-netns\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423660 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-os-release\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423687 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423711 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-socket-dir-parent\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-os-release\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423743 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl6tt\" (UniqueName: \"kubernetes.io/projected/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-kube-api-access-kl6tt\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423804 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-kubernetes\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.423816 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423805 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-registration-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03a6160b-69e9-4153-b968-e46e0f85527c-iptables-alerter-script\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423879 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-socket-dir-parent\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzq2t\" (UniqueName: \"kubernetes.io/projected/b0b33df5-d88f-49aa-a45b-829c76b39db8-kube-api-access-lzq2t\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-system-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.423974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cnibin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7k62\" (UniqueName: \"kubernetes.io/projected/5520ee00-2d7d-4b09-bc08-6ac993d146e5-kube-api-access-g7k62\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424023 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7040bea4-eecd-40ee-a8a2-b603ddde13fb-konnectivity-ca\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.424125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424074 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cnibin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424165 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-system-cni-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-var-lib-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424227 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-bin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424263 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-config\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424289 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gld4g\" (UniqueName: \"kubernetes.io/projected/53b2fd21-dadf-422d-b1f0-f2ec577ce385-kube-api-access-gld4g\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424301 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-bin\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-sys\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424349 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-bin\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424372 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-env-overrides\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424395 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovn-node-metrics-cert\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424430 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-daemon-config\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424448 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-binary-copy\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysconfig\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424484 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-tuned\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424521 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424637 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-hostroot\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.424790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m992\" (UniqueName: \"kubernetes.io/projected/3f9af940-ea64-4ad7-845c-22aa9276b4a3-kube-api-access-5m992\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-tmp\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-socket-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424755 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-hostroot\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-os-release\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424841 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-k8s-cni-cncf-io\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-tmp-dir\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-script-lib\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424905 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-os-release\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-device-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-k8s-cni-cncf-io\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.424954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425061 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-slash\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425090 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-binary-copy\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-ovn\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-daemon-config\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.425575 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-log-socket\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-conf-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425186 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cni-binary-copy\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-multus-conf-dir\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-run\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-var-lib-kubelet\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-netns\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-tmp-dir\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425325 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-kubelet-config\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-dbus\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-modprobe-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425397 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctgr\" (UniqueName: \"kubernetes.io/projected/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-kube-api-access-mctgr\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425407 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-kubelet-config\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp782\" (UniqueName: \"kubernetes.io/projected/03a6160b-69e9-4153-b968-e46e0f85527c-kube-api-access-wp782\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-kubelet\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425448 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-netns\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.426337 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425468 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425492 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-kubelet\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425535 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0fa0879f-384c-4743-857d-91bf54e7dbdf-dbus\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425554 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-kubelet\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425582 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-hosts-file\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425607 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-serviceca\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425650 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-systemd\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-hosts-file\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.425676 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425685 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-host\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425726 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f9af940-ea64-4ad7-845c-22aa9276b4a3-cni-binary-copy\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.425781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:58:52.925746708 +0000 UTC m=+2.998007066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425794 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7040bea4-eecd-40ee-a8a2-b603ddde13fb-agent-certs\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-conf\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.427036 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-sys-fs\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-node-log\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-system-cni-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-cnibin\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-system-cni-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.425986 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426016 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-cnibin\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-serviceca\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426093 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426096 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426156 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0b33df5-d88f-49aa-a45b-829c76b39db8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426210 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-systemd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426228 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-etc-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-netd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426297 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-multus-certs\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426362 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-multus\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.427620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426418 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-var-lib-cni-multus\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnzr\" (UniqueName: \"kubernetes.io/projected/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-kube-api-access-5jnzr\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-host\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-lib-modules\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.426530 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.426597 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:58:52.926577199 +0000 UTC m=+2.998837559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426392 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3f9af940-ea64-4ad7-845c-22aa9276b4a3-host-run-multus-certs\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-host\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.428159 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.426630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b0b33df5-d88f-49aa-a45b-829c76b39db8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.428724 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.428707 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:52.428790 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.428733 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:52.428790 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.428746 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:52.428889 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.428810 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:58:52.92879541 +0000 UTC m=+3.001055755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:52.430064 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.430036 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7040bea4-eecd-40ee-a8a2-b603ddde13fb-agent-certs\") pod \"konnectivity-agent-zvsll\" (UID: \"7040bea4-eecd-40ee-a8a2-b603ddde13fb\") " pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.431428 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.431359 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzq2t\" (UniqueName: \"kubernetes.io/projected/b0b33df5-d88f-49aa-a45b-829c76b39db8-kube-api-access-lzq2t\") pod \"multus-additional-cni-plugins-478zd\" (UID: \"b0b33df5-d88f-49aa-a45b-829c76b39db8\") " pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.431547 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.431528 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl6tt\" (UniqueName: \"kubernetes.io/projected/0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19-kube-api-access-kl6tt\") pod \"node-ca-lhbrn\" (UID: \"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19\") " pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.431657 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.431627 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7k62\" (UniqueName: \"kubernetes.io/projected/5520ee00-2d7d-4b09-bc08-6ac993d146e5-kube-api-access-g7k62\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.431831 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.431816 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m992\" (UniqueName: \"kubernetes.io/projected/3f9af940-ea64-4ad7-845c-22aa9276b4a3-kube-api-access-5m992\") pod \"multus-t5k52\" (UID: \"3f9af940-ea64-4ad7-845c-22aa9276b4a3\") " pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.433552 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.433531 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jnzr\" (UniqueName: \"kubernetes.io/projected/db9cf996-815a-4eb9-a3b0-09b2e40b19e6-kube-api-access-5jnzr\") pod \"node-resolver-lnp9x\" (UID: \"db9cf996-815a-4eb9-a3b0-09b2e40b19e6\") " pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.527790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527704 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.527790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-systemd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.527790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-etc-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527824 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-etc-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527842 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-systemd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-netd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527983 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-lib-modules\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.527988 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528011 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v96bx\" (UniqueName: \"kubernetes.io/projected/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kube-api-access-v96bx\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-netd\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528046 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a6160b-69e9-4153-b968-e46e0f85527c-host-slash\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-systemd-units\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528078 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03a6160b-69e9-4153-b968-e46e0f85527c-host-slash\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-netns\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528097 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-lib-modules\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-systemd-units\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528118 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-kubernetes\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528140 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-netns\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528167 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-kubernetes\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528195 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-registration-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03a6160b-69e9-4153-b968-e46e0f85527c-iptables-alerter-script\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-var-lib-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528290 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-registration-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528294 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-config\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528327 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-var-lib-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.528377 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gld4g\" (UniqueName: \"kubernetes.io/projected/53b2fd21-dadf-422d-b1f0-f2ec577ce385-kube-api-access-gld4g\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528375 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-sys\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-sys\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-bin\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-env-overrides\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovn-node-metrics-cert\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-cni-bin\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysconfig\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-tuned\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528677 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-tmp\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528724 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysconfig\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-socket-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528773 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-script-lib\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528829 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-device-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528830 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-socket-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.529122 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528877 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-device-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528891 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-slash\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-ovn\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528927 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-config\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528941 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-log-socket\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-openvswitch\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528952 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-run\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528991 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-var-lib-kubelet\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528997 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-log-socket\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-slash\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528911 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03a6160b-69e9-4153-b968-e46e0f85527c-iptables-alerter-script\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.528917 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-env-overrides\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-modprobe-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529053 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-etc-selinux\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529078 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctgr\" (UniqueName: \"kubernetes.io/projected/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-kube-api-access-mctgr\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530075 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529088 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-var-lib-kubelet\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529095 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-run-ovn\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-run\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp782\" (UniqueName: \"kubernetes.io/projected/03a6160b-69e9-4153-b968-e46e0f85527c-kube-api-access-wp782\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529159 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-kubelet\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529124 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-modprobe-d\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-run-ovn-kubernetes\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-systemd\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529276 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-host\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-conf\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529345 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-sys-fs\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529369 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-node-log\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529383 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-systemd\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529464 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-node-log\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529462 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b2fd21-dadf-422d-b1f0-f2ec577ce385-host-kubelet\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529499 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.530914 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529533 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-host\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529538 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-sys-fs\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-sysctl-conf\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.529690 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovnkube-script-lib\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.531277 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53b2fd21-dadf-422d-b1f0-f2ec577ce385-ovn-node-metrics-cert\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.531375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-tmp\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.531673 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.531407 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-etc-tuned\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.536108 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.535957 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp782\" (UniqueName: \"kubernetes.io/projected/03a6160b-69e9-4153-b968-e46e0f85527c-kube-api-access-wp782\") pod \"iptables-alerter-s46dr\" (UID: \"03a6160b-69e9-4153-b968-e46e0f85527c\") " pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.536222 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.536174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gld4g\" (UniqueName: \"kubernetes.io/projected/53b2fd21-dadf-422d-b1f0-f2ec577ce385-kube-api-access-gld4g\") pod \"ovnkube-node-gxpz9\" (UID: \"53b2fd21-dadf-422d-b1f0-f2ec577ce385\") " pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.536291 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.536272 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctgr\" (UniqueName: \"kubernetes.io/projected/4cd9da8d-2a47-4346-9d94-a8fa678aa8a6-kube-api-access-mctgr\") pod \"tuned-n2rcj\" (UID: \"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6\") " pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.536342 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.536290 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96bx\" (UniqueName: \"kubernetes.io/projected/c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6-kube-api-access-v96bx\") pod \"aws-ebs-csi-driver-node-l7ssf\" (UID: \"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.616361 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.616320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:58:52.624257 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.624231 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lnp9x" Jun 05 20:58:52.632971 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.632948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhbrn" Jun 05 20:58:52.639620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.639600 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t5k52" Jun 05 20:58:52.646242 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.646216 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-478zd" Jun 05 20:58:52.653761 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.653741 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" Jun 05 20:58:52.659380 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.659355 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" Jun 05 20:58:52.665212 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.665191 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s46dr" Jun 05 20:58:52.669849 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.669830 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:58:52.932047 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.932008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:52.932212 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.932073 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:52.932212 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:52.932099 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:52.932212 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932200 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932214 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932227 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932240 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932271 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:58:53.932255792 +0000 UTC m=+4.004516149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932204 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932321 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:58:53.932304796 +0000 UTC m=+4.004565180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:52.932389 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:52.932351 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:58:53.932341713 +0000 UTC m=+4.004602073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:53.026047 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.026023 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd9da8d_2a47_4346_9d94_a8fa678aa8a6.slice/crio-dda071139bd633c4cabfb7a78ae6f0d0aa8e11653a1a664613639918e0cc369d WatchSource:0}: Error finding container dda071139bd633c4cabfb7a78ae6f0d0aa8e11653a1a664613639918e0cc369d: Status 404 returned error can't find the container with id dda071139bd633c4cabfb7a78ae6f0d0aa8e11653a1a664613639918e0cc369d Jun 05 20:58:53.037965 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.037880 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e11ed0a_c6f3_43af_9cf5_4c2f0ab28a19.slice/crio-aa8a58d323fb0d6fa5ed3ec486271b3e97896a5b124edf7ace502a715ffe498a WatchSource:0}: Error finding container aa8a58d323fb0d6fa5ed3ec486271b3e97896a5b124edf7ace502a715ffe498a: Status 404 returned error can't find the container with id aa8a58d323fb0d6fa5ed3ec486271b3e97896a5b124edf7ace502a715ffe498a Jun 05 20:58:53.038672 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.038178 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b2fd21_dadf_422d_b1f0_f2ec577ce385.slice/crio-aad20c8132a283fb938ef2c02f742bd8e3614e4a89017eb55d2db5549ed3ecab WatchSource:0}: Error finding container aad20c8132a283fb938ef2c02f742bd8e3614e4a89017eb55d2db5549ed3ecab: Status 404 returned error can't find the container with id aad20c8132a283fb938ef2c02f742bd8e3614e4a89017eb55d2db5549ed3ecab Jun 05 20:58:53.038846 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.038820 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a6160b_69e9_4153_b968_e46e0f85527c.slice/crio-16da5ffd81d46efd792b3f980e5e6f0dc6fe40fb0be5af2e138f8af34c289f7f WatchSource:0}: Error finding container 16da5ffd81d46efd792b3f980e5e6f0dc6fe40fb0be5af2e138f8af34c289f7f: Status 404 returned error can't find the container with id 16da5ffd81d46efd792b3f980e5e6f0dc6fe40fb0be5af2e138f8af34c289f7f Jun 05 20:58:53.039840 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.039822 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7040bea4_eecd_40ee_a8a2_b603ddde13fb.slice/crio-40480936d04250bb42271e7aa5437f58f9715a64164e2f77ee308ca4dd241873 WatchSource:0}: Error finding container 40480936d04250bb42271e7aa5437f58f9715a64164e2f77ee308ca4dd241873: Status 404 returned error can't find the container with id 40480936d04250bb42271e7aa5437f58f9715a64164e2f77ee308ca4dd241873 Jun 05 20:58:53.043444 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.041733 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9af940_ea64_4ad7_845c_22aa9276b4a3.slice/crio-5c04aa425f6508a59df1f5bff2c0b6c753cb2e69ade8fe3a280307b78919b117 WatchSource:0}: Error finding container 5c04aa425f6508a59df1f5bff2c0b6c753cb2e69ade8fe3a280307b78919b117: Status 404 returned error can't find the container with id 5c04aa425f6508a59df1f5bff2c0b6c753cb2e69ade8fe3a280307b78919b117 Jun 05 20:58:53.043444 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:58:53.042654 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08fed4f_eab5_4bef_b475_0f5cc7e9bbf6.slice/crio-9b138336219dc108414cb1b980f0c15660e34c8d411745d63b4a4acc7c63c801 WatchSource:0}: Error finding container 9b138336219dc108414cb1b980f0c15660e34c8d411745d63b4a4acc7c63c801: Status 404 returned error can't find the container with id 9b138336219dc108414cb1b980f0c15660e34c8d411745d63b4a4acc7c63c801 Jun 05 20:58:53.346620 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.346353 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:53:52 +0000 UTC" deadline="2028-03-15 09:17:28.728018372 +0000 UTC" Jun 05 20:58:53.347074 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.346642 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15564h18m35.381403768s" Jun 05 20:58:53.380853 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.380824 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:53.380853 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.380847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:53.381091 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.380945 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:58:53.381147 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.381082 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:58:53.390567 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.390534 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnp9x" event={"ID":"db9cf996-815a-4eb9-a3b0-09b2e40b19e6","Type":"ContainerStarted","Data":"9bc42372081a7e7b3583d390a48f82f52886eccebeefcceb968090f5efcdcc39"} Jun 05 20:58:53.392241 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.392203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerStarted","Data":"e2ae08624dd53f6b81f963c6df3671e2733ec8e64dd4aee7a3f25e0b829f9201"} Jun 05 20:58:53.393790 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.393753 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvsll" event={"ID":"7040bea4-eecd-40ee-a8a2-b603ddde13fb","Type":"ContainerStarted","Data":"40480936d04250bb42271e7aa5437f58f9715a64164e2f77ee308ca4dd241873"} Jun 05 20:58:53.395962 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.395913 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s46dr" event={"ID":"03a6160b-69e9-4153-b968-e46e0f85527c","Type":"ContainerStarted","Data":"16da5ffd81d46efd792b3f980e5e6f0dc6fe40fb0be5af2e138f8af34c289f7f"} Jun 05 20:58:53.401876 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.401470 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"aad20c8132a283fb938ef2c02f742bd8e3614e4a89017eb55d2db5549ed3ecab"} Jun 05 20:58:53.403289 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.403262 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhbrn" event={"ID":"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19","Type":"ContainerStarted","Data":"aa8a58d323fb0d6fa5ed3ec486271b3e97896a5b124edf7ace502a715ffe498a"} Jun 05 20:58:53.405473 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.405449 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" event={"ID":"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6","Type":"ContainerStarted","Data":"dda071139bd633c4cabfb7a78ae6f0d0aa8e11653a1a664613639918e0cc369d"} Jun 05 20:58:53.412665 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.412641 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" event={"ID":"a8bd4781153f9532bb6d7b3eec5a58d8","Type":"ContainerStarted","Data":"fcc081c529fd12387e2a80e1735713ecbe5833b38e7bcc69ccdc9c7d5695b9b7"} Jun 05 20:58:53.420344 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.420317 2555 generic.go:356] "Generic (PLEG): container finished" podID="0648a4a6dbc7ab1c75e796b03072f2b9" containerID="fa7f84c74463cf27fb58b0acbeeda51213186c649167b0295904de09e3f4400c" exitCode=0 Jun 05 20:58:53.420447 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.420392 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" event={"ID":"0648a4a6dbc7ab1c75e796b03072f2b9","Type":"ContainerDied","Data":"fa7f84c74463cf27fb58b0acbeeda51213186c649167b0295904de09e3f4400c"} Jun 05 20:58:53.424806 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.424759 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-154.ec2.internal" podStartSLOduration=2.424742494 podStartE2EDuration="2.424742494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:58:53.42435805 +0000 UTC m=+3.496618419" watchObservedRunningTime="2026-06-05 20:58:53.424742494 +0000 UTC m=+3.497002861" Jun 05 20:58:53.428287 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.428263 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" event={"ID":"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6","Type":"ContainerStarted","Data":"9b138336219dc108414cb1b980f0c15660e34c8d411745d63b4a4acc7c63c801"} Jun 05 20:58:53.430629 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.430608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t5k52" event={"ID":"3f9af940-ea64-4ad7-845c-22aa9276b4a3","Type":"ContainerStarted","Data":"5c04aa425f6508a59df1f5bff2c0b6c753cb2e69ade8fe3a280307b78919b117"} Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.945650 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.945712 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:53.945770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.945906 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.945980 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:58:55.94595281 +0000 UTC m=+6.018213168 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946372 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946420 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:58:55.946405721 +0000 UTC m=+6.018666078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946502 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946535 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946548 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:53.946674 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:53.946589 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:58:55.946572333 +0000 UTC m=+6.018832691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:54.347346 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:54.347274 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:53:52 +0000 UTC" deadline="2027-12-20 14:20:32.226401828 +0000 UTC" Jun 05 20:58:54.347346 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:54.347313 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13505h21m37.879093991s" Jun 05 20:58:54.383361 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:54.383160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:54.383361 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:54.383303 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:58:54.446555 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:54.446463 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" event={"ID":"0648a4a6dbc7ab1c75e796b03072f2b9","Type":"ContainerStarted","Data":"125076a0d1bca1133fae9b5eb9a9e1e6d7782198db8e6832680706f8a75889a9"} Jun 05 20:58:54.471219 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:54.470326 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-154.ec2.internal" podStartSLOduration=3.47030709 podStartE2EDuration="3.47030709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:58:54.47001165 +0000 UTC m=+4.542272039" watchObservedRunningTime="2026-06-05 20:58:54.47030709 +0000 UTC m=+4.542567459" Jun 05 20:58:55.381158 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:55.381126 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:55.381613 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.381248 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:58:55.381788 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:55.381736 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:55.381889 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.381847 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:55.964793 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:55.964860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:55.964905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965053 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965072 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965085 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965146 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:58:59.965126509 +0000 UTC m=+10.037386875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965570 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965624 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:58:59.96560721 +0000 UTC m=+10.037867569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965680 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:55.965785 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:55.965710 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:58:59.965700138 +0000 UTC m=+10.037960521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:56.381662 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:56.381628 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:56.382125 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:56.381768 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:58:57.380869 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:57.380834 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:57.381031 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:57.380973 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:58:57.381106 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:57.381037 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:57.381156 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:57.381120 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:58:58.381637 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:58.381291 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:58.381637 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:58.381427 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:58:59.380861 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:59.380814 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:59.381065 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.380948 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:58:59.381341 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:59.381323 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:59.381432 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.381408 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:58:59.996917 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:59.996874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:59.996947 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:58:59.997011 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997124 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997155 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997174 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997187 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997200 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:07.997178872 +0000 UTC m=+18.069439230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997236 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:59:07.997221153 +0000 UTC m=+18.069481515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997293 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:58:59.997393 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:58:59.997326 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:59:07.997315105 +0000 UTC m=+18.069575463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:00.381844 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:00.381345 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:00.381844 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:00.381462 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:01.380697 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:01.380659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:01.381196 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:01.380704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:01.381196 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:01.380805 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:01.381196 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:01.380941 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:02.381035 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:02.381002 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:02.381412 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:02.381170 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:03.381484 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:03.381444 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:03.381846 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:03.381467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:03.381846 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:03.381619 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:03.381846 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:03.381722 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:04.381587 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:04.381553 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:04.382071 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:04.381680 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:05.381103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:05.381068 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:05.381103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:05.381089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:05.381347 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:05.381184 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:05.381347 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:05.381334 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:06.380774 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:06.380737 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:06.381256 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:06.380880 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:07.381335 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:07.381296 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:07.381890 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:07.381311 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:07.381890 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:07.381803 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:07.382034 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:07.382008 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:08.060191 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:08.060156 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:08.060191 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:08.060198 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:08.060233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060337 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060337 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060354 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060375 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060337 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060414 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:59:24.060391595 +0000 UTC m=+34.132651954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060435 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:59:24.06042456 +0000 UTC m=+34.132684909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:08.060546 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.060451 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:24.060441877 +0000 UTC m=+34.132702228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:08.381013 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:08.380936 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:08.381161 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:08.381067 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:09.380908 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:09.380872 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:09.381410 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:09.380879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:09.381410 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:09.381012 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:09.381410 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:09.381058 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:10.382541 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:10.382493 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:10.383013 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:10.382615 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:11.381258 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:11.381219 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:11.381450 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:11.381219 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:11.381450 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:11.381376 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:11.381450 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:11.381434 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:12.381474 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.381292 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:12.382032 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:12.381577 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:12.487675 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.487589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvsll" event={"ID":"7040bea4-eecd-40ee-a8a2-b603ddde13fb","Type":"ContainerStarted","Data":"f1734d07c710a0814b9ea851c2ea92b035b3741cd72ffb35e3d18a17feb367da"} Jun 05 20:59:12.489188 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.489115 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhbrn" event={"ID":"0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19","Type":"ContainerStarted","Data":"2d494999645ed22f8eb68014af5d874e9462c06adb074f4962396769451978bb"} Jun 05 20:59:12.491089 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.490997 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" event={"ID":"4cd9da8d-2a47-4346-9d94-a8fa678aa8a6","Type":"ContainerStarted","Data":"153ddbc9e8413bb399837803d6b57ca26d0d8608e80425e1e83c35ea3b5e0d85"} Jun 05 20:59:12.492552 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.492525 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" event={"ID":"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6","Type":"ContainerStarted","Data":"438ecfb2bf519b45c5c9e09c3b0ce54671bb1b8bec6769695e413f508bf7e477"} Jun 05 20:59:12.494163 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.494138 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t5k52" event={"ID":"3f9af940-ea64-4ad7-845c-22aa9276b4a3","Type":"ContainerStarted","Data":"2b7a12a7f5c5c3e24294de36b3ae196c5dcd0fb109460e7d30a5d35017028829"} Jun 05 20:59:12.495819 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.495797 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lnp9x" event={"ID":"db9cf996-815a-4eb9-a3b0-09b2e40b19e6","Type":"ContainerStarted","Data":"41117eca710fc750fffc1be3edde60c4304514ef2503f9ab14b28446d4ab5b92"} Jun 05 20:59:12.497529 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.497487 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="3dbf02c6c3f271ef1efe1a2b66beb07a1034a9a7cd0c410ffdd2295ab69a366e" exitCode=0 Jun 05 20:59:12.497622 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.497548 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"3dbf02c6c3f271ef1efe1a2b66beb07a1034a9a7cd0c410ffdd2295ab69a366e"} Jun 05 20:59:12.500437 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.500394 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zvsll" podStartSLOduration=4.060384697 podStartE2EDuration="22.500377128s" totalImagesPullingTime="18.439992431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:12.499988762 +0000 UTC m=+22.572249145" watchObservedRunningTime="2026-06-05 20:59:12.500377128 +0000 UTC m=+22.572637512" Jun 05 20:59:12.527429 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.527386 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lnp9x" podStartSLOduration=3.586593986 podStartE2EDuration="22.527371926s" totalImagesPullingTime="18.94077794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:12.52726325 +0000 UTC m=+22.599523646" watchObservedRunningTime="2026-06-05 20:59:12.527371926 +0000 UTC m=+22.599632291" Jun 05 20:59:12.527523 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.527483 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t5k52" podStartSLOduration=3.5588483330000003 podStartE2EDuration="22.527477452s" totalImagesPullingTime="18.968629119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:12.515120426 +0000 UTC m=+22.587380795" watchObservedRunningTime="2026-06-05 20:59:12.527477452 +0000 UTC m=+22.599737815" Jun 05 20:59:12.539364 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.539328 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lhbrn" podStartSLOduration=3.655712792 podStartE2EDuration="22.53931363s" totalImagesPullingTime="18.883600838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:12.538921322 +0000 UTC m=+22.611181706" watchObservedRunningTime="2026-06-05 20:59:12.53931363 +0000 UTC m=+22.611573995" Jun 05 20:59:12.575047 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:12.575008 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n2rcj" podStartSLOduration=3.632871169 podStartE2EDuration="22.574992769s" totalImagesPullingTime="18.9421216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:12.574909697 +0000 UTC m=+22.647170082" watchObservedRunningTime="2026-06-05 20:59:12.574992769 +0000 UTC m=+22.647253135" Jun 05 20:59:13.205502 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.205270 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:59:13.206112 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.206088 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:59:13.380764 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.380738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:13.380764 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.380753 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:13.380967 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:13.380866 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:13.381026 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:13.380986 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:13.426464 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.426438 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 20:59:13.502583 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.502549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" event={"ID":"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6","Type":"ContainerStarted","Data":"805eb19ee7a980290154014a44b8506abf8a7cfe7570ba1d174830b0b49c9594"} Jun 05 20:59:13.504215 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.504188 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s46dr" event={"ID":"03a6160b-69e9-4153-b968-e46e0f85527c","Type":"ContainerStarted","Data":"d714f7c69c4252562a96c46c68c7b9b710c2dc62ade0a9f9accbc2786dd09921"} Jun 05 20:59:13.507489 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.507470 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 20:59:13.507888 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.507862 2555 generic.go:356] "Generic (PLEG): container finished" podID="53b2fd21-dadf-422d-b1f0-f2ec577ce385" containerID="b44abf26630723e7b0473ee617dd89325641e54489b122fb8952c7de0e30116d" exitCode=1 Jun 05 20:59:13.507971 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.507955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"498b969d7f0221832f73b1282ac91797a23e35225a0239f2bff44d98e7c0fc68"} Jun 05 20:59:13.508644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508421 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:59:13.508644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508461 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"1715420cfcf4f5c769483fed2dc1cfd49e01734641492344a4be7970f4605249"} Jun 05 20:59:13.508644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508529 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"46f7d6b0890d426025b5772a9d781a9bd2c6866ce097f5ce48a5610f74975290"} Jun 05 20:59:13.508644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"6d07dc852a6a6dea031a8eb3c60cc664a29a98aba4d39016c11d12dac8fdb69f"} Jun 05 20:59:13.508644 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508623 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerDied","Data":"b44abf26630723e7b0473ee617dd89325641e54489b122fb8952c7de0e30116d"} Jun 05 20:59:13.508996 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508669 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"093b7ed93947a93d9a97f2b3a577e13e99457f03837ef99ac40937abdeb50a83"} Jun 05 20:59:13.508996 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.508743 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zvsll" Jun 05 20:59:13.558942 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:13.558898 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s46dr" podStartSLOduration=4.676092088 podStartE2EDuration="23.55887858s" totalImagesPullingTime="18.882786492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:13.538769622 +0000 UTC m=+23.611030007" watchObservedRunningTime="2026-06-05 20:59:13.55887858 +0000 UTC m=+23.631138946" Jun 05 20:59:14.381651 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:14.381618 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:14.382011 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:14.381749 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:14.384103 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:14.384021 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T20:59:13.426460538Z","UUID":"0f00ae1d-cbcc-403c-812f-1afc92711483","Handler":null,"Name":"","Endpoint":""} Jun 05 20:59:14.385758 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:14.385734 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 20:59:14.385862 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:14.385776 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 20:59:15.380612 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:15.380586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:15.380612 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:15.380605 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:15.381149 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:15.380712 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:15.381208 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:15.381150 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:15.514606 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:15.514527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" event={"ID":"c08fed4f-eab5-4bef-b475-0f5cc7e9bbf6","Type":"ContainerStarted","Data":"b94460cf2e65598d24299a35e3970d42691a19ec3740bd877db68abc918e1469"} Jun 05 20:59:15.530051 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:15.530006 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l7ssf" podStartSLOduration=4.61272488 podStartE2EDuration="25.529992151s" totalImagesPullingTime="20.917267271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:15.529837922 +0000 UTC m=+25.602098303" watchObservedRunningTime="2026-06-05 20:59:15.529992151 +0000 UTC m=+25.602252516" Jun 05 20:59:16.381038 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:16.380798 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:16.381500 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:16.381145 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:17.380583 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.380549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:17.380583 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.380586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:17.380829 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:17.380662 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:17.380829 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:17.380775 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:17.520713 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.520682 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="bf9eaedfae37b98c7a00fb3385265a17dfbd4bc97084ed105f97c5bcf102b9c0" exitCode=0 Jun 05 20:59:17.521415 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.520772 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"bf9eaedfae37b98c7a00fb3385265a17dfbd4bc97084ed105f97c5bcf102b9c0"} Jun 05 20:59:17.524086 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.524067 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 20:59:17.524400 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:17.524383 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"121c77efb1be80c7aa54896847b46d6088b874e7ddd7edd507a79dae13a3890d"} Jun 05 20:59:18.381151 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:18.381120 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:18.381333 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:18.381243 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:19.380817 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.380604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:19.381367 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.380650 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:19.381367 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:19.380913 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:19.381367 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:19.380961 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:19.532074 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.532048 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 20:59:19.532464 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.532431 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"73472caed87a2201275c9cdb74c716bcd86b5795187ceeda5364f709a2358f1c"} Jun 05 20:59:19.532692 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.532672 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:19.532776 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.532738 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:19.532864 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.532845 2555 scope.go:117] "RemoveContainer" containerID="b44abf26630723e7b0473ee617dd89325641e54489b122fb8952c7de0e30116d" Jun 05 20:59:19.534734 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.534714 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="c7113be8f4c865ae9f4d5e61fe20455cd2b543fdcbea241a300d9b20a292ba61" exitCode=0 Jun 05 20:59:19.534852 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.534741 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"c7113be8f4c865ae9f4d5e61fe20455cd2b543fdcbea241a300d9b20a292ba61"} Jun 05 20:59:19.549694 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:19.549668 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:20.381562 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.381533 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:20.382071 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:20.381641 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:20.542495 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.542476 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 20:59:20.542928 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.542898 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" event={"ID":"53b2fd21-dadf-422d-b1f0-f2ec577ce385","Type":"ContainerStarted","Data":"4b76c7388e4017458ce47f453ee5e96c6692afc98db786d91784cc26b510fe05"} Jun 05 20:59:20.543200 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.543169 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:20.545763 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.545676 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerStarted","Data":"e9b869f2d5afd1e7476f8d39b9b6d4e59af55adf604a4599972e80007239e0fa"} Jun 05 20:59:20.559764 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.559738 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:20.566012 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.565973 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" podStartSLOduration=11.202283969 podStartE2EDuration="30.565959498s" totalImagesPullingTime="19.363675529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:20.564918133 +0000 UTC m=+30.637178509" watchObservedRunningTime="2026-06-05 20:59:20.565959498 +0000 UTC m=+30.638219861" Jun 05 20:59:20.752766 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.752577 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mdkxv"] Jun 05 20:59:20.752941 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.752909 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:20.753040 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:20.753020 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:20.755269 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.755242 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcs5d"] Jun 05 20:59:20.755399 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.755354 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:20.755472 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:20.755454 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:20.765414 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.765387 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xr8q4"] Jun 05 20:59:20.765555 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:20.765527 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:20.765661 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:20.765640 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:21.550257 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:21.550220 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="e9b869f2d5afd1e7476f8d39b9b6d4e59af55adf604a4599972e80007239e0fa" exitCode=0 Jun 05 20:59:21.550725 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:21.550272 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"e9b869f2d5afd1e7476f8d39b9b6d4e59af55adf604a4599972e80007239e0fa"} Jun 05 20:59:22.380810 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:22.380773 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:22.380810 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:22.380785 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:22.381054 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:22.380898 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:22.381196 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:22.381169 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:22.381328 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:22.381287 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:22.381412 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:22.381388 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:24.079397 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.079359 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.079421 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.079461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079566 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079580 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079598 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079612 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079624 2555 projected.go:196] Error preparing data for projected volume kube-api-access-j85nl for pod openshift-network-diagnostics/network-check-target-mcs5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079647 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret podName:0fa0879f-384c-4743-857d-91bf54e7dbdf nodeName:}" failed. No retries permitted until 2026-06-05 20:59:56.079628223 +0000 UTC m=+66.151888568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret") pod "global-pull-secret-syncer-mdkxv" (UID: "0fa0879f-384c-4743-857d-91bf54e7dbdf") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079665 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl podName:8ae17994-7118-4034-8870-9affefbe088c nodeName:}" failed. No retries permitted until 2026-06-05 20:59:56.079655614 +0000 UTC m=+66.151915963 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j85nl" (UniqueName: "kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl") pod "network-check-target-mcs5d" (UID: "8ae17994-7118-4034-8870-9affefbe088c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:59:24.080002 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.079681 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 20:59:56.079671763 +0000 UTC m=+66.151932107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:59:24.381031 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.380941 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:24.381031 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.380990 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:24.381257 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.380947 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:24.381257 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.381085 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mcs5d" podUID="8ae17994-7118-4034-8870-9affefbe088c" Jun 05 20:59:24.381257 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.381159 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 20:59:24.381257 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:24.381239 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mdkxv" podUID="0fa0879f-384c-4743-857d-91bf54e7dbdf" Jun 05 20:59:24.791004 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.790974 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-154.ec2.internal" event="NodeReady" Jun 05 20:59:24.791163 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.791102 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 20:59:24.829586 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.829555 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vdssl"] Jun 05 20:59:24.834694 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.834666 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r8snp"] Jun 05 20:59:24.834823 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.834799 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:24.836755 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.836710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 20:59:24.836883 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.836802 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fnqdb\"" Jun 05 20:59:24.836883 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.836717 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 20:59:24.838106 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.838080 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:24.839849 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.839824 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qpmv\"" Jun 05 20:59:24.839976 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.839824 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 20:59:24.839976 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.839861 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 20:59:24.840139 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.840126 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 20:59:24.845354 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.845332 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vdssl"] Jun 05 20:59:24.856961 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.856938 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8snp"] Jun 05 20:59:24.987266 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d43edf-459f-4860-8473-ec7f153e630d-config-volume\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:24.987266 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d43edf-459f-4860-8473-ec7f153e630d-tmp-dir\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:24.987504 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987298 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:24.987504 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzxc\" (UniqueName: \"kubernetes.io/projected/c2d43edf-459f-4860-8473-ec7f153e630d-kube-api-access-tmzxc\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:24.987637 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c59c52-b60d-4f4b-8f7d-5f922082670e-cert\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:24.987637 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:24.987549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9xp\" (UniqueName: \"kubernetes.io/projected/71c59c52-b60d-4f4b-8f7d-5f922082670e-kube-api-access-5w9xp\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.088102 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzxc\" (UniqueName: \"kubernetes.io/projected/c2d43edf-459f-4860-8473-ec7f153e630d-kube-api-access-tmzxc\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c59c52-b60d-4f4b-8f7d-5f922082670e-cert\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9xp\" (UniqueName: \"kubernetes.io/projected/71c59c52-b60d-4f4b-8f7d-5f922082670e-kube-api-access-5w9xp\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:25.088235 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d43edf-459f-4860-8473-ec7f153e630d-config-volume\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088279 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d43edf-459f-4860-8473-ec7f153e630d-tmp-dir\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:25.088299 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:25.588279282 +0000 UTC m=+35.660539642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:25.088797 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088766 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d43edf-459f-4860-8473-ec7f153e630d-tmp-dir\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.089101 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.088857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2d43edf-459f-4860-8473-ec7f153e630d-config-volume\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.093039 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.093019 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71c59c52-b60d-4f4b-8f7d-5f922082670e-cert\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.096039 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.096011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9xp\" (UniqueName: \"kubernetes.io/projected/71c59c52-b60d-4f4b-8f7d-5f922082670e-kube-api-access-5w9xp\") pod \"ingress-canary-r8snp\" (UID: \"71c59c52-b60d-4f4b-8f7d-5f922082670e\") " pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.096039 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.096027 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzxc\" (UniqueName: \"kubernetes.io/projected/c2d43edf-459f-4860-8473-ec7f153e630d-kube-api-access-tmzxc\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.153199 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.153157 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8snp" Jun 05 20:59:25.592386 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.592350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:25.592620 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:25.592474 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:25.592620 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:25.592563 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:26.592549015 +0000 UTC m=+36.664809359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:25.832894 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:25.832743 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8snp"] Jun 05 20:59:25.835951 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:59:25.835927 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c59c52_b60d_4f4b_8f7d_5f922082670e.slice/crio-deb479bc63dbf7670f58804260eab3f57cd33e112c282210be2515985183ad97 WatchSource:0}: Error finding container deb479bc63dbf7670f58804260eab3f57cd33e112c282210be2515985183ad97: Status 404 returned error can't find the container with id deb479bc63dbf7670f58804260eab3f57cd33e112c282210be2515985183ad97 Jun 05 20:59:26.381366 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.381332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:26.381366 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.381353 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:26.382125 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.381354 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384298 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384333 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384355 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gblp8\"" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384300 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384432 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:59:26.384491 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.384298 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k95x8\"" Jun 05 20:59:26.567009 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.566976 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="4e7a05ac649d7704414e94f9392dedf8e37c2e28dd481aebac75d9e90da86969" exitCode=0 Jun 05 20:59:26.567203 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.567073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"4e7a05ac649d7704414e94f9392dedf8e37c2e28dd481aebac75d9e90da86969"} Jun 05 20:59:26.568298 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.568275 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8snp" event={"ID":"71c59c52-b60d-4f4b-8f7d-5f922082670e","Type":"ContainerStarted","Data":"deb479bc63dbf7670f58804260eab3f57cd33e112c282210be2515985183ad97"} Jun 05 20:59:26.600063 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:26.600039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:26.600210 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:26.600194 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:26.600269 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:26.600256 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:28.600237203 +0000 UTC m=+38.672497605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:27.573576 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:27.573480 2555 generic.go:356] "Generic (PLEG): container finished" podID="b0b33df5-d88f-49aa-a45b-829c76b39db8" containerID="f5dcdc2d485318dec878b087570f4dead4414a0759aba0dab330699a199bab7c" exitCode=0 Jun 05 20:59:27.573576 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:27.573546 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerDied","Data":"f5dcdc2d485318dec878b087570f4dead4414a0759aba0dab330699a199bab7c"} Jun 05 20:59:27.575119 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:27.575094 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8snp" event={"ID":"71c59c52-b60d-4f4b-8f7d-5f922082670e","Type":"ContainerStarted","Data":"2b130abfb607956308dedd00bea79890c2891d1c12e861b2b407cdc7b23118dc"} Jun 05 20:59:27.612623 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:27.612564 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r8snp" podStartSLOduration=2.131415749 podStartE2EDuration="3.612542468s" totalImagesPullingTime="1.481126719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:27.612403516 +0000 UTC m=+37.684663904" watchObservedRunningTime="2026-06-05 20:59:27.612542468 +0000 UTC m=+37.684802834" Jun 05 20:59:28.579918 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:28.579883 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-478zd" event={"ID":"b0b33df5-d88f-49aa-a45b-829c76b39db8","Type":"ContainerStarted","Data":"77467c00a4794d595f23333aca41381b3b1b0a8ed39e1cb54ccbadc6026f115b"} Jun 05 20:59:28.603937 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:28.603891 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-478zd" podStartSLOduration=9.34344387 podStartE2EDuration="38.603872253s" totalImagesPullingTime="29.260428383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:28.602444578 +0000 UTC m=+38.674704943" watchObservedRunningTime="2026-06-05 20:59:28.603872253 +0000 UTC m=+38.676132620" Jun 05 20:59:28.613369 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:28.613346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:28.613523 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:28.613496 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:28.613578 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:28.613568 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:32.613550787 +0000 UTC m=+42.685811133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:32.641181 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:32.641140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:32.641594 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:32.641287 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:32.641594 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:32.641349 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:40.641333898 +0000 UTC m=+50.713594245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:40.693628 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:40.693591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:40.694140 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:40.693751 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:40.694140 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:40.693825 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 20:59:56.693807937 +0000 UTC m=+66.766068285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 20:59:41.939972 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.939938 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8"] Jun 05 20:59:41.969441 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.969411 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8"] Jun 05 20:59:41.969603 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.969502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:41.971648 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.971623 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 20:59:41.971769 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.971629 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 20:59:41.972024 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.972008 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 05 20:59:41.972266 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.972250 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2hv6z\"" Jun 05 20:59:41.972390 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:41.972370 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 20:59:42.105040 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.104998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516c5566-b036-4cbd-b651-c53eae16d171-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.105213 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.105051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkks\" (UniqueName: \"kubernetes.io/projected/516c5566-b036-4cbd-b651-c53eae16d171-kube-api-access-wjkks\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.206359 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.206290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516c5566-b036-4cbd-b651-c53eae16d171-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.206359 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.206344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkks\" (UniqueName: \"kubernetes.io/projected/516c5566-b036-4cbd-b651-c53eae16d171-kube-api-access-wjkks\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.210386 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.210363 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/516c5566-b036-4cbd-b651-c53eae16d171-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.213082 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.213056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkks\" (UniqueName: \"kubernetes.io/projected/516c5566-b036-4cbd-b651-c53eae16d171-kube-api-access-wjkks\") pod \"managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8\" (UID: \"516c5566-b036-4cbd-b651-c53eae16d171\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.288310 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.288267 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" Jun 05 20:59:42.417572 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.417538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8"] Jun 05 20:59:42.421958 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:59:42.421916 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod516c5566_b036_4cbd_b651_c53eae16d171.slice/crio-09e2e94becd197cdb9aadb4034d2913588ff234dc5dd52c030bf19d9ca1d0815 WatchSource:0}: Error finding container 09e2e94becd197cdb9aadb4034d2913588ff234dc5dd52c030bf19d9ca1d0815: Status 404 returned error can't find the container with id 09e2e94becd197cdb9aadb4034d2913588ff234dc5dd52c030bf19d9ca1d0815 Jun 05 20:59:42.613092 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:42.613051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" event={"ID":"516c5566-b036-4cbd-b651-c53eae16d171","Type":"ContainerStarted","Data":"09e2e94becd197cdb9aadb4034d2913588ff234dc5dd52c030bf19d9ca1d0815"} Jun 05 20:59:45.621494 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:45.621448 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" event={"ID":"516c5566-b036-4cbd-b651-c53eae16d171","Type":"ContainerStarted","Data":"214b9a42680e711d7927068613fed6a076e2ee43830788765588421a703263f4"} Jun 05 20:59:45.634980 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:45.634934 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" podStartSLOduration=2.263927528 podStartE2EDuration="4.634916162s" totalImagesPullingTime="2.370988634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:59:45.634304271 +0000 UTC m=+55.706564637" watchObservedRunningTime="2026-06-05 20:59:45.634916162 +0000 UTC m=+55.707176528" Jun 05 20:59:52.563236 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:52.563209 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gxpz9" Jun 05 20:59:56.104587 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.104543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:56.105024 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.104622 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 20:59:56.105024 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.104659 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:56.106893 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.106867 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:59:56.107129 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.107111 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:59:56.107175 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.107165 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:59:56.115718 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:56.115699 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 20:59:56.115809 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:56.115768 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 21:01:00.115749256 +0000 UTC m=+130.188009620 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : secret "metrics-daemon-secret" not found Jun 05 20:59:56.117670 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.117649 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:59:56.117969 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.117943 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0fa0879f-384c-4743-857d-91bf54e7dbdf-original-pull-secret\") pod \"global-pull-secret-syncer-mdkxv\" (UID: \"0fa0879f-384c-4743-857d-91bf54e7dbdf\") " pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:56.128093 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.128068 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85nl\" (UniqueName: \"kubernetes.io/projected/8ae17994-7118-4034-8870-9affefbe088c-kube-api-access-j85nl\") pod \"network-check-target-mcs5d\" (UID: \"8ae17994-7118-4034-8870-9affefbe088c\") " pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:56.404117 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.404041 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gblp8\"" Jun 05 20:59:56.407533 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.407499 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mdkxv" Jun 05 20:59:56.412049 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.412018 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 20:59:56.571241 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.569658 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mdkxv"] Jun 05 20:59:56.575130 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:59:56.575099 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa0879f_384c_4743_857d_91bf54e7dbdf.slice/crio-2c497d90adf33b32326f52b31f0181c2a9d72b727e0c406c12b06f4b5dbe80ed WatchSource:0}: Error finding container 2c497d90adf33b32326f52b31f0181c2a9d72b727e0c406c12b06f4b5dbe80ed: Status 404 returned error can't find the container with id 2c497d90adf33b32326f52b31f0181c2a9d72b727e0c406c12b06f4b5dbe80ed Jun 05 20:59:56.587707 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.587685 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mcs5d"] Jun 05 20:59:56.590879 ip-10-0-140-154 kubenswrapper[2555]: W0605 20:59:56.590858 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae17994_7118_4034_8870_9affefbe088c.slice/crio-3eedb2fe4c50eaed5855ec7868b5e220128dd41f97cfbced710cda9ce89e5190 WatchSource:0}: Error finding container 3eedb2fe4c50eaed5855ec7868b5e220128dd41f97cfbced710cda9ce89e5190: Status 404 returned error can't find the container with id 3eedb2fe4c50eaed5855ec7868b5e220128dd41f97cfbced710cda9ce89e5190 Jun 05 20:59:56.648590 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.648551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mdkxv" event={"ID":"0fa0879f-384c-4743-857d-91bf54e7dbdf","Type":"ContainerStarted","Data":"2c497d90adf33b32326f52b31f0181c2a9d72b727e0c406c12b06f4b5dbe80ed"} Jun 05 20:59:56.649472 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.649453 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcs5d" event={"ID":"8ae17994-7118-4034-8870-9affefbe088c","Type":"ContainerStarted","Data":"3eedb2fe4c50eaed5855ec7868b5e220128dd41f97cfbced710cda9ce89e5190"} Jun 05 20:59:56.709911 ip-10-0-140-154 kubenswrapper[2555]: I0605 20:59:56.709826 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 20:59:56.710060 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:56.709936 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:59:56.710060 ip-10-0-140-154 kubenswrapper[2555]: E0605 20:59:56.710010 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 21:00:28.709993581 +0000 UTC m=+98.782253929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 21:00:01.665001 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:01.664955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mdkxv" event={"ID":"0fa0879f-384c-4743-857d-91bf54e7dbdf","Type":"ContainerStarted","Data":"0a83b78b9d6b3d5cb18ac8567502efdf47e5ce796ad72273701d4989396f52df"} Jun 05 21:00:01.666379 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:01.666354 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mcs5d" event={"ID":"8ae17994-7118-4034-8870-9affefbe088c","Type":"ContainerStarted","Data":"8f9c1c5f75ffe32985726fc08efdc1fae4ffb2d3858e6dcc137768c221a12153"} Jun 05 21:00:01.666483 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:01.666470 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 21:00:01.678929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:01.678867 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mdkxv" podStartSLOduration=67.316532281 podStartE2EDuration="1m11.678847951s" totalImagesPullingTime="4.36231567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:00:01.678274105 +0000 UTC m=+71.750534481" watchObservedRunningTime="2026-06-05 21:00:01.678847951 +0000 UTC m=+71.751108316" Jun 05 21:00:01.691015 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:01.690964 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mcs5d" podStartSLOduration=67.347155009 podStartE2EDuration="1m11.690947091s" totalImagesPullingTime="4.343792082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:00:01.690057956 +0000 UTC m=+71.762318347" watchObservedRunningTime="2026-06-05 21:00:01.690947091 +0000 UTC m=+71.763207493" Jun 05 21:00:28.730906 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:28.730756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 21:00:28.731460 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:00:28.730910 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:00:28.731460 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:00:28.730996 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 21:01:32.730975004 +0000 UTC m=+162.803235363 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 21:00:32.671310 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:00:32.671280 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mcs5d" Jun 05 21:01:00.139332 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:00.139290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 21:01:00.139846 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:00.139445 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 21:01:00.139846 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:00.139531 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs podName:5520ee00-2d7d-4b09-bc08-6ac993d146e5 nodeName:}" failed. No retries permitted until 2026-06-05 21:03:02.139496869 +0000 UTC m=+252.211757214 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs") pod "network-metrics-daemon-xr8q4" (UID: "5520ee00-2d7d-4b09-bc08-6ac993d146e5") : secret "metrics-daemon-secret" not found Jun 05 21:01:27.847700 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:27.847643 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vdssl" podUID="c2d43edf-459f-4860-8473-ec7f153e630d" Jun 05 21:01:27.874698 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:27.874669 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdssl" Jun 05 21:01:29.394206 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:29.394151 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xr8q4" podUID="5520ee00-2d7d-4b09-bc08-6ac993d146e5" Jun 05 21:01:32.765700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:32.765668 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 21:01:32.766111 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:32.765789 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 21:01:32.766111 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:01:32.765843 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls podName:c2d43edf-459f-4860-8473-ec7f153e630d nodeName:}" failed. No retries permitted until 2026-06-05 21:03:34.765829077 +0000 UTC m=+284.838089422 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls") pod "dns-default-vdssl" (UID: "c2d43edf-459f-4860-8473-ec7f153e630d") : secret "dns-default-metrics-tls" not found Jun 05 21:01:43.381018 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:43.380940 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 21:01:45.921796 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:45.921762 2555 generic.go:356] "Generic (PLEG): container finished" podID="516c5566-b036-4cbd-b651-c53eae16d171" containerID="214b9a42680e711d7927068613fed6a076e2ee43830788765588421a703263f4" exitCode=255 Jun 05 21:01:45.922176 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:45.921809 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" event={"ID":"516c5566-b036-4cbd-b651-c53eae16d171","Type":"ContainerDied","Data":"214b9a42680e711d7927068613fed6a076e2ee43830788765588421a703263f4"} Jun 05 21:01:45.927325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:45.927309 2555 scope.go:117] "RemoveContainer" containerID="214b9a42680e711d7927068613fed6a076e2ee43830788765588421a703263f4" Jun 05 21:01:46.926399 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:01:46.926362 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8fff87d8-7dbp8" event={"ID":"516c5566-b036-4cbd-b651-c53eae16d171","Type":"ContainerStarted","Data":"9b47fa26dbc3b2a5dfd7afee361339c2b2aa41692a8bab16d63420276f917a50"} Jun 05 21:02:15.874139 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.874101 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hqs9b"] Jun 05 21:02:15.876210 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.876190 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bd848c65f-t5v2k"] Jun 05 21:02:15.876356 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.876326 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:15.878172 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878126 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-knkrz\"" Jun 05 21:02:15.878172 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878135 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 21:02:15.878377 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878242 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:02:15.878377 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878242 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.878377 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878255 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 21:02:15.878546 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.878406 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 21:02:15.880238 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.880220 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 21:02:15.880371 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.880244 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 21:02:15.880975 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.880954 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 21:02:15.880975 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.880967 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 21:02:15.881158 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.880967 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-74rjt\"" Jun 05 21:02:15.881158 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.881020 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 21:02:15.881290 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.881172 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 21:02:15.884315 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.884298 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 21:02:15.889046 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.889021 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hqs9b"] Jun 05 21:02:15.892070 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.892047 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd848c65f-t5v2k"] Jun 05 21:02:15.950216 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950175 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-serving-cert\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:15.950216 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84ntq\" (UniqueName: \"kubernetes.io/projected/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-kube-api-access-84ntq\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvdjr\" (UniqueName: \"kubernetes.io/projected/ac8c3381-c2cd-4858-a125-9e5ae5905b55-kube-api-access-mvdjr\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-stats-auth\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950314 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-config\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950342 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-trusted-ca\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:15.950465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.950403 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-default-certificate\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:15.976044 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.976012 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj"] Jun 05 21:02:15.978194 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.978180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:15.980392 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.980363 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 21:02:15.980608 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.980589 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rgrnp\"" Jun 05 21:02:15.980680 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.980599 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:02:15.980680 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.980623 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 21:02:15.991172 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:15.991148 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj"] Jun 05 21:02:16.051601 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-config\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051609 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051651 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-trusted-ca\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051684 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-default-certificate\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051728 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-serving-cert\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.051767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051751 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84ntq\" (UniqueName: \"kubernetes.io/projected/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-kube-api-access-84ntq\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.051795 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:16.551770441 +0000 UTC m=+206.624030822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : configmap references non-existent config key: service-ca.crt Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d9tx\" (UniqueName: \"kubernetes.io/projected/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-kube-api-access-5d9tx\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvdjr\" (UniqueName: \"kubernetes.io/projected/ac8c3381-c2cd-4858-a125-9e5ae5905b55-kube-api-access-mvdjr\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051935 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-stats-auth\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.051963 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.052074 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.052062 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:02:16.052378 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.052114 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:16.552098368 +0000 UTC m=+206.624358729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : secret "router-metrics-certs-default" not found Jun 05 21:02:16.052378 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.052354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-config\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.052491 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.052456 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-trusted-ca\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.054212 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.054188 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-serving-cert\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.054323 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.054210 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-default-certificate\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.054323 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.054282 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-stats-auth\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.065127 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.065102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84ntq\" (UniqueName: \"kubernetes.io/projected/b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80-kube-api-access-84ntq\") pod \"console-operator-668fdbf85c-hqs9b\" (UID: \"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80\") " pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.065306 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.065286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvdjr\" (UniqueName: \"kubernetes.io/projected/ac8c3381-c2cd-4858-a125-9e5ae5905b55-kube-api-access-mvdjr\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.069631 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.069606 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:02:16.072319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.072304 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.074183 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.074164 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 21:02:16.074473 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.074458 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 21:02:16.074569 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.074546 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9mmq4\"" Jun 05 21:02:16.074715 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.074701 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 21:02:16.079771 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.079748 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 21:02:16.083356 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.083338 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:02:16.152865 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.152865 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152803 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.152865 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7hk\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152890 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.152975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d9tx\" (UniqueName: \"kubernetes.io/projected/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-kube-api-access-5d9tx\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.153021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.153042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.153064 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.153071 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:02:16.153144 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.153151 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls podName:d5c74c91-503c-4ac6-9ea5-9f1f595336e7 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:16.653128092 +0000 UTC m=+206.725388440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dm9bj" (UID: "d5c74c91-503c-4ac6-9ea5-9f1f595336e7") : secret "samples-operator-tls" not found Jun 05 21:02:16.153441 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.153171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.160616 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.160588 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d9tx\" (UniqueName: \"kubernetes.io/projected/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-kube-api-access-5d9tx\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.186559 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.186502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:16.253568 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253682 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253855 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253855 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7hk\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.253942 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.253861 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:02:16.253942 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.253878 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-859f55cdd8-wtnlr: secret "image-registry-tls" not found Jun 05 21:02:16.253942 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.253940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls podName:b14ce7e6-e880-420a-8340-49b53c46b7e9 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:16.753920997 +0000 UTC m=+206.826181349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls") pod "image-registry-859f55cdd8-wtnlr" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9") : secret "image-registry-tls" not found Jun 05 21:02:16.254116 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.253999 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.254664 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.254607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.254802 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.254751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.254872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.254857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.256032 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.256007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.256237 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.256218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.262147 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.262121 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.262241 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.262216 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7hk\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.300880 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.300821 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hqs9b"] Jun 05 21:02:16.303217 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:16.303192 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bfebcd_6554_4d47_8bcb_e14aeb3c6c80.slice/crio-dec735d26ca8b2d23fbab4e18d0c7330677c585b13f3e68d867cd314bab1aab9 WatchSource:0}: Error finding container dec735d26ca8b2d23fbab4e18d0c7330677c585b13f3e68d867cd314bab1aab9: Status 404 returned error can't find the container with id dec735d26ca8b2d23fbab4e18d0c7330677c585b13f3e68d867cd314bab1aab9 Jun 05 21:02:16.556724 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.556692 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.556865 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.556791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:16.556921 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.556860 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:02:16.556921 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.556905 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:17.556891298 +0000 UTC m=+207.629151642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : configmap references non-existent config key: service-ca.crt Jun 05 21:02:16.556921 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.556920 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:17.556913591 +0000 UTC m=+207.629173935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : secret "router-metrics-certs-default" not found Jun 05 21:02:16.657796 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.657752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:16.657976 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.657896 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:02:16.657976 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.657964 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls podName:d5c74c91-503c-4ac6-9ea5-9f1f595336e7 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:17.657947199 +0000 UTC m=+207.730207547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dm9bj" (UID: "d5c74c91-503c-4ac6-9ea5-9f1f595336e7") : secret "samples-operator-tls" not found Jun 05 21:02:16.758602 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:16.758562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:16.758765 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.758705 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:02:16.758765 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.758722 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-859f55cdd8-wtnlr: secret "image-registry-tls" not found Jun 05 21:02:16.758834 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:16.758772 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls podName:b14ce7e6-e880-420a-8340-49b53c46b7e9 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:17.758758164 +0000 UTC m=+207.831018512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls") pod "image-registry-859f55cdd8-wtnlr" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9") : secret "image-registry-tls" not found Jun 05 21:02:17.015426 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:17.015348 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" event={"ID":"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80","Type":"ContainerStarted","Data":"dec735d26ca8b2d23fbab4e18d0c7330677c585b13f3e68d867cd314bab1aab9"} Jun 05 21:02:17.565623 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:17.565578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:17.565823 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:17.565655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:17.565823 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.565781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:19.565758768 +0000 UTC m=+209.638019127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : configmap references non-existent config key: service-ca.crt Jun 05 21:02:17.565823 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.565784 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:02:17.565973 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.565853 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:19.565834268 +0000 UTC m=+209.638094631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : secret "router-metrics-certs-default" not found Jun 05 21:02:17.666455 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:17.666417 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:17.666659 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.666596 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:02:17.666713 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.666681 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls podName:d5c74c91-503c-4ac6-9ea5-9f1f595336e7 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:19.666658702 +0000 UTC m=+209.738919067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dm9bj" (UID: "d5c74c91-503c-4ac6-9ea5-9f1f595336e7") : secret "samples-operator-tls" not found Jun 05 21:02:17.767194 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:17.767162 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:17.767358 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.767289 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:02:17.767358 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.767301 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-859f55cdd8-wtnlr: secret "image-registry-tls" not found Jun 05 21:02:17.767358 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:17.767349 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls podName:b14ce7e6-e880-420a-8340-49b53c46b7e9 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:19.767335729 +0000 UTC m=+209.839596074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls") pod "image-registry-859f55cdd8-wtnlr" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9") : secret "image-registry-tls" not found Jun 05 21:02:19.028410 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.028380 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/0.log" Jun 05 21:02:19.028792 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.028420 2555 generic.go:356] "Generic (PLEG): container finished" podID="b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80" containerID="80b7060a6e5651706ff22ba52e1392bf5009800a7dc923277429342ffaef8977" exitCode=255 Jun 05 21:02:19.028792 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.028450 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" event={"ID":"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80","Type":"ContainerDied","Data":"80b7060a6e5651706ff22ba52e1392bf5009800a7dc923277429342ffaef8977"} Jun 05 21:02:19.028792 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.028716 2555 scope.go:117] "RemoveContainer" containerID="80b7060a6e5651706ff22ba52e1392bf5009800a7dc923277429342ffaef8977" Jun 05 21:02:19.581598 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.581566 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:19.581730 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.581688 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:19.581790 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.581723 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:02:19.581825 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.581793 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:23.581774811 +0000 UTC m=+213.654035171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : secret "router-metrics-certs-default" not found Jun 05 21:02:19.581825 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.581813 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:23.581803132 +0000 UTC m=+213.654063491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : configmap references non-existent config key: service-ca.crt Jun 05 21:02:19.682548 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.682501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:19.682700 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.682605 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:02:19.682700 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.682668 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls podName:d5c74c91-503c-4ac6-9ea5-9f1f595336e7 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:23.682653091 +0000 UTC m=+213.754913439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dm9bj" (UID: "d5c74c91-503c-4ac6-9ea5-9f1f595336e7") : secret "samples-operator-tls" not found Jun 05 21:02:19.783319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:19.783277 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:19.783473 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.783431 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:02:19.783473 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.783453 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-859f55cdd8-wtnlr: secret "image-registry-tls" not found Jun 05 21:02:19.783605 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:19.783531 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls podName:b14ce7e6-e880-420a-8340-49b53c46b7e9 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:23.783494757 +0000 UTC m=+213.855755105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls") pod "image-registry-859f55cdd8-wtnlr" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9") : secret "image-registry-tls" not found Jun 05 21:02:20.032820 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.032748 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:02:20.033203 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.033139 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/0.log" Jun 05 21:02:20.033203 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.033172 2555 generic.go:356] "Generic (PLEG): container finished" podID="b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80" containerID="f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba" exitCode=255 Jun 05 21:02:20.033270 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.033238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" event={"ID":"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80","Type":"ContainerDied","Data":"f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba"} Jun 05 21:02:20.033304 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.033291 2555 scope.go:117] "RemoveContainer" containerID="80b7060a6e5651706ff22ba52e1392bf5009800a7dc923277429342ffaef8977" Jun 05 21:02:20.033526 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:20.033493 2555 scope.go:117] "RemoveContainer" containerID="f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba" Jun 05 21:02:20.033686 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:20.033669 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hqs9b_openshift-console-operator(b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" podUID="b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80" Jun 05 21:02:21.037833 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.037804 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:02:21.038358 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.038129 2555 scope.go:117] "RemoveContainer" containerID="f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba" Jun 05 21:02:21.038358 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:21.038271 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hqs9b_openshift-console-operator(b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" podUID="b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80" Jun 05 21:02:21.199217 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.199186 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp"] Jun 05 21:02:21.201721 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.201706 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" Jun 05 21:02:21.203633 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.203607 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 21:02:21.203758 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.203607 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 21:02:21.203758 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.203746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hc2sc\"" Jun 05 21:02:21.208988 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.208970 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp"] Jun 05 21:02:21.294425 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.294340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qwxt\" (UniqueName: \"kubernetes.io/projected/a6c98110-dd0e-4189-8b1d-69a88453d09f-kube-api-access-2qwxt\") pod \"migrator-955ffdf5f-6wgfp\" (UID: \"a6c98110-dd0e-4189-8b1d-69a88453d09f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" Jun 05 21:02:21.394892 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.394856 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qwxt\" (UniqueName: \"kubernetes.io/projected/a6c98110-dd0e-4189-8b1d-69a88453d09f-kube-api-access-2qwxt\") pod \"migrator-955ffdf5f-6wgfp\" (UID: \"a6c98110-dd0e-4189-8b1d-69a88453d09f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" Jun 05 21:02:21.402617 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.402592 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qwxt\" (UniqueName: \"kubernetes.io/projected/a6c98110-dd0e-4189-8b1d-69a88453d09f-kube-api-access-2qwxt\") pod \"migrator-955ffdf5f-6wgfp\" (UID: \"a6c98110-dd0e-4189-8b1d-69a88453d09f\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" Jun 05 21:02:21.511145 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.511101 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" Jun 05 21:02:21.629404 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:21.629373 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp"] Jun 05 21:02:21.632081 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:21.632054 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c98110_dd0e_4189_8b1d_69a88453d09f.slice/crio-7178d28ec67d9a56549528a8146a81ec9539167d1499bd0a8772f80d19040485 WatchSource:0}: Error finding container 7178d28ec67d9a56549528a8146a81ec9539167d1499bd0a8772f80d19040485: Status 404 returned error can't find the container with id 7178d28ec67d9a56549528a8146a81ec9539167d1499bd0a8772f80d19040485 Jun 05 21:02:22.042205 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:22.042113 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" event={"ID":"a6c98110-dd0e-4189-8b1d-69a88453d09f","Type":"ContainerStarted","Data":"7178d28ec67d9a56549528a8146a81ec9539167d1499bd0a8772f80d19040485"} Jun 05 21:02:22.437845 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:22.437813 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnp9x_db9cf996-815a-4eb9-a3b0-09b2e40b19e6/dns-node-resolver/0.log" Jun 05 21:02:23.611773 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:23.611737 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:23.612130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:23.611788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:23.612130 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.611905 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:31.611886864 +0000 UTC m=+221.684147211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : configmap references non-existent config key: service-ca.crt Jun 05 21:02:23.612130 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.611910 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 21:02:23.612130 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.611947 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs podName:ac8c3381-c2cd-4858-a125-9e5ae5905b55 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:31.611937776 +0000 UTC m=+221.684198120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs") pod "router-default-7bd848c65f-t5v2k" (UID: "ac8c3381-c2cd-4858-a125-9e5ae5905b55") : secret "router-metrics-certs-default" not found Jun 05 21:02:23.640138 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:23.640111 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhbrn_0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19/node-ca/0.log" Jun 05 21:02:23.712971 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:23.712936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:23.713123 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.713090 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 21:02:23.713174 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.713152 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls podName:d5c74c91-503c-4ac6-9ea5-9f1f595336e7 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:31.713136718 +0000 UTC m=+221.785397062 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-dm9bj" (UID: "d5c74c91-503c-4ac6-9ea5-9f1f595336e7") : secret "samples-operator-tls" not found Jun 05 21:02:23.813565 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:23.813531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:23.813706 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.813685 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 21:02:23.813775 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.813708 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-859f55cdd8-wtnlr: secret "image-registry-tls" not found Jun 05 21:02:23.813775 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:23.813766 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls podName:b14ce7e6-e880-420a-8340-49b53c46b7e9 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:31.813747278 +0000 UTC m=+221.886007643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls") pod "image-registry-859f55cdd8-wtnlr" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9") : secret "image-registry-tls" not found Jun 05 21:02:24.050047 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:24.050007 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" event={"ID":"a6c98110-dd0e-4189-8b1d-69a88453d09f","Type":"ContainerStarted","Data":"d4cd4a697ac433b0529f9b5f6e4c694c2aa010c2fbd32c606c13575089322fdd"} Jun 05 21:02:24.050219 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:24.050066 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" event={"ID":"a6c98110-dd0e-4189-8b1d-69a88453d09f","Type":"ContainerStarted","Data":"ef70f53351119a265edeaf38d1e860f4eddc9946865942afe633944dc588e083"} Jun 05 21:02:24.067603 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:24.067557 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-6wgfp" podStartSLOduration=1.442988051 podStartE2EDuration="3.067542485s" totalImagesPullingTime="1.624554434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:24.066704821 +0000 UTC m=+214.138965209" watchObservedRunningTime="2026-06-05 21:02:24.067542485 +0000 UTC m=+214.139802924" Jun 05 21:02:24.238044 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:24.238004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8snp_71c59c52-b60d-4f4b-8f7d-5f922082670e/serve-healthcheck-canary/0.log" Jun 05 21:02:26.187063 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:26.187012 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:26.187426 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:26.187084 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:26.187426 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:26.187388 2555 scope.go:117] "RemoveContainer" containerID="f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba" Jun 05 21:02:26.187571 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:26.187552 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hqs9b_openshift-console-operator(b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" podUID="b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80" Jun 05 21:02:31.678013 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.677975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:31.678394 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.678096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:31.678727 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.678710 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac8c3381-c2cd-4858-a125-9e5ae5905b55-service-ca-bundle\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:31.680380 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.680358 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac8c3381-c2cd-4858-a125-9e5ae5905b55-metrics-certs\") pod \"router-default-7bd848c65f-t5v2k\" (UID: \"ac8c3381-c2cd-4858-a125-9e5ae5905b55\") " pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:31.778881 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.778824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:31.781101 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.781082 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5c74c91-503c-4ac6-9ea5-9f1f595336e7-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-dm9bj\" (UID: \"d5c74c91-503c-4ac6-9ea5-9f1f595336e7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:31.792036 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.792005 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:31.880062 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.880027 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:31.883084 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.883052 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"image-registry-859f55cdd8-wtnlr\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:31.886721 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.886664 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" Jun 05 21:02:31.914362 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.914332 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd848c65f-t5v2k"] Jun 05 21:02:31.917684 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:31.917660 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8c3381_c2cd_4858_a125_9e5ae5905b55.slice/crio-26fcb88d7ccd752bea190d6c13233766e4c9dd0c827b02b7b45de37028f07fb7 WatchSource:0}: Error finding container 26fcb88d7ccd752bea190d6c13233766e4c9dd0c827b02b7b45de37028f07fb7: Status 404 returned error can't find the container with id 26fcb88d7ccd752bea190d6c13233766e4c9dd0c827b02b7b45de37028f07fb7 Jun 05 21:02:31.981252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:31.981185 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:32.018100 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.018063 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj"] Jun 05 21:02:32.073998 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.073961 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" event={"ID":"d5c74c91-503c-4ac6-9ea5-9f1f595336e7","Type":"ContainerStarted","Data":"b6869b8fd57a85f20cbeb47460403591129443712283019b0c90aebb3c436021"} Jun 05 21:02:32.075963 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.075924 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" event={"ID":"ac8c3381-c2cd-4858-a125-9e5ae5905b55","Type":"ContainerStarted","Data":"f54ffc26253ec8b52cba355bf88657b98c4a8f9db9bb952a50847ec0285d3526"} Jun 05 21:02:32.076077 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.075969 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" event={"ID":"ac8c3381-c2cd-4858-a125-9e5ae5905b55","Type":"ContainerStarted","Data":"26fcb88d7ccd752bea190d6c13233766e4c9dd0c827b02b7b45de37028f07fb7"} Jun 05 21:02:32.091652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.091606 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" podStartSLOduration=17.091588982 podStartE2EDuration="17.091588982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:32.090613346 +0000 UTC m=+222.162873714" watchObservedRunningTime="2026-06-05 21:02:32.091588982 +0000 UTC m=+222.163849348" Jun 05 21:02:32.116535 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.116486 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:02:32.119344 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:32.119318 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14ce7e6_e880_420a_8340_49b53c46b7e9.slice/crio-dc5d1073fe951d1adad0d1126c6f5cc1369f8306144083b560554920d624c816 WatchSource:0}: Error finding container dc5d1073fe951d1adad0d1126c6f5cc1369f8306144083b560554920d624c816: Status 404 returned error can't find the container with id dc5d1073fe951d1adad0d1126c6f5cc1369f8306144083b560554920d624c816 Jun 05 21:02:32.792671 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.792632 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:32.795810 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:32.795780 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:33.080664 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.080623 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" event={"ID":"b14ce7e6-e880-420a-8340-49b53c46b7e9","Type":"ContainerStarted","Data":"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88"} Jun 05 21:02:33.080923 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.080683 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" event={"ID":"b14ce7e6-e880-420a-8340-49b53c46b7e9","Type":"ContainerStarted","Data":"dc5d1073fe951d1adad0d1126c6f5cc1369f8306144083b560554920d624c816"} Jun 05 21:02:33.080923 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.080851 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:33.080923 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.080893 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:02:33.082220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.082197 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bd848c65f-t5v2k" Jun 05 21:02:33.100835 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:33.100764 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" podStartSLOduration=17.100743584 podStartE2EDuration="17.100743584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:33.099339388 +0000 UTC m=+223.171599751" watchObservedRunningTime="2026-06-05 21:02:33.100743584 +0000 UTC m=+223.173003951" Jun 05 21:02:34.085892 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:34.085860 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" event={"ID":"d5c74c91-503c-4ac6-9ea5-9f1f595336e7","Type":"ContainerStarted","Data":"9f8ecd44297f9e332f630348a23dfa21c98d5ad39dbf5ff92e0d9681afe31b97"} Jun 05 21:02:35.090635 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:35.090600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" event={"ID":"d5c74c91-503c-4ac6-9ea5-9f1f595336e7","Type":"ContainerStarted","Data":"f62106b1399ffd33fe083c5fe5eb118451d25977db6d714bd39857012732a05b"} Jun 05 21:02:35.104777 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:35.104730 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-dm9bj" podStartSLOduration=18.171603739 podStartE2EDuration="20.104716044s" totalImagesPullingTime="1.933112305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:35.103580792 +0000 UTC m=+225.175841158" watchObservedRunningTime="2026-06-05 21:02:35.104716044 +0000 UTC m=+225.176976410" Jun 05 21:02:38.382499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:38.382467 2555 scope.go:117] "RemoveContainer" containerID="f45a14bae466af470b782baf4b2cec38e7c294c4a78a40cc612eec159991c1ba" Jun 05 21:02:39.104593 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:39.104565 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:02:39.104775 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:39.104651 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" event={"ID":"b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80","Type":"ContainerStarted","Data":"9fc8eead91e29cce3a4867db1cb2a4de7739a78f3aac23b9fbd4125565cd1d71"} Jun 05 21:02:39.104927 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:39.104908 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:39.119260 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:39.119212 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" podStartSLOduration=21.936086902 podStartE2EDuration="24.1191979s" totalImagesPullingTime="2.183110998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:39.118417757 +0000 UTC m=+229.190678122" watchObservedRunningTime="2026-06-05 21:02:39.1191979 +0000 UTC m=+229.191458266" Jun 05 21:02:39.206442 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:39.206414 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-hqs9b" Jun 05 21:02:45.364186 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.364149 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p7mdn"] Jun 05 21:02:45.367066 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.367040 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.370012 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.369989 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4q526\"" Jun 05 21:02:45.370174 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.369992 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 21:02:45.370276 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.370260 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 21:02:45.370352 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.370272 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 21:02:45.370409 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.370370 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 21:02:45.381042 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.381013 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7mdn"] Jun 05 21:02:45.429779 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.429751 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:02:45.489775 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.489738 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229d9f6c-d987-410d-9cb2-e6397839a641-crio-socket\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.489936 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.489867 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229d9f6c-d987-410d-9cb2-e6397839a641-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.489936 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.489909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229d9f6c-d987-410d-9cb2-e6397839a641-data-volume\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.490054 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.490025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229d9f6c-d987-410d-9cb2-e6397839a641-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.490113 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.490098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp864\" (UniqueName: \"kubernetes.io/projected/229d9f6c-d987-410d-9cb2-e6397839a641-kube-api-access-sp864\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590556 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590500 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp864\" (UniqueName: \"kubernetes.io/projected/229d9f6c-d987-410d-9cb2-e6397839a641-kube-api-access-sp864\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229d9f6c-d987-410d-9cb2-e6397839a641-crio-socket\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590637 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229d9f6c-d987-410d-9cb2-e6397839a641-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229d9f6c-d987-410d-9cb2-e6397839a641-data-volume\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/229d9f6c-d987-410d-9cb2-e6397839a641-crio-socket\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.590750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.590716 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229d9f6c-d987-410d-9cb2-e6397839a641-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.591109 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.591087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/229d9f6c-d987-410d-9cb2-e6397839a641-data-volume\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.591290 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.591269 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/229d9f6c-d987-410d-9cb2-e6397839a641-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.593053 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.593034 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/229d9f6c-d987-410d-9cb2-e6397839a641-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.600566 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.600544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp864\" (UniqueName: \"kubernetes.io/projected/229d9f6c-d987-410d-9cb2-e6397839a641-kube-api-access-sp864\") pod \"insights-runtime-extractor-p7mdn\" (UID: \"229d9f6c-d987-410d-9cb2-e6397839a641\") " pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.677424 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.677339 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p7mdn" Jun 05 21:02:45.799318 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:45.799297 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p7mdn"] Jun 05 21:02:45.801897 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:45.801862 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229d9f6c_d987_410d_9cb2_e6397839a641.slice/crio-deecbed02ff37e817731ff45c65482e8b5e4607fc7b832583fa3f2aad7f4c993 WatchSource:0}: Error finding container deecbed02ff37e817731ff45c65482e8b5e4607fc7b832583fa3f2aad7f4c993: Status 404 returned error can't find the container with id deecbed02ff37e817731ff45c65482e8b5e4607fc7b832583fa3f2aad7f4c993 Jun 05 21:02:46.127877 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:46.127839 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7mdn" event={"ID":"229d9f6c-d987-410d-9cb2-e6397839a641","Type":"ContainerStarted","Data":"d58ac4e1d938e058c63954695b389b081ff3bb23eb5005a05b905b65e31dd2b6"} Jun 05 21:02:46.128073 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:46.127893 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7mdn" event={"ID":"229d9f6c-d987-410d-9cb2-e6397839a641","Type":"ContainerStarted","Data":"deecbed02ff37e817731ff45c65482e8b5e4607fc7b832583fa3f2aad7f4c993"} Jun 05 21:02:47.132337 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:47.132304 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7mdn" event={"ID":"229d9f6c-d987-410d-9cb2-e6397839a641","Type":"ContainerStarted","Data":"ecf56792331065558ed2f72866365970433ab5a709a60b8ac3c27c00a27ba486"} Jun 05 21:02:49.144625 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:49.144589 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p7mdn" event={"ID":"229d9f6c-d987-410d-9cb2-e6397839a641","Type":"ContainerStarted","Data":"8e76ab628047dc0e633c48cfd28188bd69a91ae548997b5406073099286484b1"} Jun 05 21:02:49.160234 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:49.160190 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p7mdn" podStartSLOduration=1.6998305139999998 podStartE2EDuration="4.160175893s" totalImagesPullingTime="2.460345379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:02:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:49.158590148 +0000 UTC m=+239.230850533" watchObservedRunningTime="2026-06-05 21:02:49.160175893 +0000 UTC m=+239.232436286" Jun 05 21:02:54.578981 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.578946 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9"] Jun 05 21:02:54.581843 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.581825 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.583924 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.583904 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-npwpf\"" Jun 05 21:02:54.584007 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.583929 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 21:02:54.584007 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.583904 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 21:02:54.584367 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.584345 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 21:02:54.584604 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.584580 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 21:02:54.584822 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.584804 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 21:02:54.590907 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.590888 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9"] Jun 05 21:02:54.606104 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.606076 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cmwkf"] Jun 05 21:02:54.608106 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.608090 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.609931 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.609909 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 21:02:54.610049 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.609961 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 21:02:54.610049 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.610032 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6tt9d\"" Jun 05 21:02:54.610153 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.610076 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 21:02:54.761992 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.761963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzbz\" (UniqueName: \"kubernetes.io/projected/0b9eec09-89a8-4cfb-891c-f888edeee8f0-kube-api-access-bqzbz\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.761992 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.761995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-root\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762021 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-sys\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762129 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z46q\" (UniqueName: \"kubernetes.io/projected/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-kube-api-access-9z46q\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762172 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-wtmp\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-tls\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-metrics-client-ca\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762221 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-textfile\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762548 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762242 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.762548 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762262 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.762548 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.762276 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.862991 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.862916 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.862991 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.862950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.862991 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.862981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzbz\" (UniqueName: \"kubernetes.io/projected/0b9eec09-89a8-4cfb-891c-f888edeee8f0-kube-api-access-bqzbz\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.862997 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-root\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863023 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-sys\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863080 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-root\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:54.863087 2555 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863120 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-sys\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863258 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:54.863158 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls podName:e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb nodeName:}" failed. No retries permitted until 2026-06-05 21:02:55.363138681 +0000 UTC m=+245.435399034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-p89j9" (UID: "e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb") : secret "openshift-state-metrics-tls" not found Jun 05 21:02:54.863642 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.863697 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z46q\" (UniqueName: \"kubernetes.io/projected/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-kube-api-access-9z46q\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.863697 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863681 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863792 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-wtmp\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863792 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863771 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-tls\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863893 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863792 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-metrics-client-ca\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863893 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863747 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.863893 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-textfile\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863893 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-wtmp\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.863893 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.863860 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.864394 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.864203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-textfile\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.864394 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.864270 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b9eec09-89a8-4cfb-891c-f888edeee8f0-metrics-client-ca\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.865621 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.865605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.866434 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.866412 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-tls\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.866535 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.866491 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b9eec09-89a8-4cfb-891c-f888edeee8f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.870157 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.870131 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzbz\" (UniqueName: \"kubernetes.io/projected/0b9eec09-89a8-4cfb-891c-f888edeee8f0-kube-api-access-bqzbz\") pod \"node-exporter-cmwkf\" (UID: \"0b9eec09-89a8-4cfb-891c-f888edeee8f0\") " pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.870824 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.870805 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z46q\" (UniqueName: \"kubernetes.io/projected/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-kube-api-access-9z46q\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:54.916709 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:54.916684 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cmwkf" Jun 05 21:02:54.925947 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:54.925921 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9eec09_89a8_4cfb_891c_f888edeee8f0.slice/crio-2b1b4a83e6f39015edfdd6c9bfff0e566ae0efa2cc2d32a6d3c3021aa3a821c7 WatchSource:0}: Error finding container 2b1b4a83e6f39015edfdd6c9bfff0e566ae0efa2cc2d32a6d3c3021aa3a821c7: Status 404 returned error can't find the container with id 2b1b4a83e6f39015edfdd6c9bfff0e566ae0efa2cc2d32a6d3c3021aa3a821c7 Jun 05 21:02:55.163836 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.163752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmwkf" event={"ID":"0b9eec09-89a8-4cfb-891c-f888edeee8f0","Type":"ContainerStarted","Data":"2b1b4a83e6f39015edfdd6c9bfff0e566ae0efa2cc2d32a6d3c3021aa3a821c7"} Jun 05 21:02:55.368057 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.368018 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:55.370304 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.370283 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-p89j9\" (UID: \"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:55.436356 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.436279 2555 patch_prober.go:28] interesting pod/image-registry-859f55cdd8-wtnlr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:02:55.436356 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.436330 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:02:55.491624 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.491589 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" Jun 05 21:02:55.632935 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.632899 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9"] Jun 05 21:02:55.659456 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.659417 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:02:55.662618 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.662598 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.664598 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664542 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 21:02:55.664598 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664583 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 21:02:55.664873 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664772 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 21:02:55.664873 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664799 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 21:02:55.664873 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664846 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 21:02:55.665163 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.664966 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 21:02:55.665163 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.665076 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 21:02:55.665346 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.665299 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 21:02:55.665634 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.665461 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5t587\"" Jun 05 21:02:55.665634 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.665535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 21:02:55.678050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.678020 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:02:55.771520 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771411 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771520 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771565 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk44h\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771698 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771734 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771984 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771984 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771984 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771984 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.771984 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.771961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.772201 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.772013 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.815841 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:55.815813 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b5e36e_8bc8_4fc5_861d_3329d3f9c1eb.slice/crio-29d943a94151da9cb645b03fdc7d40029fec349866a0c5f62cc13f2463216e13 WatchSource:0}: Error finding container 29d943a94151da9cb645b03fdc7d40029fec349866a0c5f62cc13f2463216e13: Status 404 returned error can't find the container with id 29d943a94151da9cb645b03fdc7d40029fec349866a0c5f62cc13f2463216e13 Jun 05 21:02:55.872731 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.872847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872746 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.872847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk44h\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.872847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.872847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873050 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:55.872871 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle podName:ef495a25-fdf6-477b-a3be-a42c8d703673 nodeName:}" failed. No retries permitted until 2026-06-05 21:02:56.372854192 +0000 UTC m=+246.445114540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673") : configmap references non-existent config key: ca-bundle.crt Jun 05 21:02:55.873050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.872989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873204 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873234 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873307 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.873951 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.873688 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.875691 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.875668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.875845 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.875821 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.875947 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.875854 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.876010 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.875977 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.876200 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.876181 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.876259 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.876212 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.876328 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.876307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.876796 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.876773 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.877199 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.877184 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:55.880522 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:55.880489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk44h\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:56.168620 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.168576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" event={"ID":"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb","Type":"ContainerStarted","Data":"17cdb8f47268c2b62ff1df806ada70b02fa017724c190d6bc254dba08d3f805a"} Jun 05 21:02:56.168818 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.168677 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" event={"ID":"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb","Type":"ContainerStarted","Data":"b44dcb838afd4dab38f3517c437dfb6a8665f86e4dad1ed361800f5a982082aa"} Jun 05 21:02:56.168818 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.168707 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" event={"ID":"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb","Type":"ContainerStarted","Data":"29d943a94151da9cb645b03fdc7d40029fec349866a0c5f62cc13f2463216e13"} Jun 05 21:02:56.170071 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.170030 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b9eec09-89a8-4cfb-891c-f888edeee8f0" containerID="f85e78555e54a1a489dba471d1a671dbb39b218e3966ea235b8403b0db45b98a" exitCode=0 Jun 05 21:02:56.170302 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.170096 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmwkf" event={"ID":"0b9eec09-89a8-4cfb-891c-f888edeee8f0","Type":"ContainerDied","Data":"f85e78555e54a1a489dba471d1a671dbb39b218e3966ea235b8403b0db45b98a"} Jun 05 21:02:56.377843 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.377803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:56.378665 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.378638 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:56.485105 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.485072 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:02:56.487374 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.487358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.489232 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489196 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 21:02:56.489232 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489219 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 21:02:56.489393 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489245 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 21:02:56.489533 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489498 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:02:56.489533 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489502 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 21:02:56.489635 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489563 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:02:56.489813 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7frsw\"" Jun 05 21:02:56.489885 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.489856 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 21:02:56.493387 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.493366 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 21:02:56.495919 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.495899 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:02:56.573971 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.573928 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:02:56.580342 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580474 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580699 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.580699 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.580666 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svhqr\" (UniqueName: \"kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681165 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681124 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681165 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681688 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681688 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681688 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681297 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svhqr\" (UniqueName: \"kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681688 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.681688 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.681331 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.682210 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.682185 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.682283 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.682247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.682891 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.682866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.683388 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.683342 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.684977 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.684954 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.685460 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.685425 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.691212 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.691185 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svhqr\" (UniqueName: \"kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr\") pod \"console-54d95fd97-rmhxk\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.726748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.726713 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:02:56.730158 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:56.730126 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef495a25_fdf6_477b_a3be_a42c8d703673.slice/crio-c65654aacbbb9791fdd700206ef8109f8aab7b5b7839f5ebabedf7938905aaff WatchSource:0}: Error finding container c65654aacbbb9791fdd700206ef8109f8aab7b5b7839f5ebabedf7938905aaff: Status 404 returned error can't find the container with id c65654aacbbb9791fdd700206ef8109f8aab7b5b7839f5ebabedf7938905aaff Jun 05 21:02:56.797660 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.797626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:02:56.930116 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:56.930036 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:02:57.031812 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:02:57.031771 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5aea884_2a21_46a1_a2a3_e15f18ac698b.slice/crio-9d246fc71272405410e3e8f8cfdeeff4f92b2d94051786de3eae14f0bcd34aba WatchSource:0}: Error finding container 9d246fc71272405410e3e8f8cfdeeff4f92b2d94051786de3eae14f0bcd34aba: Status 404 returned error can't find the container with id 9d246fc71272405410e3e8f8cfdeeff4f92b2d94051786de3eae14f0bcd34aba Jun 05 21:02:57.177933 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.177901 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" event={"ID":"e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb","Type":"ContainerStarted","Data":"1a6aaee4be90dde142587c8772740dde5145eb336d1740faf03a1988b3065fb0"} Jun 05 21:02:57.179101 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.179074 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"c65654aacbbb9791fdd700206ef8109f8aab7b5b7839f5ebabedf7938905aaff"} Jun 05 21:02:57.180164 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.180095 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d95fd97-rmhxk" event={"ID":"e5aea884-2a21-46a1-a2a3-e15f18ac698b","Type":"ContainerStarted","Data":"9d246fc71272405410e3e8f8cfdeeff4f92b2d94051786de3eae14f0bcd34aba"} Jun 05 21:02:57.182090 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.182069 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmwkf" event={"ID":"0b9eec09-89a8-4cfb-891c-f888edeee8f0","Type":"ContainerStarted","Data":"af7120e28ceb44832bfc10776799dd91838069589e61773abb8c3932f1675d84"} Jun 05 21:02:57.182199 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.182105 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cmwkf" event={"ID":"0b9eec09-89a8-4cfb-891c-f888edeee8f0","Type":"ContainerStarted","Data":"41ea63593d52355d7a0757069ebf3fbbcd64a3830e6e64bc7243267d58ceacd0"} Jun 05 21:02:57.195125 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.195083 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-p89j9" podStartSLOduration=2.141349825 podStartE2EDuration="3.19506828s" totalImagesPullingTime="1.053718455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:57.194178792 +0000 UTC m=+247.266439160" watchObservedRunningTime="2026-06-05 21:02:57.19506828 +0000 UTC m=+247.267328646" Jun 05 21:02:57.209161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:57.209123 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cmwkf" podStartSLOduration=2.222512944 podStartE2EDuration="3.209108903s" totalImagesPullingTime="913.640666ms" totalInitContainerRuntime="72.955293ms" isStatefulPod=true podCreationTimestamp="2026-06-05 21:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:02:57.208037903 +0000 UTC m=+247.280298287" watchObservedRunningTime="2026-06-05 21:02:57.209108903 +0000 UTC m=+247.281369263" Jun 05 21:02:58.187443 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.187355 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d" exitCode=0 Jun 05 21:02:58.187826 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.187438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d"} Jun 05 21:02:58.886685 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.886651 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f9b699bfc-dh6h8"] Jun 05 21:02:58.888876 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.888854 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:58.890868 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.890837 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 21:02:58.891797 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.891715 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 05 21:02:58.891797 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.891776 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5lzvk\"" Jun 05 21:02:58.891969 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.891717 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 05 21:02:58.891969 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.891872 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7mh71r8hpj2b6\"" Jun 05 21:02:58.891969 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.891920 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 05 21:02:58.899784 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:58.899761 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9b699bfc-dh6h8"] Jun 05 21:02:59.005078 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-tls\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005261 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005090 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqtc\" (UniqueName: \"kubernetes.io/projected/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-kube-api-access-2wqtc\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005261 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-metrics-server-audit-profiles\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005261 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-client-certs\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005386 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005293 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-audit-log\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005386 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.005386 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.005347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-client-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106176 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-audit-log\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106365 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106181 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106365 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-client-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106365 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106306 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-tls\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106365 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106335 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqtc\" (UniqueName: \"kubernetes.io/projected/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-kube-api-access-2wqtc\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106594 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-metrics-server-audit-profiles\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106594 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-client-certs\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.106703 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.106593 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-audit-log\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.108131 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.107740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-metrics-server-audit-profiles\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.108131 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.108062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.109884 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.109839 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-client-certs\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.110708 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.110682 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-client-ca-bundle\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.110872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.110837 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-secret-metrics-server-tls\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.114245 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.114217 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqtc\" (UniqueName: \"kubernetes.io/projected/8dbc0224-7ba5-4ff8-924a-5d892caa1f56-kube-api-access-2wqtc\") pod \"metrics-server-5f9b699bfc-dh6h8\" (UID: \"8dbc0224-7ba5-4ff8-924a-5d892caa1f56\") " pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.200600 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.200503 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:02:59.366052 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.366007 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5k48c"] Jun 05 21:02:59.368471 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.368443 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:02:59.370261 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.370238 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 21:02:59.370392 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.370374 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4p7p2\"" Jun 05 21:02:59.378172 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.378145 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5k48c"] Jun 05 21:02:59.510937 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.510844 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:02:59.511082 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.510999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5qrp\" (UniqueName: \"kubernetes.io/projected/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-kube-api-access-m5qrp\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:02:59.611717 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.611676 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:02:59.611907 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:59.611809 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 21:02:59.611907 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.611836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5qrp\" (UniqueName: \"kubernetes.io/projected/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-kube-api-access-m5qrp\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:02:59.611907 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:02:59.611882 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert podName:1a7f3fd7-1272-44ca-b4e2-926dcdfddaee nodeName:}" failed. No retries permitted until 2026-06-05 21:03:00.111862535 +0000 UTC m=+250.184122902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-5k48c" (UID: "1a7f3fd7-1272-44ca-b4e2-926dcdfddaee") : secret "monitoring-plugin-cert" not found Jun 05 21:02:59.619991 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:02:59.619966 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5qrp\" (UniqueName: \"kubernetes.io/projected/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-kube-api-access-m5qrp\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:00.116522 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:00.116463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:00.119238 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:00.119211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a7f3fd7-1272-44ca-b4e2-926dcdfddaee-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-5k48c\" (UID: \"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:00.280473 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:00.280436 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:00.437392 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:00.437367 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9b699bfc-dh6h8"] Jun 05 21:03:00.444632 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:03:00.444609 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbc0224_7ba5_4ff8_924a_5d892caa1f56.slice/crio-b0cd11b7a059975f0d40b2f66f317bc3187f8fb09c28516397dce4d29dce41ad WatchSource:0}: Error finding container b0cd11b7a059975f0d40b2f66f317bc3187f8fb09c28516397dce4d29dce41ad: Status 404 returned error can't find the container with id b0cd11b7a059975f0d40b2f66f317bc3187f8fb09c28516397dce4d29dce41ad Jun 05 21:03:00.456347 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:00.456324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-5k48c"] Jun 05 21:03:00.458875 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:03:00.458850 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7f3fd7_1272_44ca_b4e2_926dcdfddaee.slice/crio-a639e297771c3a97aecd229db19c004abc4665aae037085fcbd355a7944fd38c WatchSource:0}: Error finding container a639e297771c3a97aecd229db19c004abc4665aae037085fcbd355a7944fd38c: Status 404 returned error can't find the container with id a639e297771c3a97aecd229db19c004abc4665aae037085fcbd355a7944fd38c Jun 05 21:03:01.203218 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.203176 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5"} Jun 05 21:03:01.203387 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.203305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22"} Jun 05 21:03:01.203387 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.203351 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b"} Jun 05 21:03:01.203543 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.203394 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b"} Jun 05 21:03:01.203543 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.203434 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b"} Jun 05 21:03:01.205197 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.205151 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d95fd97-rmhxk" event={"ID":"e5aea884-2a21-46a1-a2a3-e15f18ac698b","Type":"ContainerStarted","Data":"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c"} Jun 05 21:03:01.206623 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.206593 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" event={"ID":"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee","Type":"ContainerStarted","Data":"a639e297771c3a97aecd229db19c004abc4665aae037085fcbd355a7944fd38c"} Jun 05 21:03:01.207991 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.207949 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" event={"ID":"8dbc0224-7ba5-4ff8-924a-5d892caa1f56","Type":"ContainerStarted","Data":"b0cd11b7a059975f0d40b2f66f317bc3187f8fb09c28516397dce4d29dce41ad"} Jun 05 21:03:01.221272 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:01.221223 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54d95fd97-rmhxk" podStartSLOduration=1.963940895 podStartE2EDuration="5.221207728s" totalImagesPullingTime="3.257266833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:01.219891812 +0000 UTC m=+251.292152203" watchObservedRunningTime="2026-06-05 21:03:01.221207728 +0000 UTC m=+251.293468142" Jun 05 21:03:02.238150 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:02.237498 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 21:03:02.240434 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:02.240402 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5520ee00-2d7d-4b09-bc08-6ac993d146e5-metrics-certs\") pod \"network-metrics-daemon-xr8q4\" (UID: \"5520ee00-2d7d-4b09-bc08-6ac993d146e5\") " pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 21:03:02.283706 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:02.283674 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k95x8\"" Jun 05 21:03:02.292129 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:02.292098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xr8q4" Jun 05 21:03:02.519379 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:02.519294 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xr8q4"] Jun 05 21:03:02.522597 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:03:02.522567 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5520ee00_2d7d_4b09_bc08_6ac993d146e5.slice/crio-d1767169fdcb201ae09242181fd9c550f65feb86fe18ecf3bbc004228e1c006c WatchSource:0}: Error finding container d1767169fdcb201ae09242181fd9c550f65feb86fe18ecf3bbc004228e1c006c: Status 404 returned error can't find the container with id d1767169fdcb201ae09242181fd9c550f65feb86fe18ecf3bbc004228e1c006c Jun 05 21:03:03.219005 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.218967 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" event={"ID":"1a7f3fd7-1272-44ca-b4e2-926dcdfddaee","Type":"ContainerStarted","Data":"7133fe855180e5cb78cf39caa8d2eaa17d1738f0ee9e189ddf783b3893414047"} Jun 05 21:03:03.219346 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.219325 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:03.221067 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.221039 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" event={"ID":"8dbc0224-7ba5-4ff8-924a-5d892caa1f56","Type":"ContainerStarted","Data":"582ca2bc47e28be29b2ef244336e8aae72142cacea91653b387998754e8ac68d"} Jun 05 21:03:03.222571 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.222545 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8q4" event={"ID":"5520ee00-2d7d-4b09-bc08-6ac993d146e5","Type":"ContainerStarted","Data":"d1767169fdcb201ae09242181fd9c550f65feb86fe18ecf3bbc004228e1c006c"} Jun 05 21:03:03.225167 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.225145 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" Jun 05 21:03:03.226737 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.226712 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerStarted","Data":"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b"} Jun 05 21:03:03.232835 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.232797 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-5k48c" podStartSLOduration=2.312241036 podStartE2EDuration="4.232784913s" totalImagesPullingTime="1.920543877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:03.231851453 +0000 UTC m=+253.304111839" watchObservedRunningTime="2026-06-05 21:03:03.232784913 +0000 UTC m=+253.305045270" Jun 05 21:03:03.254137 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.254093 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.238596318 podStartE2EDuration="8.25407702s" totalImagesPullingTime="4.99671661s" totalInitContainerRuntime="18.764092ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:03.252429039 +0000 UTC m=+253.324689405" watchObservedRunningTime="2026-06-05 21:03:03.25407702 +0000 UTC m=+253.326337386" Jun 05 21:03:03.269344 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:03.269288 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" podStartSLOduration=3.3345858059999998 podStartE2EDuration="5.269269042s" totalImagesPullingTime="1.934683236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:03.267821991 +0000 UTC m=+253.340082384" watchObservedRunningTime="2026-06-05 21:03:03.269269042 +0000 UTC m=+253.341529408" Jun 05 21:03:04.232347 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:04.232300 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8q4" event={"ID":"5520ee00-2d7d-4b09-bc08-6ac993d146e5","Type":"ContainerStarted","Data":"ee2a895cbff1358ba000782bf18ebd6ea9fae10eddc1fe582e550a524499d9f2"} Jun 05 21:03:04.232551 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:04.232396 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xr8q4" event={"ID":"5520ee00-2d7d-4b09-bc08-6ac993d146e5","Type":"ContainerStarted","Data":"fbf782591fc3ccf339238795c8b6cc53e0ceb6c6b0e934f94701a73a59171071"} Jun 05 21:03:04.246750 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:04.246707 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xr8q4" podStartSLOduration=253.378694768 podStartE2EDuration="4m14.246691382s" totalImagesPullingTime="867.996614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:04.245214733 +0000 UTC m=+254.317475098" watchObservedRunningTime="2026-06-05 21:03:04.246691382 +0000 UTC m=+254.318951747" Jun 05 21:03:05.434095 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:05.434063 2555 patch_prober.go:28] interesting pod/image-registry-859f55cdd8-wtnlr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 21:03:05.434463 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:05.434113 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:03:06.798016 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:06.797979 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:03:06.798445 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:06.798054 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:03:06.799747 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:06.799721 2555 patch_prober.go:28] interesting pod/console-54d95fd97-rmhxk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 21:03:06.799862 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:06.799769 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54d95fd97-rmhxk" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 21:03:10.448863 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.448784 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" containerID="cri-o://ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88" gracePeriod=30 Jun 05 21:03:10.683092 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.683065 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:03:10.713256 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713179 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713256 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713225 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc7hk\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713272 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713294 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713318 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713338 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713365 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713392 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates\") pod \"b14ce7e6-e880-420a-8340-49b53c46b7e9\" (UID: \"b14ce7e6-e880-420a-8340-49b53c46b7e9\") " Jun 05 21:03:10.713800 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713673 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:03:10.714027 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.713998 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:03:10.716015 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.715987 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:03:10.716015 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.715995 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:03:10.716217 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.716194 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk" (OuterVolumeSpecName: "kube-api-access-fc7hk") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "kube-api-access-fc7hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:03:10.716261 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.716213 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:03:10.716432 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.716411 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:03:10.722721 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.722697 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b14ce7e6-e880-420a-8340-49b53c46b7e9" (UID: "b14ce7e6-e880-420a-8340-49b53c46b7e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:03:10.814982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.814938 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-trusted-ca\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.814982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.814973 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc7hk\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-kube-api-access-fc7hk\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.814982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.814987 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-tls\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.815220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.814999 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-installation-pull-secrets\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.815220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.815011 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b14ce7e6-e880-420a-8340-49b53c46b7e9-bound-sa-token\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.815220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.815023 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b14ce7e6-e880-420a-8340-49b53c46b7e9-image-registry-private-configuration\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.815220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.815035 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b14ce7e6-e880-420a-8340-49b53c46b7e9-ca-trust-extracted\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:10.815220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:10.815046 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b14ce7e6-e880-420a-8340-49b53c46b7e9-registry-certificates\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:03:11.260018 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.259976 2555 generic.go:356] "Generic (PLEG): container finished" podID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerID="ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88" exitCode=0 Jun 05 21:03:11.260220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.260027 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" Jun 05 21:03:11.260220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.260056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" event={"ID":"b14ce7e6-e880-420a-8340-49b53c46b7e9","Type":"ContainerDied","Data":"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88"} Jun 05 21:03:11.260220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.260103 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859f55cdd8-wtnlr" event={"ID":"b14ce7e6-e880-420a-8340-49b53c46b7e9","Type":"ContainerDied","Data":"dc5d1073fe951d1adad0d1126c6f5cc1369f8306144083b560554920d624c816"} Jun 05 21:03:11.260220 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.260125 2555 scope.go:117] "RemoveContainer" containerID="ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88" Jun 05 21:03:11.268711 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.268692 2555 scope.go:117] "RemoveContainer" containerID="ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88" Jun 05 21:03:11.268962 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:03:11.268941 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88\": container with ID starting with ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88 not found: ID does not exist" containerID="ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88" Jun 05 21:03:11.269030 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.268974 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88"} err="failed to get container status \"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88\": rpc error: code = NotFound desc = could not find container \"ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88\": container with ID starting with ce1396793f341ba950202ec7dacadeaf8a0ef2f215f17805f59e4c7dc138bb88 not found: ID does not exist" Jun 05 21:03:11.278480 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.278456 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:03:11.281684 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:11.281664 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-859f55cdd8-wtnlr"] Jun 05 21:03:12.385866 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:12.385835 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" path="/var/lib/kubelet/pods/b14ce7e6-e880-420a-8340-49b53c46b7e9/volumes" Jun 05 21:03:16.798950 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:16.798915 2555 patch_prober.go:28] interesting pod/console-54d95fd97-rmhxk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 21:03:16.799355 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:16.798979 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54d95fd97-rmhxk" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 21:03:19.200971 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:19.200930 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:03:19.201356 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:19.200995 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:03:26.798914 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:26.798873 2555 patch_prober.go:28] interesting pod/console-54d95fd97-rmhxk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 05 21:03:26.799378 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:26.798932 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54d95fd97-rmhxk" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 05 21:03:28.830767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:28.830734 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/init-config-reloader/0.log" Jun 05 21:03:29.030778 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:29.030752 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/alertmanager/0.log" Jun 05 21:03:29.230009 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:29.229927 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/config-reloader/0.log" Jun 05 21:03:29.431092 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:29.431046 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/kube-rbac-proxy-web/0.log" Jun 05 21:03:29.630891 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:29.630860 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/kube-rbac-proxy/0.log" Jun 05 21:03:29.830216 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:29.830192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/kube-rbac-proxy-metric/0.log" Jun 05 21:03:30.030363 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:30.030294 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ef495a25-fdf6-477b-a3be-a42c8d703673/prom-label-proxy/0.log" Jun 05 21:03:30.875938 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:03:30.875898 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vdssl" podUID="c2d43edf-459f-4860-8473-ec7f153e630d" Jun 05 21:03:31.030990 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:31.030960 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9b699bfc-dh6h8_8dbc0224-7ba5-4ff8-924a-5d892caa1f56/metrics-server/0.log" Jun 05 21:03:31.229574 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:31.229486 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-5k48c_1a7f3fd7-1272-44ca-b4e2-926dcdfddaee/monitoring-plugin/0.log" Jun 05 21:03:31.332496 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:31.332467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:32.030576 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:32.030550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/init-textfile/0.log" Jun 05 21:03:32.231479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:32.231451 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/node-exporter/0.log" Jun 05 21:03:32.430080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:32.430027 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/kube-rbac-proxy/0.log" Jun 05 21:03:33.231143 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:33.231118 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/kube-rbac-proxy-main/0.log" Jun 05 21:03:33.430307 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:33.430272 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/kube-rbac-proxy-self/0.log" Jun 05 21:03:33.630647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:33.630601 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/openshift-state-metrics/0.log" Jun 05 21:03:34.825722 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:34.825669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:34.828102 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:34.828083 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2d43edf-459f-4860-8473-ec7f153e630d-metrics-tls\") pod \"dns-default-vdssl\" (UID: \"c2d43edf-459f-4860-8473-ec7f153e630d\") " pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:34.935660 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:34.935627 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fnqdb\"" Jun 05 21:03:34.944278 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:34.944259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:35.075679 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:35.075655 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vdssl"] Jun 05 21:03:35.078418 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:03:35.078391 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d43edf_459f_4860_8473_ec7f153e630d.slice/crio-595c634726e77dd54b402a849a442a8d2985710cc305b687d046d8469bf8dbaa WatchSource:0}: Error finding container 595c634726e77dd54b402a849a442a8d2985710cc305b687d046d8469bf8dbaa: Status 404 returned error can't find the container with id 595c634726e77dd54b402a849a442a8d2985710cc305b687d046d8469bf8dbaa Jun 05 21:03:35.347817 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:35.347733 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdssl" event={"ID":"c2d43edf-459f-4860-8473-ec7f153e630d","Type":"ContainerStarted","Data":"595c634726e77dd54b402a849a442a8d2985710cc305b687d046d8469bf8dbaa"} Jun 05 21:03:36.802207 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:36.802175 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:03:36.806053 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:36.806024 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:03:37.230577 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.230461 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:03:37.356799 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.356762 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdssl" event={"ID":"c2d43edf-459f-4860-8473-ec7f153e630d","Type":"ContainerStarted","Data":"59df24b41133fce2dd9b6831c7c6c2e1ecdae57ed6655b770bbdcd2ad632d789"} Jun 05 21:03:37.356958 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.356819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vdssl" event={"ID":"c2d43edf-459f-4860-8473-ec7f153e630d","Type":"ContainerStarted","Data":"257b37c786ebd8a41f1669324ceb1bd25a8b2f92782aac277ffda13638a03628"} Jun 05 21:03:37.372295 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.372253 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vdssl" podStartSLOduration=251.962457566 podStartE2EDuration="4m13.372236801s" totalImagesPullingTime="1.409779235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:03:37.37121932 +0000 UTC m=+287.443479716" watchObservedRunningTime="2026-06-05 21:03:37.372236801 +0000 UTC m=+287.444497166" Jun 05 21:03:37.433437 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.433407 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/2.log" Jun 05 21:03:37.630155 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:37.630126 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54d95fd97-rmhxk_e5aea884-2a21-46a1-a2a3-e15f18ac698b/console/0.log" Jun 05 21:03:38.361223 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:38.361192 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:39.205946 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:39.205918 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:03:39.209876 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:39.209850 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f9b699bfc-dh6h8" Jun 05 21:03:39.230685 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:39.230630 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdssl_c2d43edf-459f-4860-8473-ec7f153e630d/dns/0.log" Jun 05 21:03:39.429952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:39.429924 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdssl_c2d43edf-459f-4860-8473-ec7f153e630d/kube-rbac-proxy/0.log" Jun 05 21:03:39.830287 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:39.830263 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnp9x_db9cf996-815a-4eb9-a3b0-09b2e40b19e6/dns-node-resolver/0.log" Jun 05 21:03:41.030005 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:41.029979 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhbrn_0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19/node-ca/0.log" Jun 05 21:03:41.230843 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:41.230817 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:03:41.630251 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:41.630223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8snp_71c59c52-b60d-4f4b-8f7d-5f922082670e/serve-healthcheck-canary/0.log" Jun 05 21:03:44.511423 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:44.511389 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:03:48.367194 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:48.367161 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vdssl" Jun 05 21:03:50.326246 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:50.326210 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:03:50.326928 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:50.326896 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:03:50.332216 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:50.332192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:03:50.332699 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:50.332678 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:03:50.337954 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:03:50.337936 2555 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 21:04:09.541228 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.541183 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54d95fd97-rmhxk" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" containerID="cri-o://c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c" gracePeriod=15 Jun 05 21:04:09.786940 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.786913 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:04:09.914973 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.914941 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.914993 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svhqr\" (UniqueName: \"kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915022 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915051 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915076 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915090 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915107 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert\") pod \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\" (UID: \"e5aea884-2a21-46a1-a2a3-e15f18ac698b\") " Jun 05 21:04:09.915494 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915467 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:09.915602 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915483 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config" (OuterVolumeSpecName: "console-config") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:09.915602 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915566 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:09.915830 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.915812 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:09.917273 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.917248 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:09.917368 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.917288 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:09.917368 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:09.917296 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr" (OuterVolumeSpecName: "kube-api-access-svhqr") pod "e5aea884-2a21-46a1-a2a3-e15f18ac698b" (UID: "e5aea884-2a21-46a1-a2a3-e15f18ac698b"). InnerVolumeSpecName "kube-api-access-svhqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:04:10.016389 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016353 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-oauth-config\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016389 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016381 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-trusted-ca-bundle\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016389 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016391 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-service-ca\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016389 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016400 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-oauth-serving-cert\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016692 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016408 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-serving-cert\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016692 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016417 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svhqr\" (UniqueName: \"kubernetes.io/projected/e5aea884-2a21-46a1-a2a3-e15f18ac698b-kube-api-access-svhqr\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.016692 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.016426 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5aea884-2a21-46a1-a2a3-e15f18ac698b-console-config\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:10.489080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.489046 2555 generic.go:356] "Generic (PLEG): container finished" podID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerID="c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c" exitCode=0 Jun 05 21:04:10.489252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.489105 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54d95fd97-rmhxk" Jun 05 21:04:10.489252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.489131 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d95fd97-rmhxk" event={"ID":"e5aea884-2a21-46a1-a2a3-e15f18ac698b","Type":"ContainerDied","Data":"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c"} Jun 05 21:04:10.489252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.489212 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54d95fd97-rmhxk" event={"ID":"e5aea884-2a21-46a1-a2a3-e15f18ac698b","Type":"ContainerDied","Data":"9d246fc71272405410e3e8f8cfdeeff4f92b2d94051786de3eae14f0bcd34aba"} Jun 05 21:04:10.489252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.489238 2555 scope.go:117] "RemoveContainer" containerID="c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c" Jun 05 21:04:10.497222 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.497203 2555 scope.go:117] "RemoveContainer" containerID="c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c" Jun 05 21:04:10.497474 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:10.497454 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c\": container with ID starting with c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c not found: ID does not exist" containerID="c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c" Jun 05 21:04:10.497648 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.497486 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c"} err="failed to get container status \"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c\": rpc error: code = NotFound desc = could not find container \"c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c\": container with ID starting with c5aa1965d1cd40873146a3fb21387a5fa4be40e2f8dcd9112e032b28c0b8c09c not found: ID does not exist" Jun 05 21:04:10.503060 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.503038 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:04:10.506278 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:10.506257 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54d95fd97-rmhxk"] Jun 05 21:04:12.385419 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:12.385381 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" path="/var/lib/kubelet/pods/e5aea884-2a21-46a1-a2a3-e15f18ac698b/volumes" Jun 05 21:04:14.819975 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.819939 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:14.820366 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820215 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="alertmanager" containerID="cri-o://e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b" gracePeriod=120 Jun 05 21:04:14.820366 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820291 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-metric" containerID="cri-o://1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5" gracePeriod=120 Jun 05 21:04:14.820366 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820295 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-web" containerID="cri-o://7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b" gracePeriod=120 Jun 05 21:04:14.820366 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820327 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="prom-label-proxy" containerID="cri-o://014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b" gracePeriod=120 Jun 05 21:04:14.820586 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820377 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy" containerID="cri-o://d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22" gracePeriod=120 Jun 05 21:04:14.820586 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:14.820344 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="config-reloader" containerID="cri-o://3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b" gracePeriod=120 Jun 05 21:04:15.516963 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.516930 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b" exitCode=0 Jun 05 21:04:15.516963 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.516957 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5" exitCode=0 Jun 05 21:04:15.516963 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.516964 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22" exitCode=0 Jun 05 21:04:15.516963 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.516971 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b" exitCode=0 Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.516978 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b" exitCode=0 Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.517001 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b"} Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.517086 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5"} Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.517113 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22"} Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.517137 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b"} Jun 05 21:04:15.517226 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:15.517161 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b"} Jun 05 21:04:16.078059 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.078025 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.160682 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160586 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160682 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160633 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160682 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160670 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160713 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160752 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160776 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160802 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160828 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160849 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160900 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.160952 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160931 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.160959 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk44h\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161001 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls\") pod \"ef495a25-fdf6-477b-a3be-a42c8d703673\" (UID: \"ef495a25-fdf6-477b-a3be-a42c8d703673\") " Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161133 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161153 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161269 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.161324 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161292 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-alertmanager-main-db\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.161709 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.161678 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:04:16.163493 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.163452 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:04:16.163914 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.163869 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out" (OuterVolumeSpecName: "config-out") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 21:04:16.164027 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.164000 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.164330 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.164299 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.164471 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.164367 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.164741 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.164712 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h" (OuterVolumeSpecName: "kube-api-access-mk44h") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "kube-api-access-mk44h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:04:16.165153 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.165134 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.165487 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.165469 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume" (OuterVolumeSpecName: "config-volume") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.168665 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.168635 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.174844 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.174815 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config" (OuterVolumeSpecName: "web-config") pod "ef495a25-fdf6-477b-a3be-a42c8d703673" (UID: "ef495a25-fdf6-477b-a3be-a42c8d703673"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 21:04:16.262116 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262075 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262116 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262109 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef495a25-fdf6-477b-a3be-a42c8d703673-config-out\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262140 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-web-config\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262149 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-config-volume\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262159 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262170 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262179 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef495a25-fdf6-477b-a3be-a42c8d703673-metrics-client-ca\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262188 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk44h\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-kube-api-access-mk44h\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262197 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-secret-alertmanager-main-tls\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262205 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ef495a25-fdf6-477b-a3be-a42c8d703673-cluster-tls-config\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.262325 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.262212 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef495a25-fdf6-477b-a3be-a42c8d703673-tls-assets\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:04:16.523837 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.523748 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerID="7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b" exitCode=0 Jun 05 21:04:16.523837 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.523783 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b"} Jun 05 21:04:16.524024 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.523847 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.524024 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.523855 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ef495a25-fdf6-477b-a3be-a42c8d703673","Type":"ContainerDied","Data":"c65654aacbbb9791fdd700206ef8109f8aab7b5b7839f5ebabedf7938905aaff"} Jun 05 21:04:16.524024 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.523889 2555 scope.go:117] "RemoveContainer" containerID="014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b" Jun 05 21:04:16.531575 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.531556 2555 scope.go:117] "RemoveContainer" containerID="1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5" Jun 05 21:04:16.538223 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.538203 2555 scope.go:117] "RemoveContainer" containerID="d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22" Jun 05 21:04:16.540583 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.540561 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:16.544880 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.544858 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:16.546019 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.546003 2555 scope.go:117] "RemoveContainer" containerID="7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b" Jun 05 21:04:16.552409 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.552391 2555 scope.go:117] "RemoveContainer" containerID="3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b" Jun 05 21:04:16.559033 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.559011 2555 scope.go:117] "RemoveContainer" containerID="e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b" Jun 05 21:04:16.565851 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.565830 2555 scope.go:117] "RemoveContainer" containerID="08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d" Jun 05 21:04:16.567771 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.567750 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:16.568004 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.567991 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="prom-label-proxy" Jun 05 21:04:16.568004 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568004 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="prom-label-proxy" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568015 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568021 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568028 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568034 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568042 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="init-config-reloader" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568047 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="init-config-reloader" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568053 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-web" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568059 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-web" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568067 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568072 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568080 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-metric" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568085 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-metric" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568092 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="alertmanager" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568097 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="alertmanager" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568107 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="config-reloader" Jun 05 21:04:16.568130 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568112 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="config-reloader" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568150 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-web" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568171 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5aea884-2a21-46a1-a2a3-e15f18ac698b" containerName="console" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568178 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="config-reloader" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568184 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568189 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="kube-rbac-proxy-metric" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568196 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="alertmanager" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568200 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14ce7e6-e880-420a-8340-49b53c46b7e9" containerName="registry" Jun 05 21:04:16.568929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.568205 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" containerName="prom-label-proxy" Jun 05 21:04:16.573102 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.573424 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573271 2555 scope.go:117] "RemoveContainer" containerID="014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b" Jun 05 21:04:16.573603 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.573580 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b\": container with ID starting with 014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b not found: ID does not exist" containerID="014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b" Jun 05 21:04:16.573691 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573616 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b"} err="failed to get container status \"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b\": rpc error: code = NotFound desc = could not find container \"014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b\": container with ID starting with 014106c612b4ecf31fb10296df284f463d4c3f124239a1f93f2d2153b5baa22b not found: ID does not exist" Jun 05 21:04:16.573691 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573642 2555 scope.go:117] "RemoveContainer" containerID="1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5" Jun 05 21:04:16.573908 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.573887 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5\": container with ID starting with 1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5 not found: ID does not exist" containerID="1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5" Jun 05 21:04:16.573982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573916 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5"} err="failed to get container status \"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5\": rpc error: code = NotFound desc = could not find container \"1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5\": container with ID starting with 1afd67eb980bf717e44484ed36be719ff24744bd31f09f98d8f34182934deec5 not found: ID does not exist" Jun 05 21:04:16.573982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.573939 2555 scope.go:117] "RemoveContainer" containerID="d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22" Jun 05 21:04:16.574210 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.574191 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22\": container with ID starting with d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22 not found: ID does not exist" containerID="d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22" Jun 05 21:04:16.574252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574215 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22"} err="failed to get container status \"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22\": rpc error: code = NotFound desc = could not find container \"d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22\": container with ID starting with d11bbd30aec4d303dea2cd46199f35c5990c02fa0f0d8aea2bdf4b55a4b6cd22 not found: ID does not exist" Jun 05 21:04:16.574252 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574230 2555 scope.go:117] "RemoveContainer" containerID="7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b" Jun 05 21:04:16.574453 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.574438 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b\": container with ID starting with 7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b not found: ID does not exist" containerID="7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b" Jun 05 21:04:16.574492 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574455 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b"} err="failed to get container status \"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b\": rpc error: code = NotFound desc = could not find container \"7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b\": container with ID starting with 7a57123200ea95c82bc1630603a4311c86daf5b0e9f8bb92f535f776a1c4907b not found: ID does not exist" Jun 05 21:04:16.574492 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574469 2555 scope.go:117] "RemoveContainer" containerID="3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b" Jun 05 21:04:16.574747 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.574722 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b\": container with ID starting with 3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b not found: ID does not exist" containerID="3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b" Jun 05 21:04:16.574825 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574768 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b"} err="failed to get container status \"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b\": rpc error: code = NotFound desc = could not find container \"3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b\": container with ID starting with 3e99c6ca9c0acadd400e66a6e23b55cfb11bc459c60f2bb72cec14c32060153b not found: ID does not exist" Jun 05 21:04:16.574825 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574792 2555 scope.go:117] "RemoveContainer" containerID="e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b" Jun 05 21:04:16.575012 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574840 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 21:04:16.575012 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.574905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 21:04:16.575123 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.575078 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b\": container with ID starting with e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b not found: ID does not exist" containerID="e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b" Jun 05 21:04:16.575123 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575104 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b"} err="failed to get container status \"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b\": rpc error: code = NotFound desc = could not find container \"e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b\": container with ID starting with e8402a8793159b6946ccf0b2218ac811fa7dbff155e9f09612383398605a882b not found: ID does not exist" Jun 05 21:04:16.575123 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575119 2555 scope.go:117] "RemoveContainer" containerID="08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d" Jun 05 21:04:16.575308 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575195 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5t587\"" Jun 05 21:04:16.575308 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575219 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 21:04:16.575308 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575278 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 21:04:16.575464 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:04:16.575356 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d\": container with ID starting with 08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d not found: ID does not exist" containerID="08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d" Jun 05 21:04:16.575464 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575379 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d"} err="failed to get container status \"08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d\": rpc error: code = NotFound desc = could not find container \"08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d\": container with ID starting with 08022278b382c03933258079ef991d4fc95c2b8a548a46ca7613fc7c26ad542d not found: ID does not exist" Jun 05 21:04:16.575464 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575430 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 21:04:16.575464 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575436 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 21:04:16.575464 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575447 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 21:04:16.575797 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.575430 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 21:04:16.580004 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.579984 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 21:04:16.583745 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.583726 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:16.665242 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665207 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmbq\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-kube-api-access-xfmbq\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665425 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-out\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665425 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665425 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665425 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665406 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665443 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665529 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-web-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-volume\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.665846 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.665644 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766689 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-out\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.766853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766819 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766906 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-web-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766929 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-volume\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766956 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.766999 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.767041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.767079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmbq\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-kube-api-access-xfmbq\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.767171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.767995 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.767650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.768169 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.768144 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.769582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.769553 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-out\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.769772 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.769750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.769892 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.769862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.769986 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.769926 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.770151 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.770122 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.770391 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.770373 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-web-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.770492 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.770474 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.770569 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.770555 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-config-volume\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.771415 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.771401 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.773766 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.773748 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmbq\" (UniqueName: \"kubernetes.io/projected/b51dc19b-f4e3-4b8b-bcfc-604e06c19c28-kube-api-access-xfmbq\") pod \"alertmanager-main-0\" (UID: \"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:16.883980 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:16.883951 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 21:04:17.016428 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:17.016381 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 21:04:17.018882 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:04:17.018856 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51dc19b_f4e3_4b8b_bcfc_604e06c19c28.slice/crio-507c5bb332443d92c0abec2bf8a5fa4d5f0eec0a2bd80ee57b18befd9112138c WatchSource:0}: Error finding container 507c5bb332443d92c0abec2bf8a5fa4d5f0eec0a2bd80ee57b18befd9112138c: Status 404 returned error can't find the container with id 507c5bb332443d92c0abec2bf8a5fa4d5f0eec0a2bd80ee57b18befd9112138c Jun 05 21:04:17.529615 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:17.529584 2555 generic.go:356] "Generic (PLEG): container finished" podID="b51dc19b-f4e3-4b8b-bcfc-604e06c19c28" containerID="a5d706ba59143825da6955b6589f443d1aa4a360cd4b7257686343b59dcf58c7" exitCode=0 Jun 05 21:04:17.530013 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:17.529639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerDied","Data":"a5d706ba59143825da6955b6589f443d1aa4a360cd4b7257686343b59dcf58c7"} Jun 05 21:04:17.530013 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:17.529689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"507c5bb332443d92c0abec2bf8a5fa4d5f0eec0a2bd80ee57b18befd9112138c"} Jun 05 21:04:18.386768 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.386728 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef495a25-fdf6-477b-a3be-a42c8d703673" path="/var/lib/kubelet/pods/ef495a25-fdf6-477b-a3be-a42c8d703673/volumes" Jun 05 21:04:18.536982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.536947 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"354a0791bf82cb754db3cc5858b4331832bbdfe8b9dccf0a4fc9c75421e99606"} Jun 05 21:04:18.537361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.537011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"cb91dbd3733701e5bb8b83ba212c6dc54d8c2b5c4873915381c1750931e12e58"} Jun 05 21:04:18.537361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.537037 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"95d2f8a8aad1697dd7a0daf42ddad842d1a0c67f5457e766d0c8404782a121f3"} Jun 05 21:04:18.537361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.537060 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"61f72083389b4dc578782004d9fcce9e5776c3fb95f577ef94f1d3a73cd25e7f"} Jun 05 21:04:18.537361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.537083 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"c5d6a2774a21888f8616aa2488613374ebf6f09657c7823de2fb40aadf2b84b6"} Jun 05 21:04:18.537361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.537108 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b51dc19b-f4e3-4b8b-bcfc-604e06c19c28","Type":"ContainerStarted","Data":"e4504e230061fb0e60113a27a39f4fb0350bea4fb413f172a9ffc452174bda68"} Jun 05 21:04:18.566687 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.566622 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5471061280000002 podStartE2EDuration="2.566603803s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.497675ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:04:18.566342333 +0000 UTC m=+328.638602712" watchObservedRunningTime="2026-06-05 21:04:18.566603803 +0000 UTC m=+328.638864170" Jun 05 21:04:18.836294 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.836259 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb"] Jun 05 21:04:18.839897 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.839879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.841795 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.841770 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 21:04:18.841914 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.841774 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dkd59\"" Jun 05 21:04:18.841914 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.841803 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 21:04:18.842026 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.841939 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 21:04:18.842026 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.841938 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 21:04:18.842269 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.842252 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 21:04:18.847077 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.847051 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 21:04:18.851680 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.851657 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb"] Jun 05 21:04:18.985291 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptfnn\" (UniqueName: \"kubernetes.io/projected/072f89b6-8186-4b57-bfc9-a50ebfb7f852-kube-api-access-ptfnn\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985291 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-serving-certs-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-federate-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985582 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985569 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-metrics-client-ca\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:18.985772 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:18.985610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086368 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-serving-certs-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086368 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086327 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-federate-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086353 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-metrics-client-ca\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086470 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptfnn\" (UniqueName: \"kubernetes.io/projected/072f89b6-8186-4b57-bfc9-a50ebfb7f852-kube-api-access-ptfnn\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.086941 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.086686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.087108 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.087083 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-serving-certs-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.087330 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.087306 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-metrics-client-ca\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.087591 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.087572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.088904 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.088872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.089134 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.089032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-telemeter-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.089316 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.089296 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.089377 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.089344 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072f89b6-8186-4b57-bfc9-a50ebfb7f852-federate-client-tls\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.093257 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.093233 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptfnn\" (UniqueName: \"kubernetes.io/projected/072f89b6-8186-4b57-bfc9-a50ebfb7f852-kube-api-access-ptfnn\") pod \"telemeter-client-7f9b8d8886-mg4gb\" (UID: \"072f89b6-8186-4b57-bfc9-a50ebfb7f852\") " pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.150550 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.150490 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" Jun 05 21:04:19.279553 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.279503 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb"] Jun 05 21:04:19.281524 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:04:19.281487 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072f89b6_8186_4b57_bfc9_a50ebfb7f852.slice/crio-094e55454e416eb3fe42f597562d3c7a9526aa335863095ba9bf07f39384c39b WatchSource:0}: Error finding container 094e55454e416eb3fe42f597562d3c7a9526aa335863095ba9bf07f39384c39b: Status 404 returned error can't find the container with id 094e55454e416eb3fe42f597562d3c7a9526aa335863095ba9bf07f39384c39b Jun 05 21:04:19.283592 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.283573 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:04:19.542770 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:19.542682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" event={"ID":"072f89b6-8186-4b57-bfc9-a50ebfb7f852","Type":"ContainerStarted","Data":"094e55454e416eb3fe42f597562d3c7a9526aa335863095ba9bf07f39384c39b"} Jun 05 21:04:21.554194 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:21.554153 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" event={"ID":"072f89b6-8186-4b57-bfc9-a50ebfb7f852","Type":"ContainerStarted","Data":"6c8763ceba4edb5dbb723d961eb780c08b602058cf41dea91a54342c712e7e7a"} Jun 05 21:04:21.554552 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:21.554220 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" event={"ID":"072f89b6-8186-4b57-bfc9-a50ebfb7f852","Type":"ContainerStarted","Data":"a2dbed45685d8647dbacd30331ad40758081a7149aab4d1801d0e51692b21993"} Jun 05 21:04:21.554552 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:21.554241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" event={"ID":"072f89b6-8186-4b57-bfc9-a50ebfb7f852","Type":"ContainerStarted","Data":"b68b193b4c87cb390070315448f996c13612d5603df8b207fa68f4992554a9c2"} Jun 05 21:04:21.574389 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:04:21.574345 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f9b8d8886-mg4gb" podStartSLOduration=1.514140013 podStartE2EDuration="3.574331285s" totalImagesPullingTime="2.060191272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:04:21.573993862 +0000 UTC m=+331.646254249" watchObservedRunningTime="2026-06-05 21:04:21.574331285 +0000 UTC m=+331.646591650" Jun 05 21:08:03.558124 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.558039 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2"] Jun 05 21:08:03.561388 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.561372 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.564558 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.564535 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 21:08:03.565197 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.565159 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fsqv6\"" Jun 05 21:08:03.565197 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.565178 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 21:08:03.570505 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.570480 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2"] Jun 05 21:08:03.685767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.685731 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72001704-6af7-4532-8ce5-9f8db54cb88f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.685767 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.685769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdb4\" (UniqueName: \"kubernetes.io/projected/72001704-6af7-4532-8ce5-9f8db54cb88f-kube-api-access-8qdb4\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.786920 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.786879 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72001704-6af7-4532-8ce5-9f8db54cb88f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.786920 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.786920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdb4\" (UniqueName: \"kubernetes.io/projected/72001704-6af7-4532-8ce5-9f8db54cb88f-kube-api-access-8qdb4\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.787251 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.787231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72001704-6af7-4532-8ce5-9f8db54cb88f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.794319 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.794289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdb4\" (UniqueName: \"kubernetes.io/projected/72001704-6af7-4532-8ce5-9f8db54cb88f-kube-api-access-8qdb4\") pod \"openshift-lws-operator-fd8ccff4c-x2tz2\" (UID: \"72001704-6af7-4532-8ce5-9f8db54cb88f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:03.871369 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:03.871266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" Jun 05 21:08:04.006731 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:04.006704 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2"] Jun 05 21:08:04.009404 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:04.009376 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72001704_6af7_4532_8ce5_9f8db54cb88f.slice/crio-63bbb2163f51adfab00630c73f8f3a342cddafac7578c9e686553b46cfd66cf6 WatchSource:0}: Error finding container 63bbb2163f51adfab00630c73f8f3a342cddafac7578c9e686553b46cfd66cf6: Status 404 returned error can't find the container with id 63bbb2163f51adfab00630c73f8f3a342cddafac7578c9e686553b46cfd66cf6 Jun 05 21:08:04.403872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:04.403838 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" event={"ID":"72001704-6af7-4532-8ce5-9f8db54cb88f","Type":"ContainerStarted","Data":"63bbb2163f51adfab00630c73f8f3a342cddafac7578c9e686553b46cfd66cf6"} Jun 05 21:08:07.422626 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:07.422588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" event={"ID":"72001704-6af7-4532-8ce5-9f8db54cb88f","Type":"ContainerStarted","Data":"de38cb75cd9eb14b838359898e1ee9fbf82c0140d90b65c35b9235ec2577ae7b"} Jun 05 21:08:07.441418 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:07.441369 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2tz2" podStartSLOduration=1.856949836 podStartE2EDuration="4.441355936s" totalImagesPullingTime="2.5844061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:07.440607794 +0000 UTC m=+557.512868159" watchObservedRunningTime="2026-06-05 21:08:07.441355936 +0000 UTC m=+557.513616301" Jun 05 21:08:28.400027 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.399988 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq"] Jun 05 21:08:28.403448 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.403424 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.409370 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.409348 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 21:08:28.409532 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.409384 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 21:08:28.409606 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.409535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 21:08:28.410359 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.410339 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w957v\"" Jun 05 21:08:28.410489 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.410475 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 21:08:28.422327 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.422300 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq"] Jun 05 21:08:28.502195 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.502156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.502390 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.502309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl4wg\" (UniqueName: \"kubernetes.io/projected/e31d1e30-8b75-413a-bea1-b99d2d5fff03-kube-api-access-vl4wg\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.502390 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.502381 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.502532 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.502412 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.502532 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.502449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.603445 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.603404 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.603445 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.603443 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl4wg\" (UniqueName: \"kubernetes.io/projected/e31d1e30-8b75-413a-bea1-b99d2d5fff03-kube-api-access-vl4wg\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.603727 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.603576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.603727 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.603614 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.603727 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.603654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.604074 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.604046 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-manifests\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.605745 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.605711 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31d1e30-8b75-413a-bea1-b99d2d5fff03-tmp\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.605974 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.605956 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.606048 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.606008 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31d1e30-8b75-413a-bea1-b99d2d5fff03-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.615809 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.615787 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl4wg\" (UniqueName: \"kubernetes.io/projected/e31d1e30-8b75-413a-bea1-b99d2d5fff03-kube-api-access-vl4wg\") pod \"opendatahub-operator-controller-manager-7d46cb5566-t5wnq\" (UID: \"e31d1e30-8b75-413a-bea1-b99d2d5fff03\") " pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.713669 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.713579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:28.841246 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:28.841222 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq"] Jun 05 21:08:28.843737 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:28.843697 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31d1e30_8b75_413a_bea1_b99d2d5fff03.slice/crio-6518395a30184b8f3da74aebdc0491a80a22f0931d8db85a2c9938eab5c0c948 WatchSource:0}: Error finding container 6518395a30184b8f3da74aebdc0491a80a22f0931d8db85a2c9938eab5c0c948: Status 404 returned error can't find the container with id 6518395a30184b8f3da74aebdc0491a80a22f0931d8db85a2c9938eab5c0c948 Jun 05 21:08:29.511997 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:29.511955 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" event={"ID":"e31d1e30-8b75-413a-bea1-b99d2d5fff03","Type":"ContainerStarted","Data":"6518395a30184b8f3da74aebdc0491a80a22f0931d8db85a2c9938eab5c0c948"} Jun 05 21:08:32.525393 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:32.525350 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" event={"ID":"e31d1e30-8b75-413a-bea1-b99d2d5fff03","Type":"ContainerStarted","Data":"b2de4cf5d90faefcaf77a7f1294530b97946af2dbd47c8d60c02baf49f9e03a2"} Jun 05 21:08:33.531446 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:33.531413 2555 generic.go:356] "Generic (PLEG): container finished" podID="e31d1e30-8b75-413a-bea1-b99d2d5fff03" containerID="b2de4cf5d90faefcaf77a7f1294530b97946af2dbd47c8d60c02baf49f9e03a2" exitCode=0 Jun 05 21:08:33.531858 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:33.531527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" event={"ID":"e31d1e30-8b75-413a-bea1-b99d2d5fff03","Type":"ContainerDied","Data":"b2de4cf5d90faefcaf77a7f1294530b97946af2dbd47c8d60c02baf49f9e03a2"} Jun 05 21:08:34.537580 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:34.537524 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" event={"ID":"e31d1e30-8b75-413a-bea1-b99d2d5fff03","Type":"ContainerStarted","Data":"387e4e2ac876b63e32fe98efa728b4ab28c55881c50f4b86a2a1171c5a3e9aa7"} Jun 05 21:08:34.538050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:34.537613 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:34.558048 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:34.557995 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" podStartSLOduration=2.275732155 podStartE2EDuration="6.557979813s" totalImagesPullingTime="3.363031629s" totalInitContainerRuntime="919.216029ms" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:34.556738469 +0000 UTC m=+584.628998836" watchObservedRunningTime="2026-06-05 21:08:34.557979813 +0000 UTC m=+584.630240169" Jun 05 21:08:45.544494 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:45.544459 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d46cb5566-t5wnq" Jun 05 21:08:48.205305 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.205271 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br"] Jun 05 21:08:48.209802 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.209782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.211614 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.211593 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n8snc\"" Jun 05 21:08:48.212015 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.211995 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 05 21:08:48.212084 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.211998 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 21:08:48.220555 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.220533 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br"] Jun 05 21:08:48.256250 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.256220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tmp\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.256397 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.256260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956vs\" (UniqueName: \"kubernetes.io/projected/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-kube-api-access-956vs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.256397 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.256362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tls-certs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.352831 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.352787 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2vrzz"] Jun 05 21:08:48.355178 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.355160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.356819 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.356789 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 05 21:08:48.356934 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.356880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956vs\" (UniqueName: \"kubernetes.io/projected/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-kube-api-access-956vs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.356999 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.356942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tls-certs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.356999 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.356955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jhk69\"" Jun 05 21:08:48.356999 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.356996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tmp\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.359456 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.359437 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tmp\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.359609 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.359592 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-tls-certs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.363052 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.363030 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2vrzz"] Jun 05 21:08:48.365949 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.365909 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-956vs\" (UniqueName: \"kubernetes.io/projected/a5eb71d9-62ac-42be-b6d1-f39e137e8ccb-kube-api-access-956vs\") pod \"kube-auth-proxy-6f86f755c4-hx5br\" (UID: \"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb\") " pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.458410 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.458327 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdhc\" (UniqueName: \"kubernetes.io/projected/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-kube-api-access-nrdhc\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.458410 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.458362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-cert\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.518643 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.518607 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" Jun 05 21:08:48.559586 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.559553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdhc\" (UniqueName: \"kubernetes.io/projected/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-kube-api-access-nrdhc\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.559586 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.559590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-cert\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.562111 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.562077 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-cert\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.569872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.569815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdhc\" (UniqueName: \"kubernetes.io/projected/4ebd71cd-1572-4113-b3f8-fa1d04a1de81-kube-api-access-nrdhc\") pod \"odh-model-controller-6dc94f689f-2vrzz\" (UID: \"4ebd71cd-1572-4113-b3f8-fa1d04a1de81\") " pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.648770 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.648738 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br"] Jun 05 21:08:48.651814 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:48.651787 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eb71d9_62ac_42be_b6d1_f39e137e8ccb.slice/crio-135f2b7a74377a538b97c748f83c839d46a3863b0d2b555efb49403c72b22ace WatchSource:0}: Error finding container 135f2b7a74377a538b97c748f83c839d46a3863b0d2b555efb49403c72b22ace: Status 404 returned error can't find the container with id 135f2b7a74377a538b97c748f83c839d46a3863b0d2b555efb49403c72b22ace Jun 05 21:08:48.679490 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.679460 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:48.804845 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:48.804819 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-2vrzz"] Jun 05 21:08:48.807870 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:48.807842 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebd71cd_1572_4113_b3f8_fa1d04a1de81.slice/crio-a5088f3b5bda4153ce980de4df3d13cfe87ce81eddf9a936ce272458072cec20 WatchSource:0}: Error finding container a5088f3b5bda4153ce980de4df3d13cfe87ce81eddf9a936ce272458072cec20: Status 404 returned error can't find the container with id a5088f3b5bda4153ce980de4df3d13cfe87ce81eddf9a936ce272458072cec20 Jun 05 21:08:49.024635 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.024558 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fbtgs"] Jun 05 21:08:49.027415 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.027399 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.029048 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.029021 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 05 21:08:49.039191 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.039170 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fbtgs"] Jun 05 21:08:49.063500 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.063476 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.063644 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.063549 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvvd9\" (UniqueName: \"kubernetes.io/projected/b57865e1-101f-42d2-ad64-65600ff613e0-kube-api-access-bvvd9\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.164307 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.164273 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.164478 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.164322 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvvd9\" (UniqueName: \"kubernetes.io/projected/b57865e1-101f-42d2-ad64-65600ff613e0-kube-api-access-bvvd9\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.164478 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:49.164431 2555 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 05 21:08:49.164569 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:49.164501 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs podName:b57865e1-101f-42d2-ad64-65600ff613e0 nodeName:}" failed. No retries permitted until 2026-06-05 21:08:49.664479825 +0000 UTC m=+599.736740188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs") pod "model-serving-api-5dd488fc48-fbtgs" (UID: "b57865e1-101f-42d2-ad64-65600ff613e0") : secret "model-serving-api-tls" not found Jun 05 21:08:49.183293 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.183257 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvvd9\" (UniqueName: \"kubernetes.io/projected/b57865e1-101f-42d2-ad64-65600ff613e0-kube-api-access-bvvd9\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.614157 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.614057 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" event={"ID":"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb","Type":"ContainerStarted","Data":"135f2b7a74377a538b97c748f83c839d46a3863b0d2b555efb49403c72b22ace"} Jun 05 21:08:49.616283 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.616251 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" event={"ID":"4ebd71cd-1572-4113-b3f8-fa1d04a1de81","Type":"ContainerStarted","Data":"a5088f3b5bda4153ce980de4df3d13cfe87ce81eddf9a936ce272458072cec20"} Jun 05 21:08:49.669005 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.668477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.673467 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.673435 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b57865e1-101f-42d2-ad64-65600ff613e0-tls-certs\") pod \"model-serving-api-5dd488fc48-fbtgs\" (UID: \"b57865e1-101f-42d2-ad64-65600ff613e0\") " pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:49.937868 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:49.937450 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:50.140718 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:50.140687 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-fbtgs"] Jun 05 21:08:51.470415 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:51.470367 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57865e1_101f_42d2_ad64_65600ff613e0.slice/crio-0d70d1b68741a98db0a25efb2ff1a9318d30fb725fe31c2874dfbcc487fb3977 WatchSource:0}: Error finding container 0d70d1b68741a98db0a25efb2ff1a9318d30fb725fe31c2874dfbcc487fb3977: Status 404 returned error can't find the container with id 0d70d1b68741a98db0a25efb2ff1a9318d30fb725fe31c2874dfbcc487fb3977 Jun 05 21:08:51.628288 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:51.628249 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" event={"ID":"b57865e1-101f-42d2-ad64-65600ff613e0","Type":"ContainerStarted","Data":"0d70d1b68741a98db0a25efb2ff1a9318d30fb725fe31c2874dfbcc487fb3977"} Jun 05 21:08:52.703856 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:52.703831 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:08:52.704219 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:52.704204 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:08:52.709030 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:52.709009 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:08:52.709285 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:52.709267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:08:52.720362 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:52.720343 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 05 21:08:53.642534 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.642466 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" event={"ID":"4ebd71cd-1572-4113-b3f8-fa1d04a1de81","Type":"ContainerStarted","Data":"be13190f29f528ea15fdf9b1cde71c109172cb70b169a56d37e25deafacf7fa7"} Jun 05 21:08:53.642735 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.642630 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:08:53.644077 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.644046 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" event={"ID":"b57865e1-101f-42d2-ad64-65600ff613e0","Type":"ContainerStarted","Data":"348c7fdaf882455b544496e716bda6c07e12411273fe4a51f662c77fe9f458b3"} Jun 05 21:08:53.644207 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.644103 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:08:53.645459 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.645437 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" event={"ID":"a5eb71d9-62ac-42be-b6d1-f39e137e8ccb","Type":"ContainerStarted","Data":"f0cba7821509c9f572be6d8ea82ab811af22e92214cfd297de577b079cbd46d4"} Jun 05 21:08:53.668562 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.668474 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" podStartSLOduration=2.64182418 podStartE2EDuration="4.66845062s" totalImagesPullingTime="2.02662644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:53.668405856 +0000 UTC m=+603.740666239" watchObservedRunningTime="2026-06-05 21:08:53.66845062 +0000 UTC m=+603.740710987" Jun 05 21:08:53.669934 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.669897 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" podStartSLOduration=1.752994757 podStartE2EDuration="5.669885417s" totalImagesPullingTime="3.91689066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:53.655751408 +0000 UTC m=+603.728011787" watchObservedRunningTime="2026-06-05 21:08:53.669885417 +0000 UTC m=+603.742145782" Jun 05 21:08:53.684023 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:53.683980 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f86f755c4-hx5br" podStartSLOduration=1.619521455 podStartE2EDuration="5.683969292s" totalImagesPullingTime="4.064447837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:08:53.682719988 +0000 UTC m=+603.754980365" watchObservedRunningTime="2026-06-05 21:08:53.683969292 +0000 UTC m=+603.756229657" Jun 05 21:08:58.013068 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.013036 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c85q8"] Jun 05 21:08:58.016346 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.016329 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.018633 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.018613 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wf984\"" Jun 05 21:08:58.018720 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.018682 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 05 21:08:58.028939 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.028903 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c85q8"] Jun 05 21:08:58.030286 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.030263 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4"] Jun 05 21:08:58.033497 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.033479 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.035926 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.035907 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 21:08:58.036163 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.036148 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-62g9l\"" Jun 05 21:08:58.043223 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.043203 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4"] Jun 05 21:08:58.148468 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.148422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf759\" (UniqueName: \"kubernetes.io/projected/d57eda6e-956f-424b-9012-4bb22598983e-kube-api-access-vf759\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.148677 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.148478 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.148677 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.148501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmnr\" (UniqueName: \"kubernetes.io/projected/e1ee6d90-53eb-47f4-95bf-a9340777471a-kube-api-access-wnmnr\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.148677 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.148552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.249334 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.249295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf759\" (UniqueName: \"kubernetes.io/projected/d57eda6e-956f-424b-9012-4bb22598983e-kube-api-access-vf759\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.249490 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.249350 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.249490 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.249377 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmnr\" (UniqueName: \"kubernetes.io/projected/e1ee6d90-53eb-47f4-95bf-a9340777471a-kube-api-access-wnmnr\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.249490 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.249397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.249707 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.249547 2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 05 21:08:58.249707 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.249605 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert podName:d57eda6e-956f-424b-9012-4bb22598983e nodeName:}" failed. No retries permitted until 2026-06-05 21:08:58.749587677 +0000 UTC m=+608.821848024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert") pod "kserve-controller-manager-69fc866d76-c85q8" (UID: "d57eda6e-956f-424b-9012-4bb22598983e") : secret "kserve-webhook-server-cert" not found Jun 05 21:08:58.249707 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.249547 2555 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 21:08:58.249707 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.249706 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert podName:e1ee6d90-53eb-47f4-95bf-a9340777471a nodeName:}" failed. No retries permitted until 2026-06-05 21:08:58.749687463 +0000 UTC m=+608.821947821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert") pod "llmisvc-controller-manager-864bfd7bc9-r29n4" (UID: "e1ee6d90-53eb-47f4-95bf-a9340777471a") : secret "llmisvc-webhook-server-cert" not found Jun 05 21:08:58.258618 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.258586 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmnr\" (UniqueName: \"kubernetes.io/projected/e1ee6d90-53eb-47f4-95bf-a9340777471a-kube-api-access-wnmnr\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.258618 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.258599 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf759\" (UniqueName: \"kubernetes.io/projected/d57eda6e-956f-424b-9012-4bb22598983e-kube-api-access-vf759\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.753385 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.753343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.753597 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.753396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:58.753597 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.753502 2555 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 21:08:58.753597 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:08:58.753591 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert podName:e1ee6d90-53eb-47f4-95bf-a9340777471a nodeName:}" failed. No retries permitted until 2026-06-05 21:08:59.75357326 +0000 UTC m=+609.825833621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert") pod "llmisvc-controller-manager-864bfd7bc9-r29n4" (UID: "e1ee6d90-53eb-47f4-95bf-a9340777471a") : secret "llmisvc-webhook-server-cert" not found Jun 05 21:08:58.755969 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.755940 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d57eda6e-956f-424b-9012-4bb22598983e-cert\") pod \"kserve-controller-manager-69fc866d76-c85q8\" (UID: \"d57eda6e-956f-424b-9012-4bb22598983e\") " pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:58.926830 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:58.926792 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:08:59.054257 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.054223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-c85q8"] Jun 05 21:08:59.057326 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:59.057299 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57eda6e_956f_424b_9012_4bb22598983e.slice/crio-ec730f5d9aa0245b78fbd39a63966c400a39cd42941e2e2e96533f7fd0ec0eff WatchSource:0}: Error finding container ec730f5d9aa0245b78fbd39a63966c400a39cd42941e2e2e96533f7fd0ec0eff: Status 404 returned error can't find the container with id ec730f5d9aa0245b78fbd39a63966c400a39cd42941e2e2e96533f7fd0ec0eff Jun 05 21:08:59.673403 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.673369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" event={"ID":"d57eda6e-956f-424b-9012-4bb22598983e","Type":"ContainerStarted","Data":"ec730f5d9aa0245b78fbd39a63966c400a39cd42941e2e2e96533f7fd0ec0eff"} Jun 05 21:08:59.761943 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.761905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:59.764331 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.764305 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1ee6d90-53eb-47f4-95bf-a9340777471a-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-r29n4\" (UID: \"e1ee6d90-53eb-47f4-95bf-a9340777471a\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:59.843145 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.843109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:08:59.980831 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:08:59.980805 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4"] Jun 05 21:08:59.983269 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:08:59.983235 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode1ee6d90_53eb_47f4_95bf_a9340777471a.slice/crio-230cd017469c7f29937c700ac608a26bb69236cf7140790762506b4d81c18e0f WatchSource:0}: Error finding container 230cd017469c7f29937c700ac608a26bb69236cf7140790762506b4d81c18e0f: Status 404 returned error can't find the container with id 230cd017469c7f29937c700ac608a26bb69236cf7140790762506b4d81c18e0f Jun 05 21:09:00.680683 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:00.680644 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" event={"ID":"e1ee6d90-53eb-47f4-95bf-a9340777471a","Type":"ContainerStarted","Data":"230cd017469c7f29937c700ac608a26bb69236cf7140790762506b4d81c18e0f"} Jun 05 21:09:02.692610 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:02.692570 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" event={"ID":"d57eda6e-956f-424b-9012-4bb22598983e","Type":"ContainerStarted","Data":"508e7a511c870630099929c829d3e0303c6c322e9bc4e726ce46dc0939dd9662"} Jun 05 21:09:02.693002 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:02.692706 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:09:02.718476 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:02.718416 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" podStartSLOduration=2.86122502 podStartE2EDuration="5.718398901s" totalImagesPullingTime="2.857173881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:02.716706044 +0000 UTC m=+612.788966430" watchObservedRunningTime="2026-06-05 21:09:02.718398901 +0000 UTC m=+612.790659267" Jun 05 21:09:03.698898 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:03.698855 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" event={"ID":"e1ee6d90-53eb-47f4-95bf-a9340777471a","Type":"ContainerStarted","Data":"39138f944b57bcb3e33d56e27933bfe8a7c1bb7e4cb88a0cc16874555e35cba4"} Jun 05 21:09:03.719137 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:03.718984 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" podStartSLOduration=2.451913508 podStartE2EDuration="5.71896468s" totalImagesPullingTime="3.267051172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:03.718549238 +0000 UTC m=+613.790809601" watchObservedRunningTime="2026-06-05 21:09:03.71896468 +0000 UTC m=+613.791225045" Jun 05 21:09:04.651481 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:04.651449 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-2vrzz" Jun 05 21:09:04.653735 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:04.653709 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-fbtgs" Jun 05 21:09:04.704502 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:04.704463 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:09:07.849775 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.849695 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5"] Jun 05 21:09:07.851978 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.851955 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:07.853974 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.853955 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 05 21:09:07.854080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.853986 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 05 21:09:07.854128 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.854085 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-s4xcf\"" Jun 05 21:09:07.866060 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.866023 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5"] Jun 05 21:09:07.935237 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.935204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc291a49-7ff0-4d1b-b595-725867b128f0-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:07.935237 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:07.935241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7dw\" (UniqueName: \"kubernetes.io/projected/bc291a49-7ff0-4d1b-b595-725867b128f0-kube-api-access-lk7dw\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.036737 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.036697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc291a49-7ff0-4d1b-b595-725867b128f0-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.036737 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.036739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7dw\" (UniqueName: \"kubernetes.io/projected/bc291a49-7ff0-4d1b-b595-725867b128f0-kube-api-access-lk7dw\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.039193 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.039171 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/bc291a49-7ff0-4d1b-b595-725867b128f0-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.044160 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.044133 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7dw\" (UniqueName: \"kubernetes.io/projected/bc291a49-7ff0-4d1b-b595-725867b128f0-kube-api-access-lk7dw\") pod \"servicemesh-operator3-57f65f65fb-d4nk5\" (UID: \"bc291a49-7ff0-4d1b-b595-725867b128f0\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.161382 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.161289 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:08.297392 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.297355 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5"] Jun 05 21:09:08.299894 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:09:08.299866 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc291a49_7ff0_4d1b_b595_725867b128f0.slice/crio-5f1064428e341f7ff3e29962c33b1b156f2b857b8632d78144f2728e439c33de WatchSource:0}: Error finding container 5f1064428e341f7ff3e29962c33b1b156f2b857b8632d78144f2728e439c33de: Status 404 returned error can't find the container with id 5f1064428e341f7ff3e29962c33b1b156f2b857b8632d78144f2728e439c33de Jun 05 21:09:08.728914 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:08.728874 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" event={"ID":"bc291a49-7ff0-4d1b-b595-725867b128f0","Type":"ContainerStarted","Data":"5f1064428e341f7ff3e29962c33b1b156f2b857b8632d78144f2728e439c33de"} Jun 05 21:09:11.745702 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:11.745662 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" event={"ID":"bc291a49-7ff0-4d1b-b595-725867b128f0","Type":"ContainerStarted","Data":"540e3070aeccac50abbfec14f521d1c55c5eb68d16994628894f76a31f5b527f"} Jun 05 21:09:11.746126 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:11.745790 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:11.764434 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:11.764377 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" podStartSLOduration=2.317812392 podStartE2EDuration="4.764358395s" totalImagesPullingTime="2.446546003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:11.762323807 +0000 UTC m=+621.834584189" watchObservedRunningTime="2026-06-05 21:09:11.764358395 +0000 UTC m=+621.836618765" Jun 05 21:09:17.565469 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.565428 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4"] Jun 05 21:09:17.567847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.567832 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.571941 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.571914 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 05 21:09:17.572083 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.571986 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tgfh4\"" Jun 05 21:09:17.572083 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.571923 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 05 21:09:17.572264 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.572233 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 21:09:17.572322 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.572313 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 05 21:09:17.583013 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.582991 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4"] Jun 05 21:09:17.722632 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722600 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.722812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722661 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzf9\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-kube-api-access-djzf9\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.722812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722692 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1940227-370b-4155-b038-0cff8986f764-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.722812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1940227-370b-4155-b038-0cff8986f764-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.722812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.722812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722761 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.723030 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.722819 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823563 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823464 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzf9\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-kube-api-access-djzf9\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823563 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1940227-370b-4155-b038-0cff8986f764-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823563 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1940227-370b-4155-b038-0cff8986f764-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823838 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823838 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823583 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823838 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.823838 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.823661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.824342 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.824311 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1940227-370b-4155-b038-0cff8986f764-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.826121 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.826087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1940227-370b-4155-b038-0cff8986f764-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.826205 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.826153 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.826257 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.826238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.826378 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.826362 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1940227-370b-4155-b038-0cff8986f764-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.830100 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.830073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.830438 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.830415 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzf9\" (UniqueName: \"kubernetes.io/projected/b1940227-370b-4155-b038-0cff8986f764-kube-api-access-djzf9\") pod \"istiod-openshift-gateway-75c67f8887-cxpj4\" (UID: \"b1940227-370b-4155-b038-0cff8986f764\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:17.878459 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:17.878426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:18.016841 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:18.016801 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4"] Jun 05 21:09:18.020932 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:09:18.020899 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1940227_370b_4155_b038_0cff8986f764.slice/crio-2fd1f4895ce181c9f99fe445d01e70d8ebe1a5c728f84751831f1e78e8994679 WatchSource:0}: Error finding container 2fd1f4895ce181c9f99fe445d01e70d8ebe1a5c728f84751831f1e78e8994679: Status 404 returned error can't find the container with id 2fd1f4895ce181c9f99fe445d01e70d8ebe1a5c728f84751831f1e78e8994679 Jun 05 21:09:18.778489 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:18.778441 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" event={"ID":"b1940227-370b-4155-b038-0cff8986f764","Type":"ContainerStarted","Data":"2fd1f4895ce181c9f99fe445d01e70d8ebe1a5c728f84751831f1e78e8994679"} Jun 05 21:09:22.752797 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:22.752759 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d4nk5" Jun 05 21:09:23.683881 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.683851 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b4cc887d-492hg"] Jun 05 21:09:23.692640 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.692614 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.695096 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695064 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 21:09:23.695224 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695189 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 21:09:23.695581 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695565 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 21:09:23.695733 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 21:09:23.695794 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695712 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7frsw\"" Jun 05 21:09:23.695794 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695755 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 21:09:23.695926 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695850 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 21:09:23.695926 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.695894 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 21:09:23.700077 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.700055 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 21:09:23.703332 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.703311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b4cc887d-492hg"] Jun 05 21:09:23.774215 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774179 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-trusted-ca-bundle\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774265 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgvtb\" (UniqueName: \"kubernetes.io/projected/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-kube-api-access-rgvtb\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774368 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-service-ca\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774406 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-oauth-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.774647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.774439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-oauth-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.874872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.874835 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.874872 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.874874 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-service-ca\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875110 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.874900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-oauth-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875110 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.874931 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-oauth-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875110 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.875050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-trusted-ca-bundle\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875110 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.875105 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875302 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.875137 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgvtb\" (UniqueName: \"kubernetes.io/projected/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-kube-api-access-rgvtb\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875769 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.875741 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-oauth-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.875913 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.875800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-service-ca\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.876082 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.876056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.876153 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.876123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-trusted-ca-bundle\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.877451 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.877428 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-oauth-config\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.877628 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.877608 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-console-serving-cert\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:23.893202 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:23.893177 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgvtb\" (UniqueName: \"kubernetes.io/projected/09aeb6d9-00e3-4d25-8d87-f00beac7f6c0-kube-api-access-rgvtb\") pod \"console-74b4cc887d-492hg\" (UID: \"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0\") " pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:24.005000 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:24.004919 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:24.172873 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:24.172845 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b4cc887d-492hg"] Jun 05 21:09:24.175338 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:09:24.175306 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09aeb6d9_00e3_4d25_8d87_f00beac7f6c0.slice/crio-80bc202aa0d6ff38e9d2b76640f063f0b43ee4c9390feba0a09f2ccc25dc31dd WatchSource:0}: Error finding container 80bc202aa0d6ff38e9d2b76640f063f0b43ee4c9390feba0a09f2ccc25dc31dd: Status 404 returned error can't find the container with id 80bc202aa0d6ff38e9d2b76640f063f0b43ee4c9390feba0a09f2ccc25dc31dd Jun 05 21:09:24.819253 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:24.819214 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b4cc887d-492hg" event={"ID":"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0","Type":"ContainerStarted","Data":"833d9314ec1fd785fcd92778e05c90279eef31f7639f51f3c3ded1523cfe7069"} Jun 05 21:09:24.819253 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:24.819263 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b4cc887d-492hg" event={"ID":"09aeb6d9-00e3-4d25-8d87-f00beac7f6c0","Type":"ContainerStarted","Data":"80bc202aa0d6ff38e9d2b76640f063f0b43ee4c9390feba0a09f2ccc25dc31dd"} Jun 05 21:09:24.835966 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:24.835915 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74b4cc887d-492hg" podStartSLOduration=1.8358981779999999 podStartE2EDuration="1.835898178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:24.834545722 +0000 UTC m=+634.906806104" watchObservedRunningTime="2026-06-05 21:09:24.835898178 +0000 UTC m=+634.908158615" Jun 05 21:09:31.910496 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:31.910455 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:09:31.910777 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:31.910547 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 21:09:32.859110 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:32.859075 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" event={"ID":"b1940227-370b-4155-b038-0cff8986f764","Type":"ContainerStarted","Data":"b3a1fa5f70e0ee83b015333a2e7a483533bdea2739975b4f0633d27890f447ae"} Jun 05 21:09:32.859318 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:32.859227 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:32.861008 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:32.860982 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-cxpj4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 05 21:09:32.861122 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:32.861037 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" podUID="b1940227-370b-4155-b038-0cff8986f764" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 21:09:32.878600 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:32.878546 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" podStartSLOduration=1.9917686140000002 podStartE2EDuration="15.878526976s" totalImagesPullingTime="13.886758362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:32.876001706 +0000 UTC m=+642.948262086" watchObservedRunningTime="2026-06-05 21:09:32.878526976 +0000 UTC m=+642.950787334" Jun 05 21:09:33.703980 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:33.703950 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-c85q8" Jun 05 21:09:33.864309 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:33.864282 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-cxpj4" Jun 05 21:09:34.005961 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:34.005884 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:34.006115 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:34.005976 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:34.010694 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:34.010663 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:34.872064 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:34.872033 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b4cc887d-492hg" Jun 05 21:09:35.711548 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:35.711494 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-r29n4" Jun 05 21:09:37.822947 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.822908 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq"] Jun 05 21:09:37.842070 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.842033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq"] Jun 05 21:09:37.842248 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.842143 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:37.844313 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.844293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jkk68\"" Jun 05 21:09:37.844416 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.844294 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 21:09:37.904428 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.904383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rr4\" (UniqueName: \"kubernetes.io/projected/687609ad-a24d-49d7-aada-fb941c7966a9-kube-api-access-d4rr4\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:37.904618 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:37.904434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/687609ad-a24d-49d7-aada-fb941c7966a9-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.005786 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.005744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rr4\" (UniqueName: \"kubernetes.io/projected/687609ad-a24d-49d7-aada-fb941c7966a9-kube-api-access-d4rr4\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.005786 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.005790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/687609ad-a24d-49d7-aada-fb941c7966a9-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.006449 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.006431 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/687609ad-a24d-49d7-aada-fb941c7966a9-redirect-config\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.013757 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.013723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rr4\" (UniqueName: \"kubernetes.io/projected/687609ad-a24d-49d7-aada-fb941c7966a9-kube-api-access-d4rr4\") pod \"dashboard-redirect-6d4cdcb7d7-p8mvq\" (UID: \"687609ad-a24d-49d7-aada-fb941c7966a9\") " pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.154537 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.154422 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" Jun 05 21:09:38.302946 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.302921 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq"] Jun 05 21:09:38.305387 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:09:38.305358 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687609ad_a24d_49d7_aada_fb941c7966a9.slice/crio-f869c070ef1bdc778066f45ebbcf8abd02d6e0323add3831f75829d79a1fd66d WatchSource:0}: Error finding container f869c070ef1bdc778066f45ebbcf8abd02d6e0323add3831f75829d79a1fd66d: Status 404 returned error can't find the container with id f869c070ef1bdc778066f45ebbcf8abd02d6e0323add3831f75829d79a1fd66d Jun 05 21:09:38.306940 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.306923 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:09:38.888058 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:38.888018 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" event={"ID":"687609ad-a24d-49d7-aada-fb941c7966a9","Type":"ContainerStarted","Data":"f869c070ef1bdc778066f45ebbcf8abd02d6e0323add3831f75829d79a1fd66d"} Jun 05 21:09:40.899761 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:40.899721 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" event={"ID":"687609ad-a24d-49d7-aada-fb941c7966a9","Type":"ContainerStarted","Data":"6a378f588c638669e1a0fb8253cb334f23f0131e26c2836c46b1762ea9761a05"} Jun 05 21:09:40.914077 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:09:40.914015 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d4cdcb7d7-p8mvq" podStartSLOduration=1.842145544 podStartE2EDuration="3.91399876s" totalImagesPullingTime="2.071853216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:09:40.91302463 +0000 UTC m=+650.985285009" watchObservedRunningTime="2026-06-05 21:09:40.91399876 +0000 UTC m=+650.986259125" Jun 05 21:10:20.417388 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.417357 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h"] Jun 05 21:10:20.424167 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.424146 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:20.426373 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.426353 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-s4smc\"" Jun 05 21:10:20.426487 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.426357 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 21:10:20.426780 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.426766 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 21:10:20.431920 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.431574 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h"] Jun 05 21:10:20.480812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.480777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tpnw\" (UniqueName: \"kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw\") pod \"limitador-operator-controller-manager-859d7b78bd-kct2h\" (UID: \"3db7d933-2907-448b-9169-9a5828af804d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:20.581416 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.581378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tpnw\" (UniqueName: \"kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw\") pod \"limitador-operator-controller-manager-859d7b78bd-kct2h\" (UID: \"3db7d933-2907-448b-9169-9a5828af804d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:20.591825 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.591789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tpnw\" (UniqueName: \"kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw\") pod \"limitador-operator-controller-manager-859d7b78bd-kct2h\" (UID: \"3db7d933-2907-448b-9169-9a5828af804d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:20.736543 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.736412 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:20.871479 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:20.871454 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h"] Jun 05 21:10:20.873385 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:10:20.873346 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db7d933_2907_448b_9169_9a5828af804d.slice/crio-c8b360e8e69b680adfe6fb6612fa9a11e50177e1e5d586cddff1c7ae6a08c360 WatchSource:0}: Error finding container c8b360e8e69b680adfe6fb6612fa9a11e50177e1e5d586cddff1c7ae6a08c360: Status 404 returned error can't find the container with id c8b360e8e69b680adfe6fb6612fa9a11e50177e1e5d586cddff1c7ae6a08c360 Jun 05 21:10:21.093804 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:21.093773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" event={"ID":"3db7d933-2907-448b-9169-9a5828af804d","Type":"ContainerStarted","Data":"c8b360e8e69b680adfe6fb6612fa9a11e50177e1e5d586cddff1c7ae6a08c360"} Jun 05 21:10:23.106480 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:23.106440 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" event={"ID":"3db7d933-2907-448b-9169-9a5828af804d","Type":"ContainerStarted","Data":"e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c"} Jun 05 21:10:23.106874 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:23.106536 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:23.121259 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:23.121210 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" podStartSLOduration=1.316767679 podStartE2EDuration="3.121193368s" totalImagesPullingTime="1.804425689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:23.119944461 +0000 UTC m=+693.192204828" watchObservedRunningTime="2026-06-05 21:10:23.121193368 +0000 UTC m=+693.193453733" Jun 05 21:10:34.113530 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:34.113482 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:50.520694 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.520617 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h"] Jun 05 21:10:50.521096 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.520828 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" podUID="3db7d933-2907-448b-9169-9a5828af804d" containerName="manager" containerID="cri-o://e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c" gracePeriod=2 Jun 05 21:10:50.528247 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.528217 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h"] Jun 05 21:10:50.552050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.552020 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74"] Jun 05 21:10:50.552698 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.552677 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db7d933-2907-448b-9169-9a5828af804d" containerName="manager" Jun 05 21:10:50.552698 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.552699 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db7d933-2907-448b-9169-9a5828af804d" containerName="manager" Jun 05 21:10:50.552867 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.552823 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db7d933-2907-448b-9169-9a5828af804d" containerName="manager" Jun 05 21:10:50.555080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.555057 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:50.557495 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:10:50.557463 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kct2h\" is forbidden: User \"system:node:ip-10-0-140-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-154.ec2.internal' and this object" podUID="3db7d933-2907-448b-9169-9a5828af804d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:50.572900 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.572868 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74"] Jun 05 21:10:50.651589 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.651555 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5x5v\" (UniqueName: \"kubernetes.io/projected/09d3270e-1601-405e-a02d-b12501d45153-kube-api-access-p5x5v\") pod \"limitador-operator-controller-manager-859d7b78bd-s7h74\" (UID: \"09d3270e-1601-405e-a02d-b12501d45153\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:50.752076 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.752042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5x5v\" (UniqueName: \"kubernetes.io/projected/09d3270e-1601-405e-a02d-b12501d45153-kube-api-access-p5x5v\") pod \"limitador-operator-controller-manager-859d7b78bd-s7h74\" (UID: \"09d3270e-1601-405e-a02d-b12501d45153\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:50.763003 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.762973 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:50.764127 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.764103 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5x5v\" (UniqueName: \"kubernetes.io/projected/09d3270e-1601-405e-a02d-b12501d45153-kube-api-access-p5x5v\") pod \"limitador-operator-controller-manager-859d7b78bd-s7h74\" (UID: \"09d3270e-1601-405e-a02d-b12501d45153\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:50.764677 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:10:50.764653 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kct2h\" is forbidden: User \"system:node:ip-10-0-140-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-154.ec2.internal' and this object" podUID="3db7d933-2907-448b-9169-9a5828af804d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:50.853090 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.853057 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tpnw\" (UniqueName: \"kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw\") pod \"3db7d933-2907-448b-9169-9a5828af804d\" (UID: \"3db7d933-2907-448b-9169-9a5828af804d\") " Jun 05 21:10:50.855151 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.855129 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw" (OuterVolumeSpecName: "kube-api-access-2tpnw") pod "3db7d933-2907-448b-9169-9a5828af804d" (UID: "3db7d933-2907-448b-9169-9a5828af804d"). InnerVolumeSpecName "kube-api-access-2tpnw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:10:50.892993 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.892946 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:50.954178 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:50.954147 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tpnw\" (UniqueName: \"kubernetes.io/projected/3db7d933-2907-448b-9169-9a5828af804d-kube-api-access-2tpnw\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:10:51.028544 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.028502 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74"] Jun 05 21:10:51.030714 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:10:51.030685 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d3270e_1601_405e_a02d_b12501d45153.slice/crio-f69c99bcd6d162e074b4645e794313264fa01cec38da30fb40bd240060940332 WatchSource:0}: Error finding container f69c99bcd6d162e074b4645e794313264fa01cec38da30fb40bd240060940332: Status 404 returned error can't find the container with id f69c99bcd6d162e074b4645e794313264fa01cec38da30fb40bd240060940332 Jun 05 21:10:51.242895 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.242796 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" event={"ID":"09d3270e-1601-405e-a02d-b12501d45153","Type":"ContainerStarted","Data":"5fa2e33d8a4d6782a811c785366de46447516050db44beb558f6a04b71a56e5b"} Jun 05 21:10:51.242895 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.242855 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" event={"ID":"09d3270e-1601-405e-a02d-b12501d45153","Type":"ContainerStarted","Data":"f69c99bcd6d162e074b4645e794313264fa01cec38da30fb40bd240060940332"} Jun 05 21:10:51.242895 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.242884 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:10:51.244174 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.244142 2555 generic.go:356] "Generic (PLEG): container finished" podID="3db7d933-2907-448b-9169-9a5828af804d" containerID="e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c" exitCode=0 Jun 05 21:10:51.244304 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.244188 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:51.244304 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.244196 2555 scope.go:117] "RemoveContainer" containerID="e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c" Jun 05 21:10:51.245331 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:10:51.245196 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kct2h\" is forbidden: User \"system:node:ip-10-0-140-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-154.ec2.internal' and this object" podUID="3db7d933-2907-448b-9169-9a5828af804d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:51.253481 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.253464 2555 scope.go:117] "RemoveContainer" containerID="e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c" Jun 05 21:10:51.253703 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:10:51.253683 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c\": container with ID starting with e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c not found: ID does not exist" containerID="e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c" Jun 05 21:10:51.253753 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.253716 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c"} err="failed to get container status \"e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c\": rpc error: code = NotFound desc = could not find container \"e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c\": container with ID starting with e1816c9cdb6fb804072436b402c26986132a62d73d45466d95b4d8bed13ca11c not found: ID does not exist" Jun 05 21:10:51.265419 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:51.265374 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" podStartSLOduration=1.265358752 podStartE2EDuration="1.265358752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:10:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:10:51.264693482 +0000 UTC m=+721.336953849" watchObservedRunningTime="2026-06-05 21:10:51.265358752 +0000 UTC m=+721.337619118" Jun 05 21:10:51.266302 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:10:51.266272 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kct2h\" is forbidden: User \"system:node:ip-10-0-140-154.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-154.ec2.internal' and this object" podUID="3db7d933-2907-448b-9169-9a5828af804d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kct2h" Jun 05 21:10:52.387207 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:10:52.387167 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db7d933-2907-448b-9169-9a5828af804d" path="/var/lib/kubelet/pods/3db7d933-2907-448b-9169-9a5828af804d/volumes" Jun 05 21:11:02.253187 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:02.253152 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s7h74" Jun 05 21:11:23.166148 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.166114 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:23.169737 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.169722 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.171748 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.171727 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 21:11:23.171860 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.171763 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s9hqq\"" Jun 05 21:11:23.179536 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.179492 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:23.217860 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.217823 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.218103 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.218022 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9tf\" (UniqueName: \"kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.255385 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.255354 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:23.319068 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.319028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.319244 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.319135 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9tf\" (UniqueName: \"kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.319711 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.319686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.329604 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.329579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9tf\" (UniqueName: \"kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf\") pod \"limitador-limitador-64c94fd64f-w54j6\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.481228 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.481159 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:23.614287 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:23.614262 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:23.616610 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:11:23.616570 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77455e1_9fa9_431a_84fb_08b6a5702b46.slice/crio-24aef16492411af78a8f32087f4c7536dcfa9e5020b2a67d47d4d2862ac4cbb7 WatchSource:0}: Error finding container 24aef16492411af78a8f32087f4c7536dcfa9e5020b2a67d47d4d2862ac4cbb7: Status 404 returned error can't find the container with id 24aef16492411af78a8f32087f4c7536dcfa9e5020b2a67d47d4d2862ac4cbb7 Jun 05 21:11:24.412929 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:24.412887 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" event={"ID":"a77455e1-9fa9-431a-84fb-08b6a5702b46","Type":"ContainerStarted","Data":"24aef16492411af78a8f32087f4c7536dcfa9e5020b2a67d47d4d2862ac4cbb7"} Jun 05 21:11:27.431230 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:27.431197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" event={"ID":"a77455e1-9fa9-431a-84fb-08b6a5702b46","Type":"ContainerStarted","Data":"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024"} Jun 05 21:11:27.431614 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:27.431316 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:27.447760 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:27.447705 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" podStartSLOduration=1.638976947 podStartE2EDuration="4.447692177s" totalImagesPullingTime="2.80871523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:11:27.445578323 +0000 UTC m=+757.517838690" watchObservedRunningTime="2026-06-05 21:11:27.447692177 +0000 UTC m=+757.519952542" Jun 05 21:11:38.437276 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:38.437246 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:40.418969 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:40.418936 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:40.419775 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:40.419721 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" podUID="a77455e1-9fa9-431a-84fb-08b6a5702b46" containerName="limitador" containerID="cri-o://2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024" gracePeriod=30 Jun 05 21:11:40.975234 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:40.975209 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:41.075658 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.075627 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file\") pod \"a77455e1-9fa9-431a-84fb-08b6a5702b46\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " Jun 05 21:11:41.075814 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.075704 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z9tf\" (UniqueName: \"kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf\") pod \"a77455e1-9fa9-431a-84fb-08b6a5702b46\" (UID: \"a77455e1-9fa9-431a-84fb-08b6a5702b46\") " Jun 05 21:11:41.076054 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.076018 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file" (OuterVolumeSpecName: "config-file") pod "a77455e1-9fa9-431a-84fb-08b6a5702b46" (UID: "a77455e1-9fa9-431a-84fb-08b6a5702b46"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 21:11:41.077731 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.077708 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf" (OuterVolumeSpecName: "kube-api-access-5z9tf") pod "a77455e1-9fa9-431a-84fb-08b6a5702b46" (UID: "a77455e1-9fa9-431a-84fb-08b6a5702b46"). InnerVolumeSpecName "kube-api-access-5z9tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:11:41.176486 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.176453 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a77455e1-9fa9-431a-84fb-08b6a5702b46-config-file\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:11:41.176486 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.176482 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z9tf\" (UniqueName: \"kubernetes.io/projected/a77455e1-9fa9-431a-84fb-08b6a5702b46-kube-api-access-5z9tf\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:11:41.499048 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.498961 2555 generic.go:356] "Generic (PLEG): container finished" podID="a77455e1-9fa9-431a-84fb-08b6a5702b46" containerID="2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024" exitCode=0 Jun 05 21:11:41.499048 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.499008 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" Jun 05 21:11:41.499446 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.499043 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" event={"ID":"a77455e1-9fa9-431a-84fb-08b6a5702b46","Type":"ContainerDied","Data":"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024"} Jun 05 21:11:41.499446 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.499096 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w54j6" event={"ID":"a77455e1-9fa9-431a-84fb-08b6a5702b46","Type":"ContainerDied","Data":"24aef16492411af78a8f32087f4c7536dcfa9e5020b2a67d47d4d2862ac4cbb7"} Jun 05 21:11:41.499446 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.499118 2555 scope.go:117] "RemoveContainer" containerID="2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024" Jun 05 21:11:41.508050 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.508033 2555 scope.go:117] "RemoveContainer" containerID="2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024" Jun 05 21:11:41.508304 ip-10-0-140-154 kubenswrapper[2555]: E0605 21:11:41.508284 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024\": container with ID starting with 2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024 not found: ID does not exist" containerID="2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024" Jun 05 21:11:41.508374 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.508312 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024"} err="failed to get container status \"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024\": rpc error: code = NotFound desc = could not find container \"2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024\": container with ID starting with 2872f3277ee343fe6a0c021ee416d215e06f751bf94de4dec94ec293752d8024 not found: ID does not exist" Jun 05 21:11:41.519871 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.519848 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:41.525875 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:41.525851 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w54j6"] Jun 05 21:11:42.387081 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:42.387037 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77455e1-9fa9-431a-84fb-08b6a5702b46" path="/var/lib/kubelet/pods/a77455e1-9fa9-431a-84fb-08b6a5702b46/volumes" Jun 05 21:11:44.341540 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.341494 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-p6h99"] Jun 05 21:11:44.342080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.342063 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77455e1-9fa9-431a-84fb-08b6a5702b46" containerName="limitador" Jun 05 21:11:44.342132 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.342084 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77455e1-9fa9-431a-84fb-08b6a5702b46" containerName="limitador" Jun 05 21:11:44.342182 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.342171 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77455e1-9fa9-431a-84fb-08b6a5702b46" containerName="limitador" Jun 05 21:11:44.346690 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.346671 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.349069 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.349046 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 21:11:44.350756 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.350728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p6h99"] Jun 05 21:11:44.507598 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.507552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4317d4-7014-47d6-99f9-5e1fdb5dc788-data\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.507805 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.507703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4n9\" (UniqueName: \"kubernetes.io/projected/da4317d4-7014-47d6-99f9-5e1fdb5dc788-kube-api-access-cw4n9\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.608247 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.608164 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4317d4-7014-47d6-99f9-5e1fdb5dc788-data\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.608247 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.608233 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4n9\" (UniqueName: \"kubernetes.io/projected/da4317d4-7014-47d6-99f9-5e1fdb5dc788-kube-api-access-cw4n9\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.608590 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.608572 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/da4317d4-7014-47d6-99f9-5e1fdb5dc788-data\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.615678 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.615657 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4n9\" (UniqueName: \"kubernetes.io/projected/da4317d4-7014-47d6-99f9-5e1fdb5dc788-kube-api-access-cw4n9\") pod \"postgres-69fb4594cf-p6h99\" (UID: \"da4317d4-7014-47d6-99f9-5e1fdb5dc788\") " pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.658188 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.658160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:44.788751 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:44.788721 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p6h99"] Jun 05 21:11:44.790832 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:11:44.790792 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4317d4_7014_47d6_99f9_5e1fdb5dc788.slice/crio-8878998bc4b9ffb1dd9309049fa0b84efc81cfc067dcb3d212777636aa36f75a WatchSource:0}: Error finding container 8878998bc4b9ffb1dd9309049fa0b84efc81cfc067dcb3d212777636aa36f75a: Status 404 returned error can't find the container with id 8878998bc4b9ffb1dd9309049fa0b84efc81cfc067dcb3d212777636aa36f75a Jun 05 21:11:45.525369 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:45.525294 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p6h99" event={"ID":"da4317d4-7014-47d6-99f9-5e1fdb5dc788","Type":"ContainerStarted","Data":"8878998bc4b9ffb1dd9309049fa0b84efc81cfc067dcb3d212777636aa36f75a"} Jun 05 21:11:47.537774 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:47.537738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p6h99" event={"ID":"da4317d4-7014-47d6-99f9-5e1fdb5dc788","Type":"ContainerStarted","Data":"9fa97f5bc0fc0ed9d3c9fb048e38bf25a87aa0af1ce431bae550900f7185e5d8"} Jun 05 21:11:47.538258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:47.537814 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:11:47.553770 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:47.553713 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-p6h99" podStartSLOduration=1.356150811 podStartE2EDuration="3.55369748s" totalImagesPullingTime="2.197546669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:11:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:11:47.551493552 +0000 UTC m=+777.623753926" watchObservedRunningTime="2026-06-05 21:11:47.55369748 +0000 UTC m=+777.625957846" Jun 05 21:11:53.576383 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:11:53.576352 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-p6h99" Jun 05 21:12:02.668848 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.668813 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-cd7h9"] Jun 05 21:12:02.677682 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.677659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" Jun 05 21:12:02.681223 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.681196 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 21:12:02.681446 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.681428 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 21:12:02.681734 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.681718 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-gbpzf\"" Jun 05 21:12:02.683316 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.683292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-cd7h9"] Jun 05 21:12:02.771801 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.771769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ccqw\" (UniqueName: \"kubernetes.io/projected/eb9aead2-9214-4a61-854b-8f1f2c89e9b4-kube-api-access-9ccqw\") pod \"keycloak-operator-dd84cbf46-cd7h9\" (UID: \"eb9aead2-9214-4a61-854b-8f1f2c89e9b4\") " pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" Jun 05 21:12:02.872584 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.872502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ccqw\" (UniqueName: \"kubernetes.io/projected/eb9aead2-9214-4a61-854b-8f1f2c89e9b4-kube-api-access-9ccqw\") pod \"keycloak-operator-dd84cbf46-cd7h9\" (UID: \"eb9aead2-9214-4a61-854b-8f1f2c89e9b4\") " pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" Jun 05 21:12:02.881733 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.881705 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ccqw\" (UniqueName: \"kubernetes.io/projected/eb9aead2-9214-4a61-854b-8f1f2c89e9b4-kube-api-access-9ccqw\") pod \"keycloak-operator-dd84cbf46-cd7h9\" (UID: \"eb9aead2-9214-4a61-854b-8f1f2c89e9b4\") " pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" Jun 05 21:12:02.989586 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:02.989476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" Jun 05 21:12:03.120747 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:03.120722 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-cd7h9"] Jun 05 21:12:03.122761 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:12:03.122732 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9aead2_9214_4a61_854b_8f1f2c89e9b4.slice/crio-89b5a4a82d525dacf8c04b75df67901cf3712efbac2c2791846ecda2659fce76 WatchSource:0}: Error finding container 89b5a4a82d525dacf8c04b75df67901cf3712efbac2c2791846ecda2659fce76: Status 404 returned error can't find the container with id 89b5a4a82d525dacf8c04b75df67901cf3712efbac2c2791846ecda2659fce76 Jun 05 21:12:03.614380 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:03.614348 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" event={"ID":"eb9aead2-9214-4a61-854b-8f1f2c89e9b4","Type":"ContainerStarted","Data":"89b5a4a82d525dacf8c04b75df67901cf3712efbac2c2791846ecda2659fce76"} Jun 05 21:12:09.650386 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:09.650347 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" event={"ID":"eb9aead2-9214-4a61-854b-8f1f2c89e9b4","Type":"ContainerStarted","Data":"c3b4d98bd90e7f52bfde7bd7d945f6841890804b965b36f5ab5705eaace7dff7"} Jun 05 21:12:09.665652 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:12:09.665602 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-cd7h9" podStartSLOduration=2.084581335 podStartE2EDuration="7.665587897s" totalImagesPullingTime="5.581006562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:12:09.664356479 +0000 UTC m=+799.736616857" watchObservedRunningTime="2026-06-05 21:12:09.665587897 +0000 UTC m=+799.737848263" Jun 05 21:13:25.618303 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.618267 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pz5z4"] Jun 05 21:13:25.620724 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.620708 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:25.623618 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.623597 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-shlrs\"" Jun 05 21:13:25.624137 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.624120 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 21:13:25.631827 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.631799 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pz5z4"] Jun 05 21:13:25.734364 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.734323 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjpc\" (UniqueName: \"kubernetes.io/projected/8b16537e-c914-4fb8-b86b-bdfbe85caf4c-kube-api-access-jbjpc\") pod \"payload-pre-processing-67d7689b65-pz5z4\" (UID: \"8b16537e-c914-4fb8-b86b-bdfbe85caf4c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:25.835103 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.835068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjpc\" (UniqueName: \"kubernetes.io/projected/8b16537e-c914-4fb8-b86b-bdfbe85caf4c-kube-api-access-jbjpc\") pod \"payload-pre-processing-67d7689b65-pz5z4\" (UID: \"8b16537e-c914-4fb8-b86b-bdfbe85caf4c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:25.847609 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.847581 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjpc\" (UniqueName: \"kubernetes.io/projected/8b16537e-c914-4fb8-b86b-bdfbe85caf4c-kube-api-access-jbjpc\") pod \"payload-pre-processing-67d7689b65-pz5z4\" (UID: \"8b16537e-c914-4fb8-b86b-bdfbe85caf4c\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:25.932573 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:25.932466 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:26.085249 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:26.085213 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-pz5z4"] Jun 05 21:13:26.087533 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:13:26.087480 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b16537e_c914_4fb8_b86b_bdfbe85caf4c.slice/crio-def3d17ee08382c740724fd860b650fcbff5113024a586cdebe923814c88adcb WatchSource:0}: Error finding container def3d17ee08382c740724fd860b650fcbff5113024a586cdebe923814c88adcb: Status 404 returned error can't find the container with id def3d17ee08382c740724fd860b650fcbff5113024a586cdebe923814c88adcb Jun 05 21:13:27.046932 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:27.046812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" event={"ID":"8b16537e-c914-4fb8-b86b-bdfbe85caf4c","Type":"ContainerStarted","Data":"def3d17ee08382c740724fd860b650fcbff5113024a586cdebe923814c88adcb"} Jun 05 21:13:29.059019 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:29.058978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" event={"ID":"8b16537e-c914-4fb8-b86b-bdfbe85caf4c","Type":"ContainerStarted","Data":"95992bdf82e29c2e173ade8339fbf61c68292f7fecceb1f8c624f22762177113"} Jun 05 21:13:29.059395 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:29.059113 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:29.072638 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:29.072583 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" podStartSLOduration=1.93908689 podStartE2EDuration="4.072566359s" totalImagesPullingTime="2.133479469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:13:29.07234409 +0000 UTC m=+879.144604457" watchObservedRunningTime="2026-06-05 21:13:29.072566359 +0000 UTC m=+879.144826726" Jun 05 21:13:40.066921 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:40.066844 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-pz5z4" Jun 05 21:13:52.736406 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:52.736372 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:13:52.736842 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:52.736373 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:13:52.741132 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:52.741110 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:13:52.741235 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:13:52.741190 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:14:29.798404 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.798368 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc"] Jun 05 21:14:29.802255 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.802230 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.804344 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.804322 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 21:14:29.804465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.804350 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 21:14:29.804809 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.804791 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kqzqj\"" Jun 05 21:14:29.804809 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.804805 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 21:14:29.811471 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.811449 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc"] Jun 05 21:14:29.922438 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.922658 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.922658 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.922658 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a67058-d5a7-4665-84c2-eba84f2767a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.922821 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:29.922821 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:29.922727 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk7fv\" (UniqueName: \"kubernetes.io/projected/62a67058-d5a7-4665-84c2-eba84f2767a5-kube-api-access-kk7fv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023261 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023551 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a67058-d5a7-4665-84c2-eba84f2767a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023551 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023319 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023551 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk7fv\" (UniqueName: \"kubernetes.io/projected/62a67058-d5a7-4665-84c2-eba84f2767a5-kube-api-access-kk7fv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023551 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023786 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023714 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023824 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.023858 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.023829 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.025722 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.025697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62a67058-d5a7-4665-84c2-eba84f2767a5-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.025824 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.025803 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62a67058-d5a7-4665-84c2-eba84f2767a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.030320 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.030298 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk7fv\" (UniqueName: \"kubernetes.io/projected/62a67058-d5a7-4665-84c2-eba84f2767a5-kube-api-access-kk7fv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-52qjc\" (UID: \"62a67058-d5a7-4665-84c2-eba84f2767a5\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.115808 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.115705 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:30.255323 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.255270 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc"] Jun 05 21:14:30.258363 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:14:30.258333 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a67058_d5a7_4665_84c2_eba84f2767a5.slice/crio-d20c64808df8435263705780c96572103553f7f1ec7eb14c7fa8ae3c7c77bc53 WatchSource:0}: Error finding container d20c64808df8435263705780c96572103553f7f1ec7eb14c7fa8ae3c7c77bc53: Status 404 returned error can't find the container with id d20c64808df8435263705780c96572103553f7f1ec7eb14c7fa8ae3c7c77bc53 Jun 05 21:14:30.373020 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:30.372944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" event={"ID":"62a67058-d5a7-4665-84c2-eba84f2767a5","Type":"ContainerStarted","Data":"d20c64808df8435263705780c96572103553f7f1ec7eb14c7fa8ae3c7c77bc53"} Jun 05 21:14:35.399216 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:35.399180 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" event={"ID":"62a67058-d5a7-4665-84c2-eba84f2767a5","Type":"ContainerStarted","Data":"a125ae442d9ccd14dcf1758efc66da0bb73961fb857fa55adee70c839c2b575a"} Jun 05 21:14:37.411285 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:37.411247 2555 generic.go:356] "Generic (PLEG): container finished" podID="62a67058-d5a7-4665-84c2-eba84f2767a5" containerID="a125ae442d9ccd14dcf1758efc66da0bb73961fb857fa55adee70c839c2b575a" exitCode=0 Jun 05 21:14:37.411787 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:37.411295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" event={"ID":"62a67058-d5a7-4665-84c2-eba84f2767a5","Type":"ContainerDied","Data":"a125ae442d9ccd14dcf1758efc66da0bb73961fb857fa55adee70c839c2b575a"} Jun 05 21:14:39.424596 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:39.424562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" event={"ID":"62a67058-d5a7-4665-84c2-eba84f2767a5","Type":"ContainerStarted","Data":"3ea8f101b5bc344747171a3233e9f9ff3090e073d092f0409333a007a0f158c1"} Jun 05 21:14:39.441207 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:39.441155 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" podStartSLOduration=2.954825524 podStartE2EDuration="10.441138512s" totalImagesPullingTime="5.204116092s" totalInitContainerRuntime="2.282196896s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:39.440133597 +0000 UTC m=+949.512393978" watchObservedRunningTime="2026-06-05 21:14:39.441138512 +0000 UTC m=+949.513398878" Jun 05 21:14:40.116113 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:40.116074 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:40.116287 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:40.116142 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:40.128564 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:40.128540 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:40.442399 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:40.442311 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-52qjc" Jun 05 21:14:43.384927 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.384889 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns"] Jun 05 21:14:43.389161 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.389139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.390922 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.390900 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 21:14:43.397457 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.397435 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns"] Jun 05 21:14:43.448459 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448422 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.448677 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448495 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.448677 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448620 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.448796 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.448796 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6br2v\" (UniqueName: \"kubernetes.io/projected/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kube-api-access-6br2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.448873 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.448809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.549629 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.549808 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549655 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.549875 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549819 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6br2v\" (UniqueName: \"kubernetes.io/projected/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kube-api-access-6br2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.549875 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.549979 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549938 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.550036 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549980 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.550036 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.549996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.550152 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.550049 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.550242 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.550223 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.552027 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.551989 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.552421 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.552400 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.556630 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.556608 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6br2v\" (UniqueName: \"kubernetes.io/projected/f28def5c-11ba-4aec-a9a3-23c0f059f6c4-kube-api-access-6br2v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns\" (UID: \"f28def5c-11ba-4aec-a9a3-23c0f059f6c4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.700256 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.700160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:43.837001 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:43.836966 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns"] Jun 05 21:14:43.840194 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:14:43.840153 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28def5c_11ba_4aec_a9a3_23c0f059f6c4.slice/crio-1c29ff3f7057a2b20a1594cc17e1f5f90d707565a59362d8de23be031369a53d WatchSource:0}: Error finding container 1c29ff3f7057a2b20a1594cc17e1f5f90d707565a59362d8de23be031369a53d: Status 404 returned error can't find the container with id 1c29ff3f7057a2b20a1594cc17e1f5f90d707565a59362d8de23be031369a53d Jun 05 21:14:44.453008 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:44.452970 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" event={"ID":"f28def5c-11ba-4aec-a9a3-23c0f059f6c4","Type":"ContainerStarted","Data":"52b3dbe09b7788b9435abfdb1478a3ace6bb4ab2d98824e7d74196f02048066e"} Jun 05 21:14:44.453376 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:44.453026 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" event={"ID":"f28def5c-11ba-4aec-a9a3-23c0f059f6c4","Type":"ContainerStarted","Data":"1c29ff3f7057a2b20a1594cc17e1f5f90d707565a59362d8de23be031369a53d"} Jun 05 21:14:45.459488 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:45.459451 2555 generic.go:356] "Generic (PLEG): container finished" podID="f28def5c-11ba-4aec-a9a3-23c0f059f6c4" containerID="52b3dbe09b7788b9435abfdb1478a3ace6bb4ab2d98824e7d74196f02048066e" exitCode=0 Jun 05 21:14:45.459986 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:45.459492 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" event={"ID":"f28def5c-11ba-4aec-a9a3-23c0f059f6c4","Type":"ContainerDied","Data":"52b3dbe09b7788b9435abfdb1478a3ace6bb4ab2d98824e7d74196f02048066e"} Jun 05 21:14:45.460070 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:45.460054 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:14:46.466361 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:46.466325 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" event={"ID":"f28def5c-11ba-4aec-a9a3-23c0f059f6c4","Type":"ContainerStarted","Data":"447d50d3980ecdfe9087d4279df19c01e2baa84443382c0e758c2109aaa7f5be"} Jun 05 21:14:46.483617 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:46.483571 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" podStartSLOduration=1.898870549 podStartE2EDuration="3.483553401s" totalImagesPullingTime="270.814633ms" totalInitContainerRuntime="1.313868219s" isStatefulPod=false podCreationTimestamp="2026-06-05 21:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:14:46.481997422 +0000 UTC m=+956.554257822" watchObservedRunningTime="2026-06-05 21:14:46.483553401 +0000 UTC m=+956.555813768" Jun 05 21:14:53.701003 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:53.700958 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:53.701579 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:53.701067 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:53.713675 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:53.713645 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:14:54.518182 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:14:54.518149 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns" Jun 05 21:18:52.773262 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:18:52.773228 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:18:52.775538 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:18:52.775497 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:18:52.777996 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:18:52.777981 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:18:52.780403 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:18:52.780385 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:23:52.811700 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:23:52.811664 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:23:52.812255 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:23:52.812235 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:23:52.816396 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:23:52.816375 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:23:52.816990 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:23:52.816971 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:28:52.842895 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:28:52.842866 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:28:52.844499 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:28:52.844472 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:28:52.847631 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:28:52.847609 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:28:52.849318 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:28:52.849300 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:30:00.136297 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.136258 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29678250-lq995"] Jun 05 21:30:00.139735 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.139718 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:00.142200 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.142180 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q6n5s\"" Jun 05 21:30:00.148537 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.148500 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29678250-lq995"] Jun 05 21:30:00.314539 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.314462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrkbp\" (UniqueName: \"kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp\") pod \"maas-api-key-cleanup-29678250-lq995\" (UID: \"6eb2d2e9-1421-448f-b728-4eb42686dbfd\") " pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:00.416067 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.415982 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrkbp\" (UniqueName: \"kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp\") pod \"maas-api-key-cleanup-29678250-lq995\" (UID: \"6eb2d2e9-1421-448f-b728-4eb42686dbfd\") " pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:00.432710 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.432686 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrkbp\" (UniqueName: \"kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp\") pod \"maas-api-key-cleanup-29678250-lq995\" (UID: \"6eb2d2e9-1421-448f-b728-4eb42686dbfd\") " pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:00.450866 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.450840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:00.585368 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.585341 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29678250-lq995"] Jun 05 21:30:00.588194 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:30:00.588158 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb2d2e9_1421_448f_b728_4eb42686dbfd.slice/crio-d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232 WatchSource:0}: Error finding container d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232: Status 404 returned error can't find the container with id d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232 Jun 05 21:30:00.590372 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:00.590347 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 21:30:01.177321 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:01.177286 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" event={"ID":"6eb2d2e9-1421-448f-b728-4eb42686dbfd","Type":"ContainerStarted","Data":"d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232"} Jun 05 21:30:05.200415 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:05.200326 2555 generic.go:356] "Generic (PLEG): container finished" podID="6eb2d2e9-1421-448f-b728-4eb42686dbfd" containerID="fd9e8005ada5128c0e86cd330acdf3e9a3bf5cadcee24cbb915d0a2ca4aba668" exitCode=0 Jun 05 21:30:05.200795 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:05.200414 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" event={"ID":"6eb2d2e9-1421-448f-b728-4eb42686dbfd","Type":"ContainerDied","Data":"fd9e8005ada5128c0e86cd330acdf3e9a3bf5cadcee24cbb915d0a2ca4aba668"} Jun 05 21:30:06.351938 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:06.351907 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:06.370749 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:06.370722 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrkbp\" (UniqueName: \"kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp\") pod \"6eb2d2e9-1421-448f-b728-4eb42686dbfd\" (UID: \"6eb2d2e9-1421-448f-b728-4eb42686dbfd\") " Jun 05 21:30:06.373080 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:06.373051 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp" (OuterVolumeSpecName: "kube-api-access-wrkbp") pod "6eb2d2e9-1421-448f-b728-4eb42686dbfd" (UID: "6eb2d2e9-1421-448f-b728-4eb42686dbfd"). InnerVolumeSpecName "kube-api-access-wrkbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 21:30:06.471890 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:06.471802 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrkbp\" (UniqueName: \"kubernetes.io/projected/6eb2d2e9-1421-448f-b728-4eb42686dbfd-kube-api-access-wrkbp\") on node \"ip-10-0-140-154.ec2.internal\" DevicePath \"\"" Jun 05 21:30:07.212158 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:07.212131 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" Jun 05 21:30:07.212336 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:07.212133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29678250-lq995" event={"ID":"6eb2d2e9-1421-448f-b728-4eb42686dbfd","Type":"ContainerDied","Data":"d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232"} Jun 05 21:30:07.212336 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:30:07.212257 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1726c305380404ca6242e983c9e8f63907d7625d5479d68b0bfd0e15896b232" Jun 05 21:33:52.875335 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:33:52.875304 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:33:52.877908 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:33:52.877860 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:33:52.880187 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:33:52.880167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:33:52.882400 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:33:52.882380 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:38:52.907021 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:38:52.906906 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:38:52.910909 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:38:52.909730 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:38:52.911853 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:38:52.911836 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:38:52.914385 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:38:52.914369 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gxpz9_53b2fd21-dadf-422d-b1f0-f2ec577ce385/ovn-acl-logging/0.log" Jun 05 21:39:14.854715 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:14.854638 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d4cdcb7d7-p8mvq_687609ad-a24d-49d7-aada-fb941c7966a9/nginx/0.log" Jun 05 21:39:14.957000 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:14.956968 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-c85q8_d57eda6e-956f-424b-9012-4bb22598983e/manager/0.log" Jun 05 21:39:15.066627 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:15.066594 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r29n4_e1ee6d90-53eb-47f4-95bf-a9340777471a/manager/0.log" Jun 05 21:39:15.397982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:15.397948 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29678250-lq995_6eb2d2e9-1421-448f-b728-4eb42686dbfd/cleanup/0.log" Jun 05 21:39:15.621749 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:15.621710 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-fbtgs_b57865e1-101f-42d2-ad64-65600ff613e0/server/0.log" Jun 05 21:39:15.733870 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:15.733790 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2vrzz_4ebd71cd-1572-4113-b3f8-fa1d04a1de81/manager/0.log" Jun 05 21:39:16.085717 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:16.085690 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-t5wnq_e31d1e30-8b75-413a-bea1-b99d2d5fff03/copy-manifests/0.log" Jun 05 21:39:16.092662 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:16.092640 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-t5wnq_e31d1e30-8b75-413a-bea1-b99d2d5fff03/manager/0.log" Jun 05 21:39:16.198958 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:16.198924 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p6h99_da4317d4-7014-47d6-99f9-5e1fdb5dc788/postgres/0.log" Jun 05 21:39:18.212870 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:18.212835 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7h74_09d3270e-1601-405e-a02d-b12501d45153/manager/0.log" Jun 05 21:39:18.666794 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:18.666768 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cxpj4_b1940227-370b-4155-b038-0cff8986f764/discovery/0.log" Jun 05 21:39:18.774667 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:18.774634 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f86f755c4-hx5br_a5eb71d9-62ac-42be-b6d1-f39e137e8ccb/kube-auth-proxy/0.log" Jun 05 21:39:19.118374 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:19.118343 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pz5z4_8b16537e-c914-4fb8-b86b-bdfbe85caf4c/payload-pre-processing/0.log" Jun 05 21:39:19.335420 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:19.335375 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:39:19.783628 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:19.783598 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-52qjc_62a67058-d5a7-4665-84c2-eba84f2767a5/storage-initializer/0.log" Jun 05 21:39:19.791246 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:19.791222 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-52qjc_62a67058-d5a7-4665-84c2-eba84f2767a5/main/0.log" Jun 05 21:39:20.046186 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:20.046158 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns_f28def5c-11ba-4aec-a9a3-23c0f059f6c4/storage-initializer/0.log" Jun 05 21:39:20.054369 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:20.054346 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68mns_f28def5c-11ba-4aec-a9a3-23c0f059f6c4/main/0.log" Jun 05 21:39:26.723033 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:26.722999 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mdkxv_0fa0879f-384c-4743-857d-91bf54e7dbdf/global-pull-secret-syncer/0.log" Jun 05 21:39:26.928040 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:26.927994 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zvsll_7040bea4-eecd-40ee-a8a2-b603ddde13fb/konnectivity-agent/0.log" Jun 05 21:39:27.006258 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:27.006176 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-154.ec2.internal_a8bd4781153f9532bb6d7b3eec5a58d8/haproxy/0.log" Jun 05 21:39:30.794745 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:30.794714 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-d4nk5_bc291a49-7ff0-4d1b-b595-725867b128f0/sail-operator/0.log" Jun 05 21:39:32.766554 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:32.766468 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s7h74_09d3270e-1601-405e-a02d-b12501d45153/manager/0.log" Jun 05 21:39:34.371715 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.371683 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/alertmanager/0.log" Jun 05 21:39:34.403400 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.403375 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/config-reloader/0.log" Jun 05 21:39:34.430195 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.430167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/kube-rbac-proxy-web/0.log" Jun 05 21:39:34.454612 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.454590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/kube-rbac-proxy/0.log" Jun 05 21:39:34.479585 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.479560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/kube-rbac-proxy-metric/0.log" Jun 05 21:39:34.511260 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.511234 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/prom-label-proxy/0.log" Jun 05 21:39:34.537973 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.537949 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b51dc19b-f4e3-4b8b-bcfc-604e06c19c28/init-config-reloader/0.log" Jun 05 21:39:34.709746 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.709711 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9b699bfc-dh6h8_8dbc0224-7ba5-4ff8-924a-5d892caa1f56/metrics-server/0.log" Jun 05 21:39:34.745255 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.745223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-5k48c_1a7f3fd7-1272-44ca-b4e2-926dcdfddaee/monitoring-plugin/0.log" Jun 05 21:39:34.914058 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.914036 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/node-exporter/0.log" Jun 05 21:39:34.947259 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.947185 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/kube-rbac-proxy/0.log" Jun 05 21:39:34.971904 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:34.971880 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cmwkf_0b9eec09-89a8-4cfb-891c-f888edeee8f0/init-textfile/0.log" Jun 05 21:39:35.093847 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.093823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/kube-rbac-proxy-main/0.log" Jun 05 21:39:35.122037 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.122016 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/kube-rbac-proxy-self/0.log" Jun 05 21:39:35.149298 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.149273 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-p89j9_e4b5e36e-8bc8-4fc5-861d-3329d3f9c1eb/openshift-state-metrics/0.log" Jun 05 21:39:35.476111 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.476086 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9b8d8886-mg4gb_072f89b6-8186-4b57-bfc9-a50ebfb7f852/telemeter-client/0.log" Jun 05 21:39:35.501860 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.501831 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9b8d8886-mg4gb_072f89b6-8186-4b57-bfc9-a50ebfb7f852/reload/0.log" Jun 05 21:39:35.526915 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:35.526888 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9b8d8886-mg4gb_072f89b6-8186-4b57-bfc9-a50ebfb7f852/kube-rbac-proxy/0.log" Jun 05 21:39:37.613679 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:37.613644 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/1.log" Jun 05 21:39:37.618728 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:37.618710 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hqs9b_b3bfebcd-6554-4d47-8bcb-e14aeb3c6c80/console-operator/2.log" Jun 05 21:39:38.194353 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.194330 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74b4cc887d-492hg_09aeb6d9-00e3-4d25-8d87-f00beac7f6c0/console/0.log" Jun 05 21:39:38.606307 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.606274 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6"] Jun 05 21:39:38.606768 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.606742 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb2d2e9-1421-448f-b728-4eb42686dbfd" containerName="cleanup" Jun 05 21:39:38.606768 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.606762 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb2d2e9-1421-448f-b728-4eb42686dbfd" containerName="cleanup" Jun 05 21:39:38.606959 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.606839 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb2d2e9-1421-448f-b728-4eb42686dbfd" containerName="cleanup" Jun 05 21:39:38.610105 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.610083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.612431 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.612405 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7h26\"/\"kube-root-ca.crt\"" Jun 05 21:39:38.613019 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.612998 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c7h26\"/\"openshift-service-ca.crt\"" Jun 05 21:39:38.613111 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.613031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c7h26\"/\"default-dockercfg-2dbv6\"" Jun 05 21:39:38.619812 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.619788 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6"] Jun 05 21:39:38.705083 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.705048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z7sk\" (UniqueName: \"kubernetes.io/projected/708b8dd8-7efe-45eb-9f2f-66009d880c19-kube-api-access-6z7sk\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.705288 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.705131 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-sys\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.705288 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.705171 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-podres\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.705288 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.705202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-lib-modules\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.705288 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.705241 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-proc\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806779 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-podres\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806779 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806787 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-lib-modules\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806988 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806906 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-proc\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806988 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-podres\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806988 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806913 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-lib-modules\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.806988 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.806942 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-proc\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.807121 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.807006 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z7sk\" (UniqueName: \"kubernetes.io/projected/708b8dd8-7efe-45eb-9f2f-66009d880c19-kube-api-access-6z7sk\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.807121 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.807071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-sys\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.807186 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.807148 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/708b8dd8-7efe-45eb-9f2f-66009d880c19-sys\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.816314 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.816286 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z7sk\" (UniqueName: \"kubernetes.io/projected/708b8dd8-7efe-45eb-9f2f-66009d880c19-kube-api-access-6z7sk\") pod \"perf-node-gather-daemonset-snqs6\" (UID: \"708b8dd8-7efe-45eb-9f2f-66009d880c19\") " pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:38.920647 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:38.920560 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:39.066550 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:39.066520 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6"] Jun 05 21:39:39.068356 ip-10-0-140-154 kubenswrapper[2555]: W0605 21:39:39.068329 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod708b8dd8_7efe_45eb_9f2f_66009d880c19.slice/crio-7df739c138cfeea64321943cab58c3551d56dec6634717260d3c66cf43ff0d4a WatchSource:0}: Error finding container 7df739c138cfeea64321943cab58c3551d56dec6634717260d3c66cf43ff0d4a: Status 404 returned error can't find the container with id 7df739c138cfeea64321943cab58c3551d56dec6634717260d3c66cf43ff0d4a Jun 05 21:39:39.136298 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:39.136268 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" event={"ID":"708b8dd8-7efe-45eb-9f2f-66009d880c19","Type":"ContainerStarted","Data":"7df739c138cfeea64321943cab58c3551d56dec6634717260d3c66cf43ff0d4a"} Jun 05 21:39:40.143719 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.143675 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" event={"ID":"708b8dd8-7efe-45eb-9f2f-66009d880c19","Type":"ContainerStarted","Data":"aeeb8e438822f891118321d6d14659cf01842fb18e23da423c52762dc4f62001"} Jun 05 21:39:40.144188 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.143812 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:40.158543 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.158476 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" podStartSLOduration=2.158461049 podStartE2EDuration="2.158461049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 21:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 21:39:40.157141708 +0000 UTC m=+2450.229402088" watchObservedRunningTime="2026-06-05 21:39:40.158461049 +0000 UTC m=+2450.230721454" Jun 05 21:39:40.220628 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.220599 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdssl_c2d43edf-459f-4860-8473-ec7f153e630d/dns/0.log" Jun 05 21:39:40.243759 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.243732 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vdssl_c2d43edf-459f-4860-8473-ec7f153e630d/kube-rbac-proxy/0.log" Jun 05 21:39:40.296311 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.296278 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lnp9x_db9cf996-815a-4eb9-a3b0-09b2e40b19e6/dns-node-resolver/0.log" Jun 05 21:39:40.930034 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:40.930004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhbrn_0e11ed0a-c6f3-43af-9cf5-4c2f0ab28a19/node-ca/0.log" Jun 05 21:39:41.957807 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:41.957777 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cxpj4_b1940227-370b-4155-b038-0cff8986f764/discovery/0.log" Jun 05 21:39:41.979123 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:41.979098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f86f755c4-hx5br_a5eb71d9-62ac-42be-b6d1-f39e137e8ccb/kube-auth-proxy/0.log" Jun 05 21:39:42.108489 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:42.108458 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pz5z4_8b16537e-c914-4fb8-b86b-bdfbe85caf4c/payload-pre-processing/0.log" Jun 05 21:39:42.198524 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:42.198491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:39:42.838772 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:42.838741 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8snp_71c59c52-b60d-4f4b-8f7d-5f922082670e/serve-healthcheck-canary/0.log" Jun 05 21:39:43.508131 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:43.508086 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7mdn_229d9f6c-d987-410d-9cb2-e6397839a641/kube-rbac-proxy/0.log" Jun 05 21:39:43.530646 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:43.530618 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7mdn_229d9f6c-d987-410d-9cb2-e6397839a641/exporter/0.log" Jun 05 21:39:43.554272 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:43.554249 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p7mdn_229d9f6c-d987-410d-9cb2-e6397839a641/extractor/0.log" Jun 05 21:39:45.909302 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:45.909276 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d4cdcb7d7-p8mvq_687609ad-a24d-49d7-aada-fb941c7966a9/nginx/0.log" Jun 05 21:39:45.935998 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:45.935974 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-c85q8_d57eda6e-956f-424b-9012-4bb22598983e/manager/0.log" Jun 05 21:39:46.018684 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.018658 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-r29n4_e1ee6d90-53eb-47f4-95bf-a9340777471a/manager/0.log" Jun 05 21:39:46.099875 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.099849 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29678250-lq995_6eb2d2e9-1421-448f-b728-4eb42686dbfd/cleanup/0.log" Jun 05 21:39:46.160544 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.160441 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c7h26/perf-node-gather-daemonset-snqs6" Jun 05 21:39:46.197972 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.197947 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-fbtgs_b57865e1-101f-42d2-ad64-65600ff613e0/server/0.log" Jun 05 21:39:46.250939 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.250908 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-2vrzz_4ebd71cd-1572-4113-b3f8-fa1d04a1de81/manager/0.log" Jun 05 21:39:46.473113 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.473025 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-t5wnq_e31d1e30-8b75-413a-bea1-b99d2d5fff03/manager/0.log" Jun 05 21:39:46.498441 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.498415 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d46cb5566-t5wnq_e31d1e30-8b75-413a-bea1-b99d2d5fff03/copy-manifests/0.log" Jun 05 21:39:46.526314 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:46.526288 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p6h99_da4317d4-7014-47d6-99f9-5e1fdb5dc788/postgres/0.log" Jun 05 21:39:48.323465 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:48.323437 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-x2tz2_72001704-6af7-4532-8ce5-9f8db54cb88f/openshift-lws-operator/0.log" Jun 05 21:39:52.196705 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:52.196668 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cxpj4_b1940227-370b-4155-b038-0cff8986f764/discovery/0.log" Jun 05 21:39:52.206982 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:52.206949 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f86f755c4-hx5br_a5eb71d9-62ac-42be-b6d1-f39e137e8ccb/kube-auth-proxy/0.log" Jun 05 21:39:52.312711 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:52.312678 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pz5z4_8b16537e-c914-4fb8-b86b-bdfbe85caf4c/payload-pre-processing/0.log" Jun 05 21:39:52.382473 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:52.382435 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:39:53.663884 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.663854 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cxpj4_b1940227-370b-4155-b038-0cff8986f764/discovery/0.log" Jun 05 21:39:53.679225 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.679200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f86f755c4-hx5br_a5eb71d9-62ac-42be-b6d1-f39e137e8ccb/kube-auth-proxy/0.log" Jun 05 21:39:53.708616 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.708590 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-6wgfp_a6c98110-dd0e-4189-8b1d-69a88453d09f/migrator/0.log" Jun 05 21:39:53.733020 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.732983 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-6wgfp_a6c98110-dd0e-4189-8b1d-69a88453d09f/graceful-termination/0.log" Jun 05 21:39:53.778343 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.778312 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pz5z4_8b16537e-c914-4fb8-b86b-bdfbe85caf4c/payload-pre-processing/0.log" Jun 05 21:39:53.844602 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:53.844574 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:39:55.321637 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.321609 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/kube-multus-additional-cni-plugins/0.log" Jun 05 21:39:55.346690 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.346660 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/egress-router-binary-copy/0.log" Jun 05 21:39:55.372631 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.372607 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/cni-plugins/0.log" Jun 05 21:39:55.395770 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.395745 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/bond-cni-plugin/0.log" Jun 05 21:39:55.420138 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.420112 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/routeoverride-cni/0.log" Jun 05 21:39:55.444112 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.444088 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/whereabouts-cni-bincopy/0.log" Jun 05 21:39:55.468236 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.468211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-478zd_b0b33df5-d88f-49aa-a45b-829c76b39db8/whereabouts-cni/0.log" Jun 05 21:39:55.537807 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.537774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-cxpj4_b1940227-370b-4155-b038-0cff8986f764/discovery/0.log" Jun 05 21:39:55.547956 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.547928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f86f755c4-hx5br_a5eb71d9-62ac-42be-b6d1-f39e137e8ccb/kube-auth-proxy/0.log" Jun 05 21:39:55.645807 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.645717 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-pz5z4_8b16537e-c914-4fb8-b86b-bdfbe85caf4c/payload-pre-processing/0.log" Jun 05 21:39:55.708772 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.708749 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd848c65f-t5v2k_ac8c3381-c2cd-4858-a125-9e5ae5905b55/router/0.log" Jun 05 21:39:55.870740 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:55.870708 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t5k52_3f9af940-ea64-4ad7-845c-22aa9276b4a3/kube-multus/0.log" Jun 05 21:39:56.017439 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:56.017363 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xr8q4_5520ee00-2d7d-4b09-bc08-6ac993d146e5/network-metrics-daemon/0.log" Jun 05 21:39:56.039374 ip-10-0-140-154 kubenswrapper[2555]: I0605 21:39:56.039344 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xr8q4_5520ee00-2d7d-4b09-bc08-6ac993d146e5/kube-rbac-proxy/0.log"