Apr 17 18:07:19.998319 ip-10-0-139-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Apr 17 18:07:19.998331 ip-10-0-139-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Apr 17 18:07:19.998340 ip-10-0-139-47 systemd[1]: kubelet.service: Failed with result 'resources'. Apr 17 18:07:19.998541 ip-10-0-139-47 systemd[1]: Failed to start Kubernetes Kubelet. Apr 17 18:07:30.217826 ip-10-0-139-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Apr 17 18:07:30.217842 ip-10-0-139-47 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot cfe710031029483790e0174a44533101 -- Apr 17 18:10:07.539898 ip-10-0-139-47 systemd[1]: Starting Kubernetes Kubelet... Apr 17 18:10:08.030610 ip-10-0-139-47 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 18:10:08.030610 ip-10-0-139-47 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 17 18:10:08.030610 ip-10-0-139-47 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 18:10:08.030610 ip-10-0-139-47 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 17 18:10:08.030610 ip-10-0-139-47 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 18:10:08.034670 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.034574 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 17 18:10:08.039289 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039275 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 18:10:08.039289 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039290 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039293 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039296 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039299 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039302 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039305 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039307 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039310 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039313 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039317 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039320 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039323 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039326 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039329 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039333 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039336 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039338 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039341 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039344 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039347 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 18:10:08.039355 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039349 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039351 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039354 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039357 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039359 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039362 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039365 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039368 2574 feature_gate.go:328] unrecognized feature gate: Example Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039370 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039373 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039376 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039378 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039380 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039383 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039385 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039389 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039391 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039395 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039397 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039400 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039402 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 18:10:08.039864 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039405 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039407 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039409 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039411 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039414 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039417 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039420 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039423 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039425 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039429 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039432 2574 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039435 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039438 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039441 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039444 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039447 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039449 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039452 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039456 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 18:10:08.040352 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039459 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039461 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039464 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039466 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039469 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039471 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039474 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039476 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039479 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039481 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039484 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039486 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039488 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039491 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039493 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039495 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039498 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039500 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039503 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 18:10:08.040810 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039506 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039509 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039511 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039515 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039518 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039521 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039900 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039906 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039909 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039912 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039914 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039917 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039919 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039922 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039924 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039927 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039929 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039932 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039936 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 18:10:08.041267 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039940 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039942 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039945 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039948 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039950 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039953 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039955 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039957 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039960 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039962 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039965 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039968 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039971 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039974 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039976 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039979 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039981 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039983 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039986 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 18:10:08.041785 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039989 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039992 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039994 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039997 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.039999 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040001 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040004 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040006 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040009 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040011 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040013 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040016 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040019 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040021 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040024 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040026 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040029 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040031 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040034 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040038 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 18:10:08.042479 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040041 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040043 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040046 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040049 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040051 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040053 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040055 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040058 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040061 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040063 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040066 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040068 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040070 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040073 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040075 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040077 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040080 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040082 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040085 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040087 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 18:10:08.042986 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040089 2574 feature_gate.go:328] unrecognized feature gate: Example Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040092 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040094 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040097 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040099 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040102 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040106 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040109 2574 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040113 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040115 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040118 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040120 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040123 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.040126 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040963 2574 flags.go:64] FLAG: --address="0.0.0.0" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040972 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040978 2574 flags.go:64] FLAG: --anonymous-auth="true" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040983 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040987 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040990 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040995 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 17 18:10:08.043624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.040999 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041002 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041005 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041008 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041011 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041014 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041017 2574 flags.go:64] FLAG: --cgroup-root="" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041020 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041036 2574 flags.go:64] FLAG: --client-ca-file="" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041040 2574 flags.go:64] FLAG: --cloud-config="" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041043 2574 flags.go:64] FLAG: --cloud-provider="external" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041046 2574 flags.go:64] FLAG: --cluster-dns="[]" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041050 2574 flags.go:64] FLAG: --cluster-domain="" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041053 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041056 2574 flags.go:64] FLAG: --config-dir="" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041062 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041065 2574 flags.go:64] FLAG: --container-log-max-files="5" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041069 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041072 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041075 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041078 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041081 2574 flags.go:64] FLAG: --contention-profiling="false" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041083 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041086 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041089 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 17 18:10:08.044286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041092 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041096 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041099 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041102 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041104 2574 flags.go:64] FLAG: --enable-load-reader="false" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041107 2574 flags.go:64] FLAG: --enable-server="true" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041110 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041115 2574 flags.go:64] FLAG: --event-burst="100" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041118 2574 flags.go:64] FLAG: --event-qps="50" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041121 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041124 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041127 2574 flags.go:64] FLAG: --eviction-hard="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041130 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041134 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041136 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041139 2574 flags.go:64] FLAG: --eviction-soft="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041142 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041145 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041148 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041151 2574 flags.go:64] FLAG: --experimental-mounter-path="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041153 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041156 2574 flags.go:64] FLAG: --fail-swap-on="true" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041160 2574 flags.go:64] FLAG: --feature-gates="" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041164 2574 flags.go:64] FLAG: --file-check-frequency="20s" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041166 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 17 18:10:08.044959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041169 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041172 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041175 2574 flags.go:64] FLAG: --healthz-port="10248" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041178 2574 flags.go:64] FLAG: --help="false" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041181 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041184 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041187 2574 flags.go:64] FLAG: --http-check-frequency="20s" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041189 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041193 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041196 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041198 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041201 2574 flags.go:64] FLAG: --image-service-endpoint="" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041204 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041206 2574 flags.go:64] FLAG: --kube-api-burst="100" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041209 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041213 2574 flags.go:64] FLAG: --kube-api-qps="50" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041215 2574 flags.go:64] FLAG: --kube-reserved="" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041218 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041221 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041224 2574 flags.go:64] FLAG: --kubelet-cgroups="" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041228 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041231 2574 flags.go:64] FLAG: --lock-file="" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041233 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041236 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 17 18:10:08.045560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041239 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041244 2574 flags.go:64] FLAG: --log-json-split-stream="false" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041247 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041250 2574 flags.go:64] FLAG: --log-text-split-stream="false" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041252 2574 flags.go:64] FLAG: --logging-format="text" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041256 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041260 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041263 2574 flags.go:64] FLAG: --manifest-url="" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041266 2574 flags.go:64] FLAG: --manifest-url-header="" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041271 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041274 2574 flags.go:64] FLAG: --max-open-files="1000000" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041278 2574 flags.go:64] FLAG: --max-pods="110" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041281 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041284 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041287 2574 flags.go:64] FLAG: --memory-manager-policy="None" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041290 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041293 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041295 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041298 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041308 2574 flags.go:64] FLAG: --node-status-max-images="50" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041311 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041314 2574 flags.go:64] FLAG: --oom-score-adj="-999" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041317 2574 flags.go:64] FLAG: --pod-cidr="" Apr 17 18:10:08.046176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041319 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041325 2574 flags.go:64] FLAG: --pod-manifest-path="" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041328 2574 flags.go:64] FLAG: --pod-max-pids="-1" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041331 2574 flags.go:64] FLAG: --pods-per-core="0" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041334 2574 flags.go:64] FLAG: --port="10250" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041338 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041341 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8253453997b1ba5" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041344 2574 flags.go:64] FLAG: --qos-reserved="" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041347 2574 flags.go:64] FLAG: --read-only-port="10255" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041350 2574 flags.go:64] FLAG: --register-node="true" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041352 2574 flags.go:64] FLAG: --register-schedulable="true" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041355 2574 flags.go:64] FLAG: --register-with-taints="" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041359 2574 flags.go:64] FLAG: --registry-burst="10" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041362 2574 flags.go:64] FLAG: --registry-qps="5" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041364 2574 flags.go:64] FLAG: --reserved-cpus="" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041368 2574 flags.go:64] FLAG: --reserved-memory="" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041372 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041374 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041377 2574 flags.go:64] FLAG: --rotate-certificates="false" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041380 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041383 2574 flags.go:64] FLAG: --runonce="false" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041386 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041389 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041392 2574 flags.go:64] FLAG: --seccomp-default="false" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041395 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041397 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 17 18:10:08.046801 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041400 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041403 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041406 2574 flags.go:64] FLAG: --storage-driver-password="root" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041409 2574 flags.go:64] FLAG: --storage-driver-secure="false" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041411 2574 flags.go:64] FLAG: --storage-driver-table="stats" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041414 2574 flags.go:64] FLAG: --storage-driver-user="root" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041416 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041419 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041422 2574 flags.go:64] FLAG: --system-cgroups="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041425 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041431 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041438 2574 flags.go:64] FLAG: --tls-cert-file="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041441 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041444 2574 flags.go:64] FLAG: --tls-min-version="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041447 2574 flags.go:64] FLAG: --tls-private-key-file="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041450 2574 flags.go:64] FLAG: --topology-manager-policy="none" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041452 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041455 2574 flags.go:64] FLAG: --topology-manager-scope="container" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041458 2574 flags.go:64] FLAG: --v="2" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041462 2574 flags.go:64] FLAG: --version="false" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041465 2574 flags.go:64] FLAG: --vmodule="" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041471 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.041474 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041872 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041884 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 18:10:08.047434 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041890 2574 feature_gate.go:328] unrecognized feature gate: Example Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041896 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041900 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041905 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041909 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041915 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041919 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041923 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041927 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041931 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041941 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041946 2574 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041950 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041954 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041958 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041962 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041967 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041972 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041979 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 18:10:08.048024 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041985 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041989 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041994 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.041998 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042007 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042013 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042017 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042021 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042025 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042030 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042033 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042037 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042042 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042046 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042050 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042054 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042063 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042067 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042072 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042076 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 18:10:08.048515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042080 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042084 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042088 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042092 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042096 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042100 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042104 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042108 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042112 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042121 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042125 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042129 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042133 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042137 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042141 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042145 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042149 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042154 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042158 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042162 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 18:10:08.049021 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042168 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042180 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042184 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042188 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042193 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042197 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042201 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042205 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042211 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042215 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042220 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042223 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042228 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042232 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042241 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042245 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042249 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042253 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042257 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042261 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 18:10:08.049552 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042298 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 18:10:08.050048 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042304 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 18:10:08.050048 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042308 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 18:10:08.050048 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042314 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 18:10:08.050048 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.042319 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 18:10:08.050048 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.043010 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 18:10:08.051497 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.051477 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 17 18:10:08.051535 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.051498 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051545 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051550 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051553 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051556 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051559 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 18:10:08.051562 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051562 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051565 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051568 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051570 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051575 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051579 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051582 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051585 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051588 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051590 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051593 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051596 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051599 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051602 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051605 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051609 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051611 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051614 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051616 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 18:10:08.051730 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051619 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051621 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051624 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051639 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051642 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051644 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051647 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051649 2574 feature_gate.go:328] unrecognized feature gate: Example Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051652 2574 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051655 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051657 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051660 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051662 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051665 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051667 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051671 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051674 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051676 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051679 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051681 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 18:10:08.052191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051685 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051689 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051692 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051695 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051698 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051701 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051703 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051706 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051708 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051711 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051714 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051716 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051718 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051721 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051724 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051726 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051729 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051731 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051734 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051736 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 18:10:08.052710 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051739 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051741 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051744 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051746 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051749 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051751 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051754 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051757 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051760 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051763 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051765 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051768 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051771 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051773 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051776 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051778 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051781 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051783 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051786 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051788 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 18:10:08.053187 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051791 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051793 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.051798 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051893 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051897 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051900 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051903 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051906 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051908 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051911 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051914 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051917 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051919 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051922 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051925 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051927 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 18:10:08.053701 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051930 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051932 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051948 2574 feature_gate.go:328] unrecognized feature gate: Example Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051952 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051956 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051959 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051962 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051965 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051968 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051970 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051973 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051976 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051978 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051981 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051984 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051986 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051988 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051991 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051993 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051996 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 18:10:08.054090 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.051998 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052000 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052003 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052005 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052009 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052013 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052015 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052018 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052021 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052024 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052027 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052029 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052032 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052034 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052038 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052041 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052044 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052047 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052049 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 18:10:08.054559 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052052 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052054 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052057 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052059 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052062 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052064 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052067 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052069 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052071 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052074 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052076 2574 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052079 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052081 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052083 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052086 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052088 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052091 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052093 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052096 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052098 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 18:10:08.055020 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052101 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052103 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052106 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052108 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052111 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052113 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052115 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052117 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052120 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052123 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052125 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052128 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052130 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:08.052132 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.052137 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 18:10:08.055484 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.053882 2574 server.go:962] "Client rotation is on, will bootstrap in background" Apr 17 18:10:08.056785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.056771 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 17 18:10:08.057826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.057815 2574 server.go:1019] "Starting client certificate rotation" Apr 17 18:10:08.057928 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.057915 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 18:10:08.057962 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.057945 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 18:10:08.090904 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.090885 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 18:10:08.095898 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.095874 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 18:10:08.117797 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.117770 2574 log.go:25] "Validated CRI v1 runtime API" Apr 17 18:10:08.118570 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.118553 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 18:10:08.123531 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.123518 2574 log.go:25] "Validated CRI v1 image API" Apr 17 18:10:08.125019 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.125003 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 17 18:10:08.129215 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.129197 2574 fs.go:135] Filesystem UUIDs: map[27e23654-f415-484c-ba64-1ec3123e3bee:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7f78a068-7510-4dda-af7f-4d610aab849e:/dev/nvme0n1p3] Apr 17 18:10:08.129287 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.129213 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 17 18:10:08.133905 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.133886 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7htrk" Apr 17 18:10:08.135537 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.135436 2574 manager.go:217] Machine: {Timestamp:2026-04-17 18:10:08.133456454 +0000 UTC m=+0.468956405 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202591 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec250d8a41f51b2afbbf95527aa78cf7 SystemUUID:ec250d8a-41f5-1b2a-fbbf-95527aa78cf7 BootID:cfe71003-1029-4837-90e0-174a44533101 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:de:f4:37:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:de:f4:37:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:e2:fa:f8:3d:90 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 17 18:10:08.135537 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.135534 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 17 18:10:08.135650 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.135600 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 17 18:10:08.136672 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.136649 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 17 18:10:08.136793 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.136674 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 17 18:10:08.136832 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.136798 2574 topology_manager.go:138] "Creating topology manager with none policy" Apr 17 18:10:08.136832 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.136806 2574 container_manager_linux.go:306] "Creating device plugin manager" Apr 17 18:10:08.136832 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.136820 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 18:10:08.137747 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.137737 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 18:10:08.138664 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.138655 2574 state_mem.go:36] "Initialized new in-memory state store" Apr 17 18:10:08.138766 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.138758 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 17 18:10:08.141570 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141557 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7htrk" Apr 17 18:10:08.141697 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141686 2574 kubelet.go:491] "Attempting to sync node with API server" Apr 17 18:10:08.141730 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141700 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 17 18:10:08.141730 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141712 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 17 18:10:08.141730 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141721 2574 kubelet.go:397] "Adding apiserver pod source" Apr 17 18:10:08.141863 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.141732 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 17 18:10:08.142953 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.142935 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 18:10:08.143038 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.142962 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 18:10:08.146771 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.146756 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 17 18:10:08.148813 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.148799 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 17 18:10:08.151391 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151378 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151411 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151420 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151427 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151436 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151443 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151453 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151458 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 17 18:10:08.151464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151464 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 17 18:10:08.151683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151471 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 17 18:10:08.151683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151485 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 17 18:10:08.151683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.151528 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 17 18:10:08.152456 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.152444 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 17 18:10:08.152518 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.152472 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 17 18:10:08.152854 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.152829 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:08.155261 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.155239 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:08.157237 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.157224 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 17 18:10:08.157302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.157296 2574 server.go:1295] "Started kubelet" Apr 17 18:10:08.157417 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.157372 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 17 18:10:08.157463 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.157434 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 17 18:10:08.157514 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.157479 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 17 18:10:08.157911 ip-10-0-139-47 systemd[1]: Started Kubernetes Kubelet. Apr 17 18:10:08.158428 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.158391 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-47.ec2.internal" not found Apr 17 18:10:08.159479 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.159465 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 17 18:10:08.160966 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.160954 2574 server.go:317] "Adding debug handlers to kubelet server" Apr 17 18:10:08.165905 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.165878 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 17 18:10:08.166720 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.166701 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 17 18:10:08.167120 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.167099 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 17 18:10:08.167807 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.167789 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 17 18:10:08.167807 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.167790 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 17 18:10:08.167959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.167823 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 17 18:10:08.167959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.167897 2574 reconstruct.go:97] "Volume reconstruction finished" Apr 17 18:10:08.167959 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.167903 2574 reconciler.go:26] "Reconciler: start to sync state" Apr 17 18:10:08.168098 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.168084 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found" Apr 17 18:10:08.168664 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168648 2574 factory.go:55] Registering systemd factory Apr 17 18:10:08.168752 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168673 2574 factory.go:223] Registration of the systemd container factory successfully Apr 17 18:10:08.168752 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168708 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:08.168903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168885 2574 factory.go:153] Registering CRI-O factory Apr 17 18:10:08.168903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168902 2574 factory.go:223] Registration of the crio container factory successfully Apr 17 18:10:08.168993 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168956 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 17 18:10:08.168993 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168974 2574 factory.go:103] Registering Raw factory Apr 17 18:10:08.168993 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.168989 2574 manager.go:1196] Started watching for new ooms in manager Apr 17 18:10:08.169428 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.169418 2574 manager.go:319] Starting recovery of all containers Apr 17 18:10:08.171472 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.171453 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-47.ec2.internal\" not found" node="ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.175754 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.175733 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-47.ec2.internal" not found Apr 17 18:10:08.179580 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.179567 2574 manager.go:324] Recovery completed Apr 17 18:10:08.180837 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.180821 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Apr 17 18:10:08.184779 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.184767 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 18:10:08.186812 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.186795 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory" Apr 17 18:10:08.186885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.186827 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 18:10:08.186885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.186838 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID" Apr 17 18:10:08.187302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.187289 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 17 18:10:08.187302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.187300 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 17 18:10:08.187419 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.187315 2574 state_mem.go:36] "Initialized new in-memory state store" Apr 17 18:10:08.190004 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.189992 2574 policy_none.go:49] "None policy: Start" Apr 17 18:10:08.190040 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.190007 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 17 18:10:08.190040 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.190017 2574 state_mem.go:35] "Initializing new in-memory state store" Apr 17 18:10:08.235957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.235944 2574 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-139-47.ec2.internal" not found Apr 17 18:10:08.239189 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239178 2574 manager.go:341] "Starting Device Plugin manager" Apr 17 18:10:08.239238 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.239203 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 17 18:10:08.239238 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239212 2574 server.go:85] "Starting device plugin registration server" Apr 17 18:10:08.239427 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239412 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 17 18:10:08.239513 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239427 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 17 18:10:08.239570 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239520 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 17 18:10:08.239623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239603 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 17 18:10:08.239623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.239612 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 17 18:10:08.240107 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.240088 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 17 18:10:08.240191 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.240125 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-47.ec2.internal\" not found" Apr 17 18:10:08.291777 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.291722 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 17 18:10:08.292864 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.292842 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 17 18:10:08.292957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.292873 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 17 18:10:08.292957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.292889 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 17 18:10:08.292957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.292895 2574 kubelet.go:2451] "Starting kubelet main sync loop" Apr 17 18:10:08.292957 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:08.292945 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 17 18:10:08.297218 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.297202 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:08.339824 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.339808 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 18:10:08.340509 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.340495 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory" Apr 17 18:10:08.340576 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.340520 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 18:10:08.340576 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.340532 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID" Apr 17 18:10:08.340576 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.340557 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.347117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.347103 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.393941 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.393920 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"] Apr 17 18:10:08.396172 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.396156 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.396254 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.396159 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.411118 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.411103 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.415339 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.415325 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.423040 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.423026 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 18:10:08.425184 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.425170 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 18:10:08.470143 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.470124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.470228 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.470147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.470228 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.470164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a103039f5ca79ac6a4c1f769b0a80c09-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"a103039f5ca79ac6a4c1f769b0a80c09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571172 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571121 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a103039f5ca79ac6a4c1f769b0a80c09-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"a103039f5ca79ac6a4c1f769b0a80c09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571172 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571155 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571179 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd5586df870f9c05e0b79498a03c47e3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"bd5586df870f9c05e0b79498a03c47e3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.571304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.571283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a103039f5ca79ac6a4c1f769b0a80c09-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"a103039f5ca79ac6a4c1f769b0a80c09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.726344 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.726317 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" Apr 17 18:10:08.727378 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:08.727366 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" Apr 17 18:10:09.058773 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.058748 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 17 18:10:09.059384 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.058848 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 18:10:09.059384 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.058894 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 18:10:09.059384 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.058915 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 18:10:09.141978 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.141962 2574 apiserver.go:52] "Watching apiserver" Apr 17 18:10:09.143069 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.143042 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-16 18:05:08 +0000 UTC" deadline="2027-11-08 10:04:29.620443752 +0000 UTC" Apr 17 18:10:09.143069 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.143066 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13671h54m20.477379413s" Apr 17 18:10:09.151176 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.151160 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 17 18:10:09.152200 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.152182 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-ptfqc","openshift-network-operator/iptables-alerter-6ql96","openshift-dns/node-resolver-2mxld","openshift-image-registry/node-ca-6sq4b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal","openshift-multus/network-metrics-daemon-snrz7","openshift-network-diagnostics/network-check-target-f529d","openshift-ovn-kubernetes/ovnkube-node-sk45l","kube-system/konnectivity-agent-zmkjn","kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt","openshift-cluster-node-tuning-operator/tuned-dhqmw","openshift-multus/multus-75gtp"] Apr 17 18:10:09.154835 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.154811 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.155842 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.155820 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.155930 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.155894 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.157032 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.157012 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.157128 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.157111 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.158199 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.158180 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.158462 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.158781 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.158863 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159005 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159114 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.159536 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159210 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 17 18:10:09.159894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159711 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.159952 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159889 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 17 18:10:09.160007 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.159961 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.160056 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160008 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.161280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160427 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 17 18:10:09.161280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160459 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7rnz\"" Apr 17 18:10:09.161280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160471 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sk7kv\"" Apr 17 18:10:09.161280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160518 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k5lpw\"" Apr 17 18:10:09.161280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.160977 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qd9lw\"" Apr 17 18:10:09.161593 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.161354 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.161593 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.161406 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.161992 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.161976 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:09.162080 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.162047 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:09.163973 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.163957 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.165977 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.165953 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 17 18:10:09.166493 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.166324 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 17 18:10:09.166855 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.166836 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.167117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167017 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 17 18:10:09.167117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167020 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 17 18:10:09.167117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167068 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 17 18:10:09.167545 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167320 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lnzgm\"" Apr 17 18:10:09.167545 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167368 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.167739 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167723 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.167864 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.167845 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.169327 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.169311 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.169953 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.169938 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 17 18:10:09.170178 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170166 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zm7fs\"" Apr 17 18:10:09.170245 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170217 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.170326 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170311 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 17 18:10:09.170378 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170332 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 17 18:10:09.170378 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170334 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kjkrk\"" Apr 17 18:10:09.170378 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.170346 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.171030 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.171015 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.171703 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.171608 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 17 18:10:09.171703 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.171672 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7jk2w\"" Apr 17 18:10:09.171811 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.171726 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 17 18:10:09.173293 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.173278 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d2h25\"" Apr 17 18:10:09.173385 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.173303 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 17 18:10:09.174815 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovn-node-metrics-cert\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.174901 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.174901 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-run\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.174901 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7gt5\" (UniqueName: \"kubernetes.io/projected/859128d1-b8f5-4792-b699-05e8bc2cef37-kube-api-access-c7gt5\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.174901 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-device-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.175090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqrp\" (UniqueName: \"kubernetes.io/projected/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kube-api-access-8jqrp\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.175090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9e76ee-0f23-4da8-ac35-76f4927ab685-host-slash\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.175090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.174983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-config\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-env-overrides\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d00a606-a143-4c76-9411-c88c0cded84f-agent-certs\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysconfig\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-conf\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd121bc-4898-442f-bbbb-e673a5c42e8d-hosts-file\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd121bc-4898-442f-bbbb-e673a5c42e8d-tmp-dir\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.175283 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-system-cni-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d00a606-a143-4c76-9411-c88c0cded84f-konnectivity-ca\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-systemd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-bin\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtl6v\" (UniqueName: \"kubernetes.io/projected/cc9e76ee-0f23-4da8-ac35-76f4927ab685-kube-api-access-jtl6v\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f583aa9-f0c5-4df6-baa8-1e00e0442078-serviceca\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-slash\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29k2h\" (UniqueName: \"kubernetes.io/projected/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-kube-api-access-29k2h\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.175605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-os-release\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.176028 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkd7g\" (UniqueName: \"kubernetes.io/projected/4b57a1dd-f9f2-4315-889b-19e7f4b51454-kube-api-access-rkd7g\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.176028 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-lib-modules\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176028 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-etc-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176028 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.175749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-systemd\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176245 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176222 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-var-lib-kubelet\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176321 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-node-log\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176321 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-log-socket\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176321 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cnibin\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.176457 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-host\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176457 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc9e76ee-0f23-4da8-ac35-76f4927ab685-iptables-alerter-script\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.176457 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176415 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.176457 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnp8k\" (UniqueName: \"kubernetes.io/projected/f716dbf1-bcde-4892-b9da-62d55e29f521-kube-api-access-bnp8k\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-systemd-units\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-netd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.176600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-tmp\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f583aa9-f0c5-4df6-baa8-1e00e0442078-host\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjjjw\" (UniqueName: \"kubernetes.io/projected/3f583aa9-f0c5-4df6-baa8-1e00e0442078-kube-api-access-rjjjw\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-kubernetes\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-sys\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-kubelet\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-netns\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.176870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-modprobe-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-script-lib\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-var-lib-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176939 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-tuned\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.176985 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.177022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.177056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmql6\" (UniqueName: \"kubernetes.io/projected/7bd121bc-4898-442f-bbbb-e673a5c42e8d-kube-api-access-qmql6\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.177268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.177083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-ovn\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.177999 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.177981 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 18:10:09.197903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.197886 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdcr5" Apr 17 18:10:09.207393 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.207373 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdcr5" Apr 17 18:10:09.268195 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.268180 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 17 18:10:09.273719 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.273682 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5586df870f9c05e0b79498a03c47e3.slice/crio-1c08cc6b3c8402868bd6a108d36b3f6ddb477932f5cf40e0e1b803719d4a661b WatchSource:0}: Error finding container 1c08cc6b3c8402868bd6a108d36b3f6ddb477932f5cf40e0e1b803719d4a661b: Status 404 returned error can't find the container with id 1c08cc6b3c8402868bd6a108d36b3f6ddb477932f5cf40e0e1b803719d4a661b Apr 17 18:10:09.273947 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.273927 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda103039f5ca79ac6a4c1f769b0a80c09.slice/crio-ec45b7cc42c1cdcc61b40558f7c657ea22cb07f8075a360830d40019716dc0e3 WatchSource:0}: Error finding container ec45b7cc42c1cdcc61b40558f7c657ea22cb07f8075a360830d40019716dc0e3: Status 404 returned error can't find the container with id ec45b7cc42c1cdcc61b40558f7c657ea22cb07f8075a360830d40019716dc0e3 Apr 17 18:10:09.277277 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277260 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtl6v\" (UniqueName: \"kubernetes.io/projected/cc9e76ee-0f23-4da8-ac35-76f4927ab685-kube-api-access-jtl6v\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.277364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277283 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f583aa9-f0c5-4df6-baa8-1e00e0442078-serviceca\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.277364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277299 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-slash\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.277364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277313 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29k2h\" (UniqueName: \"kubernetes.io/projected/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-kube-api-access-29k2h\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.277364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277344 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-os-release\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.277548 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-slash\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.277548 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-os-release\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.277548 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277452 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkd7g\" (UniqueName: \"kubernetes.io/projected/4b57a1dd-f9f2-4315-889b-19e7f4b51454-kube-api-access-rkd7g\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.277758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-etc-kubernetes\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.277758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277659 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-lib-modules\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.277758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-etc-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.277758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f583aa9-f0c5-4df6-baa8-1e00e0442078-serviceca\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.277758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-netns\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-etc-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277799 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-daemon-config\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-lib-modules\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277829 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-systemd\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277855 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-var-lib-kubelet\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277870 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-systemd\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-node-log\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-log-socket\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-var-lib-kubelet\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277921 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cnibin\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-hostroot\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-node-log\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-log-socket\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cnibin\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.277970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-multus-certs\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64csn\" (UniqueName: \"kubernetes.io/projected/1b354b11-c37f-439d-876a-c2b9ba90c04a-kube-api-access-64csn\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-host\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278077 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc9e76ee-0f23-4da8-ac35-76f4927ab685-iptables-alerter-script\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-host\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278137 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278161 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278183 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278206 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bnp8k\" (UniqueName: \"kubernetes.io/projected/f716dbf1-bcde-4892-b9da-62d55e29f521-kube-api-access-bnp8k\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278231 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-systemd-units\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278262 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-netd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278290 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-cni-binary-copy\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278347 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-socket-dir-parent\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-netd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278374 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-tmp\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278397 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f583aa9-f0c5-4df6-baa8-1e00e0442078-host\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278418 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjjjw\" (UniqueName: \"kubernetes.io/projected/3f583aa9-f0c5-4df6-baa8-1e00e0442078-kube-api-access-rjjjw\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.278820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278440 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278466 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-socket-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278494 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-conf-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278520 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-kubernetes\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278554 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-sys\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278596 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-kubelet\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278621 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-netns\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278670 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278715 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc9e76ee-0f23-4da8-ac35-76f4927ab685-iptables-alerter-script\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.278791 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-systemd-units\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278743 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-bin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-kubernetes\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.278852 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:09.778832641 +0000 UTC m=+2.114332594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:09.279603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-sys\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-kubelet\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279017 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-netns\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-run-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279187 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f583aa9-f0c5-4df6-baa8-1e00e0442078-host\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279235 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279292 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-modprobe-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279324 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-script-lib\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-system-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-k8s-cni-cncf-io\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279400 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-var-lib-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.278790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-kubelet\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279487 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-tuned\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279511 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279533 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.280266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279555 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmql6\" (UniqueName: \"kubernetes.io/projected/7bd121bc-4898-442f-bbbb-e673a5c42e8d-kube-api-access-qmql6\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-binary-copy\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279600 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-ovn\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279624 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovn-node-metrics-cert\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279667 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279689 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-run\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279712 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7gt5\" (UniqueName: \"kubernetes.io/projected/859128d1-b8f5-4792-b699-05e8bc2cef37-kube-api-access-c7gt5\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-run\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-cnibin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-ovn\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-script-lib\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280041 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-var-lib-openvswitch\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-registration-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280111 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-modprobe-d\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-multus\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.281141 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280266 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-device-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280293 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqrp\" (UniqueName: \"kubernetes.io/projected/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kube-api-access-8jqrp\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280335 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9e76ee-0f23-4da8-ac35-76f4927ab685-host-slash\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280360 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-config\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280384 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-env-overrides\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280409 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280449 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d00a606-a143-4c76-9411-c88c0cded84f-agent-certs\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysconfig\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280563 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-conf\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.279254 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-sys-fs\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280588 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd121bc-4898-442f-bbbb-e673a5c42e8d-hosts-file\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc9e76ee-0f23-4da8-ac35-76f4927ab685-host-slash\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysconfig\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280760 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd121bc-4898-442f-bbbb-e673a5c42e8d-tmp-dir\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-device-dir\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.281894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-sysctl-conf\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280910 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-system-cni-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-os-release\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280976 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d00a606-a143-4c76-9411-c88c0cded84f-konnectivity-ca\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.280999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bd121bc-4898-442f-bbbb-e673a5c42e8d-tmp-dir\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281015 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-systemd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281041 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-bin\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281066 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-env-overrides\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7bd121bc-4898-442f-bbbb-e673a5c42e8d-hosts-file\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281275 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-run-systemd\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b57a1dd-f9f2-4315-889b-19e7f4b51454-system-cni-dir\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-host-cni-bin\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b57a1dd-f9f2-4315-889b-19e7f4b51454-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-etc-selinux\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.282590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.281617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d00a606-a143-4c76-9411-c88c0cded84f-konnectivity-ca\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.283284 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.282689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovnkube-config\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.283725 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.283530 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-tmp\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.283725 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.283569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/859128d1-b8f5-4792-b699-05e8bc2cef37-etc-tuned\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.283916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.283856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-ovn-node-metrics-cert\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.284070 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.284050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d00a606-a143-4c76-9411-c88c0cded84f-agent-certs\") pod \"konnectivity-agent-zmkjn\" (UID: \"9d00a606-a143-4c76-9411-c88c0cded84f\") " pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.285728 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.285560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29k2h\" (UniqueName: \"kubernetes.io/projected/90cffb2f-3b60-4f42-b9c0-a8a1b430bdff-kube-api-access-29k2h\") pod \"ovnkube-node-sk45l\" (UID: \"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff\") " pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.285728 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.285703 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:09.285728 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.285719 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:09.285728 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.285730 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:09.285944 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.285784 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:09.785767427 +0000 UTC m=+2.121267376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:09.285944 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.285920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkd7g\" (UniqueName: \"kubernetes.io/projected/4b57a1dd-f9f2-4315-889b-19e7f4b51454-kube-api-access-rkd7g\") pod \"multus-additional-cni-plugins-ptfqc\" (UID: \"4b57a1dd-f9f2-4315-889b-19e7f4b51454\") " pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.286443 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.286417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtl6v\" (UniqueName: \"kubernetes.io/projected/cc9e76ee-0f23-4da8-ac35-76f4927ab685-kube-api-access-jtl6v\") pod \"iptables-alerter-6ql96\" (UID: \"cc9e76ee-0f23-4da8-ac35-76f4927ab685\") " pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.287812 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.287789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjjjw\" (UniqueName: \"kubernetes.io/projected/3f583aa9-f0c5-4df6-baa8-1e00e0442078-kube-api-access-rjjjw\") pod \"node-ca-6sq4b\" (UID: \"3f583aa9-f0c5-4df6-baa8-1e00e0442078\") " pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.288270 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.288250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7gt5\" (UniqueName: \"kubernetes.io/projected/859128d1-b8f5-4792-b699-05e8bc2cef37-kube-api-access-c7gt5\") pod \"tuned-dhqmw\" (UID: \"859128d1-b8f5-4792-b699-05e8bc2cef37\") " pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.288619 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.288598 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" Apr 17 18:10:09.288758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.288685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmql6\" (UniqueName: \"kubernetes.io/projected/7bd121bc-4898-442f-bbbb-e673a5c42e8d-kube-api-access-qmql6\") pod \"node-resolver-2mxld\" (UID: \"7bd121bc-4898-442f-bbbb-e673a5c42e8d\") " pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.288831 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.288812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqrp\" (UniqueName: \"kubernetes.io/projected/1c5158d4-d3a4-476a-abdb-3112fdb44ff9-kube-api-access-8jqrp\") pod \"aws-ebs-csi-driver-node-m8sqt\" (UID: \"1c5158d4-d3a4-476a-abdb-3112fdb44ff9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.289126 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.289108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnp8k\" (UniqueName: \"kubernetes.io/projected/f716dbf1-bcde-4892-b9da-62d55e29f521-kube-api-access-bnp8k\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.295270 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.295221 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" event={"ID":"a103039f5ca79ac6a4c1f769b0a80c09","Type":"ContainerStarted","Data":"ec45b7cc42c1cdcc61b40558f7c657ea22cb07f8075a360830d40019716dc0e3"} Apr 17 18:10:09.296242 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.296225 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859128d1_b8f5_4792_b699_05e8bc2cef37.slice/crio-5b128faa7c6241679d7edfdef72524a0f4ec5c05bedac79b1674b04716fbb1e0 WatchSource:0}: Error finding container 5b128faa7c6241679d7edfdef72524a0f4ec5c05bedac79b1674b04716fbb1e0: Status 404 returned error can't find the container with id 5b128faa7c6241679d7edfdef72524a0f4ec5c05bedac79b1674b04716fbb1e0 Apr 17 18:10:09.296242 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.296227 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"bd5586df870f9c05e0b79498a03c47e3","Type":"ContainerStarted","Data":"1c08cc6b3c8402868bd6a108d36b3f6ddb477932f5cf40e0e1b803719d4a661b"} Apr 17 18:10:09.382050 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382028 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382061 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-etc-kubernetes\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382084 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-netns\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-netns\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382141 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382141 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-daemon-config\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-etc-kubernetes\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-hostroot\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382185 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-hostroot\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382227 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-multus-certs\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382252 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64csn\" (UniqueName: \"kubernetes.io/projected/1b354b11-c37f-439d-876a-c2b9ba90c04a-kube-api-access-64csn\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382269 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-cni-binary-copy\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382285 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-socket-dir-parent\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-multus-certs\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382312 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-conf-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-conf-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-socket-dir-parent\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382360 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-bin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-bin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382391 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-system-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382416 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-k8s-cni-cncf-io\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382441 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-kubelet\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-system-cni-dir\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-run-k8s-cni-cncf-io\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382499 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-cnibin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-kubelet\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382523 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-multus\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.382550 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-cnibin\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.383039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382569 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-os-release\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.383039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-host-var-lib-cni-multus\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.383039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382582 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-multus-daemon-config\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.383039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382691 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b354b11-c37f-439d-876a-c2b9ba90c04a-cni-binary-copy\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.383039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.382702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b354b11-c37f-439d-876a-c2b9ba90c04a-os-release\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.389414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.389394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64csn\" (UniqueName: \"kubernetes.io/projected/1b354b11-c37f-439d-876a-c2b9ba90c04a-kube-api-access-64csn\") pod \"multus-75gtp\" (UID: \"1b354b11-c37f-439d-876a-c2b9ba90c04a\") " pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.476177 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.476159 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" Apr 17 18:10:09.481569 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.481554 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b57a1dd_f9f2_4315_889b_19e7f4b51454.slice/crio-b85ec0cab3f911303eb4a3faa7de04c7404c2c032de4179d735bc6673f1dd1c0 WatchSource:0}: Error finding container b85ec0cab3f911303eb4a3faa7de04c7404c2c032de4179d735bc6673f1dd1c0: Status 404 returned error can't find the container with id b85ec0cab3f911303eb4a3faa7de04c7404c2c032de4179d735bc6673f1dd1c0 Apr 17 18:10:09.490799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.490782 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6ql96" Apr 17 18:10:09.496191 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.496158 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9e76ee_0f23_4da8_ac35_76f4927ab685.slice/crio-2dcd4094d0b942225b6938a7d1668cbe2f7ae44600ddf9de0ee451afb3d7d7eb WatchSource:0}: Error finding container 2dcd4094d0b942225b6938a7d1668cbe2f7ae44600ddf9de0ee451afb3d7d7eb: Status 404 returned error can't find the container with id 2dcd4094d0b942225b6938a7d1668cbe2f7ae44600ddf9de0ee451afb3d7d7eb Apr 17 18:10:09.509547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.509531 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2mxld" Apr 17 18:10:09.515336 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.515320 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd121bc_4898_442f_bbbb_e673a5c42e8d.slice/crio-d5c1333f8cb94eb432ab9ac22e16b8f16c31121edd6e8078d4fb6641ba1dd733 WatchSource:0}: Error finding container d5c1333f8cb94eb432ab9ac22e16b8f16c31121edd6e8078d4fb6641ba1dd733: Status 404 returned error can't find the container with id d5c1333f8cb94eb432ab9ac22e16b8f16c31121edd6e8078d4fb6641ba1dd733 Apr 17 18:10:09.518957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.518943 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6sq4b" Apr 17 18:10:09.523852 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.523827 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f583aa9_f0c5_4df6_baa8_1e00e0442078.slice/crio-973ec0944899aa8f7e51183eae1ca85a0119c952216635cc030ce3b8233f593b WatchSource:0}: Error finding container 973ec0944899aa8f7e51183eae1ca85a0119c952216635cc030ce3b8233f593b: Status 404 returned error can't find the container with id 973ec0944899aa8f7e51183eae1ca85a0119c952216635cc030ce3b8233f593b Apr 17 18:10:09.535422 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.535408 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:09.541174 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.541155 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cffb2f_3b60_4f42_b9c0_a8a1b430bdff.slice/crio-6f59a8d883ac0bae27cb58827db4aa0766035053142eb2b74bef58b022288dba WatchSource:0}: Error finding container 6f59a8d883ac0bae27cb58827db4aa0766035053142eb2b74bef58b022288dba: Status 404 returned error can't find the container with id 6f59a8d883ac0bae27cb58827db4aa0766035053142eb2b74bef58b022288dba Apr 17 18:10:09.557080 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.557065 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:09.563004 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.562983 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d00a606_a143_4c76_9411_c88c0cded84f.slice/crio-5f4a3b7d97d6b58a3bdebda9065caa6daebe6bdf649dd524da340b0f010ee484 WatchSource:0}: Error finding container 5f4a3b7d97d6b58a3bdebda9065caa6daebe6bdf649dd524da340b0f010ee484: Status 404 returned error can't find the container with id 5f4a3b7d97d6b58a3bdebda9065caa6daebe6bdf649dd524da340b0f010ee484 Apr 17 18:10:09.583312 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.583296 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" Apr 17 18:10:09.589792 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.589774 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5158d4_d3a4_476a_abdb_3112fdb44ff9.slice/crio-54dbb57a2be0072af3d1e3a93466f3ba36acc2056d1884cc42ce9f3c4973db74 WatchSource:0}: Error finding container 54dbb57a2be0072af3d1e3a93466f3ba36acc2056d1884cc42ce9f3c4973db74: Status 404 returned error can't find the container with id 54dbb57a2be0072af3d1e3a93466f3ba36acc2056d1884cc42ce9f3c4973db74 Apr 17 18:10:09.596856 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.596843 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-75gtp" Apr 17 18:10:09.601515 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:09.601497 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b354b11_c37f_439d_876a_c2b9ba90c04a.slice/crio-4c2fdbe3715688a25ea0d1a1b2386a0cd677f81483e075506d5e0b0744266f1a WatchSource:0}: Error finding container 4c2fdbe3715688a25ea0d1a1b2386a0cd677f81483e075506d5e0b0744266f1a: Status 404 returned error can't find the container with id 4c2fdbe3715688a25ea0d1a1b2386a0cd677f81483e075506d5e0b0744266f1a Apr 17 18:10:09.784943 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.784398 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:09.784943 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.784559 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:09.784943 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.784612 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:10.784594819 +0000 UTC m=+3.120094768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:09.885070 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.885036 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:09.885226 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.885198 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:09.885226 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.885215 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:09.885226 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.885226 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:09.885386 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:09.885284 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:10.885263608 +0000 UTC m=+3.220763571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:09.969015 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:09.968979 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:10.208743 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.208665 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 18:05:09 +0000 UTC" deadline="2027-09-28 01:47:11.746094736 +0000 UTC" Apr 17 18:10:10.208743 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.208697 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12679h37m1.537401556s" Apr 17 18:10:10.316133 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.316071 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2mxld" event={"ID":"7bd121bc-4898-442f-bbbb-e673a5c42e8d","Type":"ContainerStarted","Data":"d5c1333f8cb94eb432ab9ac22e16b8f16c31121edd6e8078d4fb6641ba1dd733"} Apr 17 18:10:10.343864 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.343779 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerStarted","Data":"b85ec0cab3f911303eb4a3faa7de04c7404c2c032de4179d735bc6673f1dd1c0"} Apr 17 18:10:10.352017 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.351992 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" event={"ID":"859128d1-b8f5-4792-b699-05e8bc2cef37","Type":"ContainerStarted","Data":"5b128faa7c6241679d7edfdef72524a0f4ec5c05bedac79b1674b04716fbb1e0"} Apr 17 18:10:10.367133 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.367110 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75gtp" event={"ID":"1b354b11-c37f-439d-876a-c2b9ba90c04a","Type":"ContainerStarted","Data":"4c2fdbe3715688a25ea0d1a1b2386a0cd677f81483e075506d5e0b0744266f1a"} Apr 17 18:10:10.383771 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.383746 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" event={"ID":"1c5158d4-d3a4-476a-abdb-3112fdb44ff9","Type":"ContainerStarted","Data":"54dbb57a2be0072af3d1e3a93466f3ba36acc2056d1884cc42ce9f3c4973db74"} Apr 17 18:10:10.401284 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.401261 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmkjn" event={"ID":"9d00a606-a143-4c76-9411-c88c0cded84f","Type":"ContainerStarted","Data":"5f4a3b7d97d6b58a3bdebda9065caa6daebe6bdf649dd524da340b0f010ee484"} Apr 17 18:10:10.405168 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.405148 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:10.429721 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.428241 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ql96" event={"ID":"cc9e76ee-0f23-4da8-ac35-76f4927ab685","Type":"ContainerStarted","Data":"2dcd4094d0b942225b6938a7d1668cbe2f7ae44600ddf9de0ee451afb3d7d7eb"} Apr 17 18:10:10.434915 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.434891 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"6f59a8d883ac0bae27cb58827db4aa0766035053142eb2b74bef58b022288dba"} Apr 17 18:10:10.453568 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.453542 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6sq4b" event={"ID":"3f583aa9-f0c5-4df6-baa8-1e00e0442078","Type":"ContainerStarted","Data":"973ec0944899aa8f7e51183eae1ca85a0119c952216635cc030ce3b8233f593b"} Apr 17 18:10:10.656136 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.656109 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 18:10:10.796989 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.796953 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:10.797136 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.797092 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:10.797211 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.797155 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:12.797136298 +0000 UTC m=+5.132636236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:10.898166 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:10.897606 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:10.898166 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.897756 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:10.898166 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.897776 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:10.898166 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.897787 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:10.898166 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:10.897841 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:12.897822731 +0000 UTC m=+5.233322682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:11.209590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:11.209531 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 18:05:09 +0000 UTC" deadline="2027-11-24 20:13:33.37644618 +0000 UTC" Apr 17 18:10:11.209590 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:11.209561 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14066h3m22.166888856s" Apr 17 18:10:11.293295 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:11.293267 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:11.293444 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:11.293386 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:11.293832 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:11.293812 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:11.293944 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:11.293919 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:12.814233 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:12.814099 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:12.814233 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.814222 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:12.814856 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.814289 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:16.814269677 +0000 UTC m=+9.149769612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:12.915184 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:12.915152 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:12.915352 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.915295 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:12.915352 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.915314 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:12.915352 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.915325 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:12.915508 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:12.915389 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:16.915370207 +0000 UTC m=+9.250870160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:13.294028 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:13.293997 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:13.294196 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:13.294089 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:13.294406 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:13.294386 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:13.294555 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:13.294511 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:15.293269 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:15.293215 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:15.293858 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:15.293364 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:15.293858 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:15.293215 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:15.293858 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:15.293465 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:16.845185 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:16.845151 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:16.845658 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.845303 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:16.845658 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.845363 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:24.845343342 +0000 UTC m=+17.180843279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:16.946766 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:16.946189 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:16.946766 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.946334 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:16.946766 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.946354 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:16.946766 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.946368 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:16.946766 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:16.946421 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:24.946403336 +0000 UTC m=+17.281903285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:17.294461 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:17.293904 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:17.294461 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:17.293950 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:17.294461 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:17.294022 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:17.294461 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:17.294419 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:19.293413 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:19.293338 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:19.293804 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:19.293338 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:19.293804 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:19.293469 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:19.293804 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:19.293535 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:21.293084 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:21.293056 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:21.293084 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:21.293082 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:21.293687 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:21.293163 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:21.293687 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:21.293230 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:23.293195 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:23.293161 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:23.293595 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:23.293173 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:23.293595 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:23.293269 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:23.293595 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:23.293369 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:24.904740 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:24.904691 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:24.905313 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:24.904857 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:24.905313 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:24.904945 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:40.904924825 +0000 UTC m=+33.240424773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 18:10:25.005327 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:25.005295 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:25.005497 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.005474 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 18:10:25.005562 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.005499 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 18:10:25.005562 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.005512 2574 projected.go:194] Error preparing data for projected volume kube-api-access-7txjm for pod openshift-network-diagnostics/network-check-target-f529d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:25.005679 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.005588 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm podName:e385f165-5bc7-4270-8367-299a14868662 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:41.005568263 +0000 UTC m=+33.341068219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7txjm" (UniqueName: "kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm") pod "network-check-target-f529d" (UID: "e385f165-5bc7-4270-8367-299a14868662") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 18:10:25.293986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:25.293914 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:25.294153 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:25.293914 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:25.294153 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.294055 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:25.294153 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:25.294135 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:27.294433 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.294027 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:27.295177 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:27.294488 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:27.295177 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.294079 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:27.295177 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:27.294904 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:27.493879 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.493841 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-75gtp" event={"ID":"1b354b11-c37f-439d-876a-c2b9ba90c04a","Type":"ContainerStarted","Data":"7376c8409facea51886ca3fb8f160e5254e138b0c6b32da86ee7299ff6b1675d"} Apr 17 18:10:27.501716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.501689 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:10:27.502014 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.501994 2574 generic.go:358] "Generic (PLEG): container finished" podID="90cffb2f-3b60-4f42-b9c0-a8a1b430bdff" containerID="ab4d1735e1c86ad9749a0078a91272acce2c9347d87460ae5e2425c7ddb0391d" exitCode=1 Apr 17 18:10:27.502080 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502065 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"8aa09d3fa1752d38b5f782e9d422f6c00ec06e742fbad3dedd49976c8a6b755d"} Apr 17 18:10:27.502124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502093 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"fec49c4e77fa0683e7b96cf87e7f8c38b1c7e1f105deef6396fb396b066cbd1a"} Apr 17 18:10:27.502124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502108 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"af872a4601e58b9c2bdedc29f49a8af3a40f14af00e01af8d47d5758bb966993"} Apr 17 18:10:27.502185 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502122 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"d64d1a4ca2fd637b8db7df9b70ff32531f6d12da2e041b8ed1d88fd30b4927d3"} Apr 17 18:10:27.502185 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502135 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerDied","Data":"ab4d1735e1c86ad9749a0078a91272acce2c9347d87460ae5e2425c7ddb0391d"} Apr 17 18:10:27.502185 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.502149 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"ab52ab5690736c49f05ebefe656b645cbbe1cd520c61a51dcfe1929c60b1601a"} Apr 17 18:10:27.503055 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.503039 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" event={"ID":"859128d1-b8f5-4792-b699-05e8bc2cef37","Type":"ContainerStarted","Data":"e5877dbe70321b379d8a5ff801a189adc44bfaf869ca3c812fc0998ed166745f"} Apr 17 18:10:27.504168 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.504153 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" event={"ID":"a103039f5ca79ac6a4c1f769b0a80c09","Type":"ContainerStarted","Data":"b0bbc9799944f4f2222773305ed0ab04df86ac4704813f62b2b2e59e9b813053"} Apr 17 18:10:27.511157 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.511123 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-75gtp" podStartSLOduration=2.394799304 podStartE2EDuration="19.511114407s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.60279775 +0000 UTC m=+1.938297684" lastFinishedPulling="2026-04-17 18:10:26.71911284 +0000 UTC m=+19.054612787" observedRunningTime="2026-04-17 18:10:27.510408573 +0000 UTC m=+19.845908528" watchObservedRunningTime="2026-04-17 18:10:27.511114407 +0000 UTC m=+19.846614362" Apr 17 18:10:27.523477 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.523435 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" podStartSLOduration=19.523422545 podStartE2EDuration="19.523422545s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:10:27.523111336 +0000 UTC m=+19.858611293" watchObservedRunningTime="2026-04-17 18:10:27.523422545 +0000 UTC m=+19.858922501" Apr 17 18:10:27.543802 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:27.543755 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dhqmw" podStartSLOduration=2.136821651 podStartE2EDuration="19.543739675s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.29758071 +0000 UTC m=+1.633080644" lastFinishedPulling="2026-04-17 18:10:26.704498717 +0000 UTC m=+19.039998668" observedRunningTime="2026-04-17 18:10:27.543093072 +0000 UTC m=+19.878593026" watchObservedRunningTime="2026-04-17 18:10:27.543739675 +0000 UTC m=+19.879239630" Apr 17 18:10:28.397448 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.397326 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 17 18:10:28.507573 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.507522 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" event={"ID":"1c5158d4-d3a4-476a-abdb-3112fdb44ff9","Type":"ContainerStarted","Data":"89242e0024c9fc5297f8fb948d3017836844300b21f4a775d6b1968d72a3e1e2"} Apr 17 18:10:28.507573 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.507549 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" event={"ID":"1c5158d4-d3a4-476a-abdb-3112fdb44ff9","Type":"ContainerStarted","Data":"1a7148f6d9ba00861532ab771df1cc58e0cfef0f2fabcbd0271b50a6042311f8"} Apr 17 18:10:28.508560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.508535 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmkjn" event={"ID":"9d00a606-a143-4c76-9411-c88c0cded84f","Type":"ContainerStarted","Data":"f0d5131ef196f1e09912ea0b8888a59468e5f1aece3ab454d6eac02bf04e6bf8"} Apr 17 18:10:28.509701 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.509682 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6ql96" event={"ID":"cc9e76ee-0f23-4da8-ac35-76f4927ab685","Type":"ContainerStarted","Data":"0d403b08187c97cd35556c9f55631b61a8c60951b3aae5359ed54db855bd7d3a"} Apr 17 18:10:28.510786 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.510767 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6sq4b" event={"ID":"3f583aa9-f0c5-4df6-baa8-1e00e0442078","Type":"ContainerStarted","Data":"d378ed5709251c09c9c2e21f46f5798c6e64f49db86273dd1a112e95ed5b1079"} Apr 17 18:10:28.511963 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.511944 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2mxld" event={"ID":"7bd121bc-4898-442f-bbbb-e673a5c42e8d","Type":"ContainerStarted","Data":"1e45fd7459e5d6e2edf02bb126077af1ee4814bb2bf421c5a866f383c61b0e59"} Apr 17 18:10:28.513163 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.513141 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="09f65883a0c9c59a9e0e145ffb759f2d070a5b9e2c00ccf13fc4be75e40801ff" exitCode=0 Apr 17 18:10:28.513263 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.513217 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"09f65883a0c9c59a9e0e145ffb759f2d070a5b9e2c00ccf13fc4be75e40801ff"} Apr 17 18:10:28.514448 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.514426 2574 generic.go:358] "Generic (PLEG): container finished" podID="bd5586df870f9c05e0b79498a03c47e3" containerID="72c326671824e27c41b4887bc67e24dad114d80b8dd3c416209d30be3c09f3b6" exitCode=0 Apr 17 18:10:28.514531 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.514512 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"bd5586df870f9c05e0b79498a03c47e3","Type":"ContainerDied","Data":"72c326671824e27c41b4887bc67e24dad114d80b8dd3c416209d30be3c09f3b6"} Apr 17 18:10:28.523129 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.523099 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmkjn" podStartSLOduration=3.384691212 podStartE2EDuration="20.523089623s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.564316201 +0000 UTC m=+1.899816135" lastFinishedPulling="2026-04-17 18:10:26.702714599 +0000 UTC m=+19.038214546" observedRunningTime="2026-04-17 18:10:28.522954024 +0000 UTC m=+20.858453979" watchObservedRunningTime="2026-04-17 18:10:28.523089623 +0000 UTC m=+20.858589579" Apr 17 18:10:28.571734 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.571694 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6ql96" podStartSLOduration=3.366456904 podStartE2EDuration="20.57168027s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.497502645 +0000 UTC m=+1.833002579" lastFinishedPulling="2026-04-17 18:10:26.702725997 +0000 UTC m=+19.038225945" observedRunningTime="2026-04-17 18:10:28.553950253 +0000 UTC m=+20.889450208" watchObservedRunningTime="2026-04-17 18:10:28.57168027 +0000 UTC m=+20.907180225" Apr 17 18:10:28.597781 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.597740 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2mxld" podStartSLOduration=3.411372019 podStartE2EDuration="20.597727641s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.51661286 +0000 UTC m=+1.852112794" lastFinishedPulling="2026-04-17 18:10:26.702968466 +0000 UTC m=+19.038468416" observedRunningTime="2026-04-17 18:10:28.585234624 +0000 UTC m=+20.920734580" watchObservedRunningTime="2026-04-17 18:10:28.597727641 +0000 UTC m=+20.933227598" Apr 17 18:10:28.597886 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:28.597824 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6sq4b" podStartSLOduration=3.419921353 podStartE2EDuration="20.59781591s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.525042396 +0000 UTC m=+1.860542333" lastFinishedPulling="2026-04-17 18:10:26.702936941 +0000 UTC m=+19.038436890" observedRunningTime="2026-04-17 18:10:28.59744327 +0000 UTC m=+20.932943226" watchObservedRunningTime="2026-04-17 18:10:28.59781591 +0000 UTC m=+20.933315867" Apr 17 18:10:29.219225 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.219197 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:29.220014 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.219997 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:29.249745 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.249655 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-17T18:10:28.397443456Z","UUID":"2070827b-78a5-40f0-aeca-116618e62a55","Handler":null,"Name":"","Endpoint":""} Apr 17 18:10:29.251753 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.251726 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 17 18:10:29.251753 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.251755 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 17 18:10:29.293619 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.293598 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:29.293728 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.293600 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:29.293797 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:29.293726 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:29.293863 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:29.293836 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:29.517592 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.517548 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"bd5586df870f9c05e0b79498a03c47e3","Type":"ContainerStarted","Data":"a8931fa95621fb7df7730b4006d3f497553e9242e67d313964dfa84dd2ceed62"} Apr 17 18:10:29.519704 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.519675 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" event={"ID":"1c5158d4-d3a4-476a-abdb-3112fdb44ff9","Type":"ContainerStarted","Data":"38b88086f5ccb31a0ce273d7e4527aff532f35fbf8cf9c4d40f14d6f5be93648"} Apr 17 18:10:29.524805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.524788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:10:29.525204 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.525171 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"3171428ce6926b7d12ce5c2decf1eea7adcf0f646c0b3958a4618a2ec8ead005"} Apr 17 18:10:29.536950 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.536911 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" podStartSLOduration=21.536899144 podStartE2EDuration="21.536899144s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:10:29.536522124 +0000 UTC m=+21.872022081" watchObservedRunningTime="2026-04-17 18:10:29.536899144 +0000 UTC m=+21.872399099" Apr 17 18:10:29.555601 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:29.555561 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m8sqt" podStartSLOduration=2.041076399 podStartE2EDuration="21.555547739s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.590952137 +0000 UTC m=+1.926452084" lastFinishedPulling="2026-04-17 18:10:29.105423485 +0000 UTC m=+21.440923424" observedRunningTime="2026-04-17 18:10:29.554750761 +0000 UTC m=+21.890250717" watchObservedRunningTime="2026-04-17 18:10:29.555547739 +0000 UTC m=+21.891047696" Apr 17 18:10:30.526406 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:30.526338 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Apr 17 18:10:31.261871 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:31.261845 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:31.262699 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:31.262675 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmkjn" Apr 17 18:10:31.293254 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:31.293229 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:31.293375 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:31.293233 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:31.293375 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:31.293356 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:31.293483 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:31.293388 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:32.533478 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.533338 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:10:32.533903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.533860 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"c804be1d53548fa2523f913109c99b8247b175a494d882c797e4ad228d18f43c"} Apr 17 18:10:32.534039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.534020 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:32.534107 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.534060 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:32.534107 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.534074 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:32.534288 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.534263 2574 scope.go:117] "RemoveContainer" containerID="ab4d1735e1c86ad9749a0078a91272acce2c9347d87460ae5e2425c7ddb0391d" Apr 17 18:10:32.549881 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.549862 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:32.549983 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:32.549926 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:10:33.293469 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.293314 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:33.293571 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.293319 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:33.293624 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:33.293606 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:33.293624 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:33.293528 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:33.540109 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.540089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:10:33.540410 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.540390 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" event={"ID":"90cffb2f-3b60-4f42-b9c0-a8a1b430bdff","Type":"ContainerStarted","Data":"3322b2a3a3caa4e721beaf38056279aa63f971020d99ad36d2ba192f80304c35"} Apr 17 18:10:33.541832 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.541813 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="dd7733efa81b2bde50f83f89a765cc8ab35d4d6a2253cbabff320e9467b1452e" exitCode=0 Apr 17 18:10:33.541933 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.541847 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"dd7733efa81b2bde50f83f89a765cc8ab35d4d6a2253cbabff320e9467b1452e"} Apr 17 18:10:33.588278 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:33.588227 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" podStartSLOduration=8.3837027 podStartE2EDuration="25.588213162s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.542330103 +0000 UTC m=+1.877830038" lastFinishedPulling="2026-04-17 18:10:26.746840551 +0000 UTC m=+19.082340500" observedRunningTime="2026-04-17 18:10:33.586538894 +0000 UTC m=+25.922038849" watchObservedRunningTime="2026-04-17 18:10:33.588213162 +0000 UTC m=+25.923713118" Apr 17 18:10:34.312577 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:34.312408 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-snrz7"] Apr 17 18:10:34.312577 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:34.312533 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:34.312800 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:34.312663 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:34.314107 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:34.313926 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f529d"] Apr 17 18:10:34.314107 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:34.314021 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:34.314107 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:34.314094 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:35.552973 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:35.552944 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="ff85cf6bbacfbd4f5219da16c894286b9ae29ef520e7c05a31bd8fa9a7c3b2a9" exitCode=0 Apr 17 18:10:35.553805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:35.552990 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"ff85cf6bbacfbd4f5219da16c894286b9ae29ef520e7c05a31bd8fa9a7c3b2a9"} Apr 17 18:10:36.293412 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:36.293371 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:36.293563 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:36.293419 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:36.293563 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:36.293494 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:36.293695 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:36.293639 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:36.556717 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:36.556510 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="102a20be940d391f80a902fbb6bc3036ebdc7b9034bda63913bbc99b4e102214" exitCode=0 Apr 17 18:10:36.556717 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:36.556559 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"102a20be940d391f80a902fbb6bc3036ebdc7b9034bda63913bbc99b4e102214"} Apr 17 18:10:38.294657 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.294611 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:38.295092 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:38.294738 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:10:38.295092 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.294795 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:38.295092 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:38.294880 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f529d" podUID="e385f165-5bc7-4270-8367-299a14868662" Apr 17 18:10:38.934178 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.934150 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeReady" Apr 17 18:10:38.934365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.934268 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 17 18:10:38.980117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.980087 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fmmdc"] Apr 17 18:10:38.998643 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.998602 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8mp25"] Apr 17 18:10:38.998808 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:38.998779 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.001428 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.001361 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 17 18:10:39.001428 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.001363 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 17 18:10:39.001594 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.001364 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46dtx\"" Apr 17 18:10:39.013899 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.013880 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmmdc"] Apr 17 18:10:39.013899 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.013897 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.014023 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.013904 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8mp25"] Apr 17 18:10:39.016370 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.016335 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 17 18:10:39.016456 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.016371 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 17 18:10:39.016648 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.016614 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 17 18:10:39.016870 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.016840 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hwgzd\"" Apr 17 18:10:39.110198 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-tmp-dir\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.110360 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-config-volume\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.110360 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxqk\" (UniqueName: \"kubernetes.io/projected/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-kube-api-access-2nxqk\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.110360 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.110524 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.110524 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.110411 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmwv\" (UniqueName: \"kubernetes.io/projected/20e3ddf2-2561-496a-8a56-350b145462b9-kube-api-access-dkmwv\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.211248 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211170 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxqk\" (UniqueName: \"kubernetes.io/projected/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-kube-api-access-2nxqk\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.211248 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.211452 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211253 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.211452 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211279 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmwv\" (UniqueName: \"kubernetes.io/projected/20e3ddf2-2561-496a-8a56-350b145462b9-kube-api-access-dkmwv\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.211452 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-tmp-dir\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.211452 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211329 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-config-volume\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.211676 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.211452 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:39.211676 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.211457 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:39.211676 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.211529 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:39.711510711 +0000 UTC m=+32.047010663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:39.211676 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.211572 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:39.711552919 +0000 UTC m=+32.047052854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:10:39.211892 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.211745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-tmp-dir\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.221803 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.221779 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxqk\" (UniqueName: \"kubernetes.io/projected/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-kube-api-access-2nxqk\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.222022 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.222002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmwv\" (UniqueName: \"kubernetes.io/projected/20e3ddf2-2561-496a-8a56-350b145462b9-kube-api-access-dkmwv\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.226990 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.226964 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-config-volume\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.715982 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.715949 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:39.716359 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:39.715991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:39.716359 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.716095 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:39.716359 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.716111 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:39.716359 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.716166 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:40.716150885 +0000 UTC m=+33.051650824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:10:39.716359 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:39.716180 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:40.716174259 +0000 UTC m=+33.051674193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:40.293460 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.293421 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:40.293685 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.293478 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:40.296348 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.296317 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 18:10:40.296348 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.296334 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 18:10:40.297355 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.297332 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 18:10:40.297464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.297373 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5nnqt\"" Apr 17 18:10:40.297524 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.297334 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c85k4\"" Apr 17 18:10:40.724005 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.723971 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:40.724449 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.724017 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:40.724449 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.724122 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:40.724449 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.724180 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:42.724165689 +0000 UTC m=+35.059665624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:40.724449 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.724121 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:40.724449 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.724281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:42.724260053 +0000 UTC m=+35.059759994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:10:40.925844 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:40.925809 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:10:40.926003 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.925970 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Apr 17 18:10:40.926064 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:40.926039 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:11:12.926019314 +0000 UTC m=+65.261519265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : secret "metrics-daemon-secret" not found Apr 17 18:10:41.026537 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:41.026461 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:41.029203 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:41.029174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txjm\" (UniqueName: \"kubernetes.io/projected/e385f165-5bc7-4270-8367-299a14868662-kube-api-access-7txjm\") pod \"network-check-target-f529d\" (UID: \"e385f165-5bc7-4270-8367-299a14868662\") " pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:41.209839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:41.209806 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:41.985293 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:41.985263 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f529d"] Apr 17 18:10:42.064817 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:10:42.064776 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode385f165_5bc7_4270_8367_299a14868662.slice/crio-6032f4f01ad4327c2f4acbdfdfb588ce85db74fea0081ac3b56c934fbb18384b WatchSource:0}: Error finding container 6032f4f01ad4327c2f4acbdfdfb588ce85db74fea0081ac3b56c934fbb18384b: Status 404 returned error can't find the container with id 6032f4f01ad4327c2f4acbdfdfb588ce85db74fea0081ac3b56c934fbb18384b Apr 17 18:10:42.570332 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:42.570162 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="78d7427a54669b5a4d2063fac71400cb0d0fef33dcc24da34d854626eeda3764" exitCode=0 Apr 17 18:10:42.570484 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:42.570218 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"78d7427a54669b5a4d2063fac71400cb0d0fef33dcc24da34d854626eeda3764"} Apr 17 18:10:42.571608 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:42.571562 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f529d" event={"ID":"e385f165-5bc7-4270-8367-299a14868662","Type":"ContainerStarted","Data":"6032f4f01ad4327c2f4acbdfdfb588ce85db74fea0081ac3b56c934fbb18384b"} Apr 17 18:10:42.740168 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:42.740145 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:42.740267 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:42.740253 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:42.740334 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:42.740276 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:42.740384 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:42.740344 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:46.740325376 +0000 UTC m=+39.075825320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:10:42.740447 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:42.740389 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:42.740447 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:42.740432 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:46.740420605 +0000 UTC m=+39.075920540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:43.576016 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:43.575977 2574 generic.go:358] "Generic (PLEG): container finished" podID="4b57a1dd-f9f2-4315-889b-19e7f4b51454" containerID="aa2a44cff7e987a157126df3193ccfa132338c90cab60e4e19960ee6e13752c3" exitCode=0 Apr 17 18:10:43.576652 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:43.576029 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerDied","Data":"aa2a44cff7e987a157126df3193ccfa132338c90cab60e4e19960ee6e13752c3"} Apr 17 18:10:44.581762 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:44.581728 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" event={"ID":"4b57a1dd-f9f2-4315-889b-19e7f4b51454","Type":"ContainerStarted","Data":"1207c274e391c6cb8be9d1ae60fb74c4f124dfeaaa223fe50a1254e3617703ec"} Apr 17 18:10:44.603989 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:44.603947 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ptfqc" podStartSLOduration=3.991323408 podStartE2EDuration="36.603933683s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:09.483052822 +0000 UTC m=+1.818552756" lastFinishedPulling="2026-04-17 18:10:42.095663094 +0000 UTC m=+34.431163031" observedRunningTime="2026-04-17 18:10:44.602148908 +0000 UTC m=+36.937648886" watchObservedRunningTime="2026-04-17 18:10:44.603933683 +0000 UTC m=+36.939433639" Apr 17 18:10:45.584149 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:45.584122 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f529d" event={"ID":"e385f165-5bc7-4270-8367-299a14868662","Type":"ContainerStarted","Data":"eafaaa72f9650ba5c0eccb5ad4c90fe7d18d87e5d45b876f4c9269da12ae205a"} Apr 17 18:10:45.584563 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:45.584297 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:10:45.598357 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:45.598314 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f529d" podStartSLOduration=34.291359734 podStartE2EDuration="37.598302504s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:10:42.075162508 +0000 UTC m=+34.410662446" lastFinishedPulling="2026-04-17 18:10:45.382105279 +0000 UTC m=+37.717605216" observedRunningTime="2026-04-17 18:10:45.597839661 +0000 UTC m=+37.933339616" watchObservedRunningTime="2026-04-17 18:10:45.598302504 +0000 UTC m=+37.933802456" Apr 17 18:10:46.766427 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:46.766397 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:46.766427 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:46.766429 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:46.766885 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:46.766514 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:46.766885 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:46.766547 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:46.766885 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:46.766557 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:54.766544505 +0000 UTC m=+47.102044439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:46.766885 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:46.766648 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:10:54.766612285 +0000 UTC m=+47.102112225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:10:54.814600 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:54.814563 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:10:54.815030 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:10:54.814623 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:10:54.815030 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:54.814708 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:10:54.815030 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:54.814715 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:10:54.815030 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:54.814760 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:11:10.814747351 +0000 UTC m=+63.150247286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:10:54.815030 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:10:54.814773 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:11:10.814767873 +0000 UTC m=+63.150267807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:11:04.561367 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:04.561341 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sk45l" Apr 17 18:11:10.912516 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:10.912479 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:11:10.912516 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:10.912520 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:11:10.912934 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:10.912607 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:11:10.912934 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:10.912611 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:11:10.912934 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:10.912679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:11:42.912663719 +0000 UTC m=+95.248163653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:11:10.912934 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:10.912694 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:11:42.912687814 +0000 UTC m=+95.248187749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:11:12.927184 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:12.927155 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:11:12.927509 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:12.927266 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Apr 17 18:11:12.927509 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:12.927312 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:16.927298748 +0000 UTC m=+129.262798682 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : secret "metrics-daemon-secret" not found Apr 17 18:11:16.587495 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:16.587469 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f529d" Apr 17 18:11:42.918896 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:42.918791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:11:42.918896 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:11:42.918823 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:11:42.918896 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:42.918896 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Apr 17 18:11:42.919409 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:42.918917 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Apr 17 18:11:42.919409 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:42.918942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert podName:20e3ddf2-2561-496a-8a56-350b145462b9 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:46.918928506 +0000 UTC m=+159.254428440 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert") pod "ingress-canary-8mp25" (UID: "20e3ddf2-2561-496a-8a56-350b145462b9") : secret "canary-serving-cert" not found Apr 17 18:11:42.919409 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:11:42.918975 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls podName:b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:46.918962847 +0000 UTC m=+159.254462781 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls") pod "dns-default-fmmdc" (UID: "b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9") : secret "dns-default-metrics-tls" not found Apr 17 18:12:16.939945 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:16.939908 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:12:16.940601 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:16.940100 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Apr 17 18:12:16.940601 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:16.940215 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs podName:f716dbf1-bcde-4892-b9da-62d55e29f521 nodeName:}" failed. No retries permitted until 2026-04-17 18:14:18.94019018 +0000 UTC m=+251.275690140 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs") pod "network-metrics-daemon-snrz7" (UID: "f716dbf1-bcde-4892-b9da-62d55e29f521") : secret "metrics-daemon-secret" not found Apr 17 18:12:21.167329 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.167289 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd"] Apr 17 18:12:21.170084 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.170053 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" Apr 17 18:12:21.171456 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.171424 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-585dfdc468-tlzlj"] Apr 17 18:12:21.172699 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.172671 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xcpwf\"" Apr 17 18:12:21.174516 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.174495 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.175345 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.175318 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-z9xc6"] Apr 17 18:12:21.177216 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177191 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Apr 17 18:12:21.177389 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177292 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 17 18:12:21.177389 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177300 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Apr 17 18:12:21.177592 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177563 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cbs4r\"" Apr 17 18:12:21.177786 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177770 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 17 18:12:21.177987 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.177964 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:12:21.178102 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.178081 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.180906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.180872 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Apr 17 18:12:21.181527 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.181505 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6ls9j\"" Apr 17 18:12:21.181798 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.181599 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Apr 17 18:12:21.181973 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.181944 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Apr 17 18:12:21.182355 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.182323 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Apr 17 18:12:21.182456 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.182431 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.186986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.186955 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Apr 17 18:12:21.187120 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.187100 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd"] Apr 17 18:12:21.187408 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.187385 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Apr 17 18:12:21.187408 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.187401 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wbd55\"" Apr 17 18:12:21.187691 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.187650 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Apr 17 18:12:21.187807 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.187714 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Apr 17 18:12:21.191710 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.191684 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-585dfdc468-tlzlj"] Apr 17 18:12:21.191856 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.191813 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Apr 17 18:12:21.193790 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.193766 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Apr 17 18:12:21.197455 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.197203 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-z9xc6"] Apr 17 18:12:21.198215 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.198098 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:12:21.266201 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-service-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.266304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/358063c2-5e0c-4278-8b52-bd8bab0d8c13-serving-cert\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.266304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-trusted-ca\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.266304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.266304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266295 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266342 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924a9d74-9241-4ce3-b95c-e513695b73e7-serving-cert\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkccf\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9dr4\" (UniqueName: \"kubernetes.io/projected/924a9d74-9241-4ce3-b95c-e513695b73e7-kube-api-access-c9dr4\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266411 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-snapshots\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-tmp\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.266491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-config\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.266794 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l598z\" (UniqueName: \"kubernetes.io/projected/e7b2da7d-be8d-4a3e-a490-2906d6b8299f-kube-api-access-l598z\") pod \"network-check-source-8894fc9bd-5qnqd\" (UID: \"e7b2da7d-be8d-4a3e-a490-2906d6b8299f\") " pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" Apr 17 18:12:21.266794 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266794 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.266794 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.266641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trxk\" (UniqueName: \"kubernetes.io/projected/358063c2-5e0c-4278-8b52-bd8bab0d8c13-kube-api-access-4trxk\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.367728 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.367705 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.367822 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.367751 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4trxk\" (UniqueName: \"kubernetes.io/projected/358063c2-5e0c-4278-8b52-bd8bab0d8c13-kube-api-access-4trxk\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.367822 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.367802 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-service-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.367930 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.367825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/358063c2-5e0c-4278-8b52-bd8bab0d8c13-serving-cert\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.367995 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.367972 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-trusted-ca\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.368050 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368014 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.368050 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368040 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368131 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368131 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368121 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368236 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368145 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924a9d74-9241-4ce3-b95c-e513695b73e7-serving-cert\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.368236 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368169 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkccf\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368505 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-service-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.368570 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368319 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9dr4\" (UniqueName: \"kubernetes.io/projected/924a9d74-9241-4ce3-b95c-e513695b73e7-kube-api-access-c9dr4\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.368659 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368569 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368659 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368597 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.368762 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368674 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-snapshots\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.368762 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368725 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-tmp\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.368964 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/358063c2-5e0c-4278-8b52-bd8bab0d8c13-trusted-ca-bundle\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.369046 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-tmp\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.369106 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.369260 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.368571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.369327 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369287 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-config\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.369327 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369320 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l598z\" (UniqueName: \"kubernetes.io/projected/e7b2da7d-be8d-4a3e-a490-2906d6b8299f-kube-api-access-l598z\") pod \"network-check-source-8894fc9bd-5qnqd\" (UID: \"e7b2da7d-be8d-4a3e-a490-2906d6b8299f\") " pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" Apr 17 18:12:21.369424 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369349 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.369476 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.369439 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Apr 17 18:12:21.369476 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.369451 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9dc6798b-5nkml: secret "image-registry-tls" not found Apr 17 18:12:21.369476 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.369620 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.369495 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls podName:8117fe13-a8cb-40fa-b1b5-facaa80ba064 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:21.869479574 +0000 UTC m=+134.204979531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls") pod "image-registry-5d9dc6798b-5nkml" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064") : secret "image-registry-tls" not found Apr 17 18:12:21.369620 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/358063c2-5e0c-4278-8b52-bd8bab0d8c13-snapshots\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.369757 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-trusted-ca\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.369998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.369978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/924a9d74-9241-4ce3-b95c-e513695b73e7-config\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.371716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.371690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/924a9d74-9241-4ce3-b95c-e513695b73e7-serving-cert\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.371798 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.371693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.371798 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.371780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/358063c2-5e0c-4278-8b52-bd8bab0d8c13-serving-cert\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.371869 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.371798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.376547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.376525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trxk\" (UniqueName: \"kubernetes.io/projected/358063c2-5e0c-4278-8b52-bd8bab0d8c13-kube-api-access-4trxk\") pod \"insights-operator-585dfdc468-tlzlj\" (UID: \"358063c2-5e0c-4278-8b52-bd8bab0d8c13\") " pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.377124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.377099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.377274 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.377252 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkccf\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.378193 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.378170 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9dr4\" (UniqueName: \"kubernetes.io/projected/924a9d74-9241-4ce3-b95c-e513695b73e7-kube-api-access-c9dr4\") pod \"console-operator-9d4b6777b-z9xc6\" (UID: \"924a9d74-9241-4ce3-b95c-e513695b73e7\") " pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.378795 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.378773 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l598z\" (UniqueName: \"kubernetes.io/projected/e7b2da7d-be8d-4a3e-a490-2906d6b8299f-kube-api-access-l598z\") pod \"network-check-source-8894fc9bd-5qnqd\" (UID: \"e7b2da7d-be8d-4a3e-a490-2906d6b8299f\") " pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" Apr 17 18:12:21.484767 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.484724 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" Apr 17 18:12:21.494306 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.494288 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" Apr 17 18:12:21.502173 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.501862 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:21.617313 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.617286 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd"] Apr 17 18:12:21.748299 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.748237 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" event={"ID":"e7b2da7d-be8d-4a3e-a490-2906d6b8299f","Type":"ContainerStarted","Data":"2a2bb8bab8402489c0814d6706d04089e166a9245924957954359f6bdd3d94ec"} Apr 17 18:12:21.748299 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.748279 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" event={"ID":"e7b2da7d-be8d-4a3e-a490-2906d6b8299f","Type":"ContainerStarted","Data":"99ab1e8cf63e861a2968daf52a0f99e93bdb216490ab97a804fcfd7c11c64b6f"} Apr 17 18:12:21.762977 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.762933 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-8894fc9bd-5qnqd" podStartSLOduration=0.76291928 podStartE2EDuration="762.91928ms" podCreationTimestamp="2026-04-17 18:12:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:12:21.762112336 +0000 UTC m=+134.097612294" watchObservedRunningTime="2026-04-17 18:12:21.76291928 +0000 UTC m=+134.098419235" Apr 17 18:12:21.835309 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.835286 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-585dfdc468-tlzlj"] Apr 17 18:12:21.838217 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.838195 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-9d4b6777b-z9xc6"] Apr 17 18:12:21.838496 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:21.838469 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358063c2_5e0c_4278_8b52_bd8bab0d8c13.slice/crio-568d19994eaf5ddb1652fea8444224ecdee8295ecf3cf355d31edf96fd32d70f WatchSource:0}: Error finding container 568d19994eaf5ddb1652fea8444224ecdee8295ecf3cf355d31edf96fd32d70f: Status 404 returned error can't find the container with id 568d19994eaf5ddb1652fea8444224ecdee8295ecf3cf355d31edf96fd32d70f Apr 17 18:12:21.842202 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:21.842177 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924a9d74_9241_4ce3_b95c_e513695b73e7.slice/crio-6e82d1c149a9144ab4a3223fdf57aa7d9eb445b9f2423c9cbe60a94ccf79691b WatchSource:0}: Error finding container 6e82d1c149a9144ab4a3223fdf57aa7d9eb445b9f2423c9cbe60a94ccf79691b: Status 404 returned error can't find the container with id 6e82d1c149a9144ab4a3223fdf57aa7d9eb445b9f2423c9cbe60a94ccf79691b Apr 17 18:12:21.873716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:21.873696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:21.873859 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.873844 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Apr 17 18:12:21.873918 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.873862 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9dc6798b-5nkml: secret "image-registry-tls" not found Apr 17 18:12:21.873918 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:21.873913 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls podName:8117fe13-a8cb-40fa-b1b5-facaa80ba064 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:22.873894724 +0000 UTC m=+135.209394676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls") pod "image-registry-5d9dc6798b-5nkml" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064") : secret "image-registry-tls" not found Apr 17 18:12:22.751207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:22.751172 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" event={"ID":"358063c2-5e0c-4278-8b52-bd8bab0d8c13","Type":"ContainerStarted","Data":"568d19994eaf5ddb1652fea8444224ecdee8295ecf3cf355d31edf96fd32d70f"} Apr 17 18:12:22.752316 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:22.752268 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" event={"ID":"924a9d74-9241-4ce3-b95c-e513695b73e7","Type":"ContainerStarted","Data":"6e82d1c149a9144ab4a3223fdf57aa7d9eb445b9f2423c9cbe60a94ccf79691b"} Apr 17 18:12:22.878845 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:22.878817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:22.878954 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:22.878927 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Apr 17 18:12:22.878954 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:22.878939 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9dc6798b-5nkml: secret "image-registry-tls" not found Apr 17 18:12:22.879021 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:22.878989 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls podName:8117fe13-a8cb-40fa-b1b5-facaa80ba064 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:24.878972655 +0000 UTC m=+137.214472606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls") pod "image-registry-5d9dc6798b-5nkml" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064") : secret "image-registry-tls" not found Apr 17 18:12:24.757688 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.757618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/0.log" Apr 17 18:12:24.757688 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.757670 2574 generic.go:358] "Generic (PLEG): container finished" podID="924a9d74-9241-4ce3-b95c-e513695b73e7" containerID="5f40f0a3b6898930eb2026bed3b011c72630981dec8c48a8c3c07e97ebbb8257" exitCode=255 Apr 17 18:12:24.758045 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.757736 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" event={"ID":"924a9d74-9241-4ce3-b95c-e513695b73e7","Type":"ContainerDied","Data":"5f40f0a3b6898930eb2026bed3b011c72630981dec8c48a8c3c07e97ebbb8257"} Apr 17 18:12:24.758045 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.757924 2574 scope.go:117] "RemoveContainer" containerID="5f40f0a3b6898930eb2026bed3b011c72630981dec8c48a8c3c07e97ebbb8257" Apr 17 18:12:24.759099 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.759070 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" event={"ID":"358063c2-5e0c-4278-8b52-bd8bab0d8c13","Type":"ContainerStarted","Data":"de0dc2e9c67847277246f37609098e966b58fe6d99b7e98d556fcfa47a4f4cee"} Apr 17 18:12:24.790504 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.790462 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" podStartSLOduration=1.121572328 podStartE2EDuration="3.790449037s" podCreationTimestamp="2026-04-17 18:12:21 +0000 UTC" firstStartedPulling="2026-04-17 18:12:21.840495886 +0000 UTC m=+134.175995821" lastFinishedPulling="2026-04-17 18:12:24.509372592 +0000 UTC m=+136.844872530" observedRunningTime="2026-04-17 18:12:24.789657424 +0000 UTC m=+137.125157373" watchObservedRunningTime="2026-04-17 18:12:24.790449037 +0000 UTC m=+137.125948992" Apr 17 18:12:24.892889 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:24.892859 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:24.893013 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:24.892994 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Apr 17 18:12:24.893052 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:24.893014 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9dc6798b-5nkml: secret "image-registry-tls" not found Apr 17 18:12:24.893085 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:24.893063 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls podName:8117fe13-a8cb-40fa-b1b5-facaa80ba064 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:28.893048822 +0000 UTC m=+141.228548759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls") pod "image-registry-5d9dc6798b-5nkml" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064") : secret "image-registry-tls" not found Apr 17 18:12:25.445516 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.445487 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj"] Apr 17 18:12:25.448363 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.448345 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" Apr 17 18:12:25.450725 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.450695 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Apr 17 18:12:25.451738 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.451715 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Apr 17 18:12:25.451852 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.451715 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xhrdc\"" Apr 17 18:12:25.457561 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.457543 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj"] Apr 17 18:12:25.496768 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.496746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gf57\" (UniqueName: \"kubernetes.io/projected/10a0f856-6ff0-4be0-a0ca-35f7df85b28a-kube-api-access-2gf57\") pod \"migrator-74bb7799d9-tnftj\" (UID: \"10a0f856-6ff0-4be0-a0ca-35f7df85b28a\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" Apr 17 18:12:25.597403 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.597382 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gf57\" (UniqueName: \"kubernetes.io/projected/10a0f856-6ff0-4be0-a0ca-35f7df85b28a-kube-api-access-2gf57\") pod \"migrator-74bb7799d9-tnftj\" (UID: \"10a0f856-6ff0-4be0-a0ca-35f7df85b28a\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" Apr 17 18:12:25.604657 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.604621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gf57\" (UniqueName: \"kubernetes.io/projected/10a0f856-6ff0-4be0-a0ca-35f7df85b28a-kube-api-access-2gf57\") pod \"migrator-74bb7799d9-tnftj\" (UID: \"10a0f856-6ff0-4be0-a0ca-35f7df85b28a\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" Apr 17 18:12:25.756437 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.756373 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" Apr 17 18:12:25.763601 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.763426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:12:25.763911 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.763869 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/0.log" Apr 17 18:12:25.763960 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.763906 2574 generic.go:358] "Generic (PLEG): container finished" podID="924a9d74-9241-4ce3-b95c-e513695b73e7" containerID="c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9" exitCode=255 Apr 17 18:12:25.764015 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.763989 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" event={"ID":"924a9d74-9241-4ce3-b95c-e513695b73e7","Type":"ContainerDied","Data":"c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9"} Apr 17 18:12:25.764105 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.764073 2574 scope.go:117] "RemoveContainer" containerID="5f40f0a3b6898930eb2026bed3b011c72630981dec8c48a8c3c07e97ebbb8257" Apr 17 18:12:25.764278 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.764257 2574 scope.go:117] "RemoveContainer" containerID="c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9" Apr 17 18:12:25.764550 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:25.764470 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-z9xc6_openshift-console-operator(924a9d74-9241-4ce3-b95c-e513695b73e7)\"" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" podUID="924a9d74-9241-4ce3-b95c-e513695b73e7" Apr 17 18:12:25.869969 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:25.869939 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj"] Apr 17 18:12:25.872702 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:25.872680 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a0f856_6ff0_4be0_a0ca_35f7df85b28a.slice/crio-1adeb422b12c44b9d2ce3607c9e7e69ccaba241b4107e50f4857696edacaa678 WatchSource:0}: Error finding container 1adeb422b12c44b9d2ce3607c9e7e69ccaba241b4107e50f4857696edacaa678: Status 404 returned error can't find the container with id 1adeb422b12c44b9d2ce3607c9e7e69ccaba241b4107e50f4857696edacaa678 Apr 17 18:12:26.767760 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:26.767736 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:12:26.768153 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:26.768073 2574 scope.go:117] "RemoveContainer" containerID="c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9" Apr 17 18:12:26.768283 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:26.768260 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-z9xc6_openshift-console-operator(924a9d74-9241-4ce3-b95c-e513695b73e7)\"" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" podUID="924a9d74-9241-4ce3-b95c-e513695b73e7" Apr 17 18:12:26.768819 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:26.768794 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" event={"ID":"10a0f856-6ff0-4be0-a0ca-35f7df85b28a","Type":"ContainerStarted","Data":"1adeb422b12c44b9d2ce3607c9e7e69ccaba241b4107e50f4857696edacaa678"} Apr 17 18:12:27.660772 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.660739 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-865cb79987-v45ct"] Apr 17 18:12:27.663641 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.663614 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.666218 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.666198 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Apr 17 18:12:27.667249 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.667225 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Apr 17 18:12:27.667346 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.667240 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Apr 17 18:12:27.667397 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.667360 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4ztqg\"" Apr 17 18:12:27.667464 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.667448 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Apr 17 18:12:27.670698 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.670675 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-865cb79987-v45ct"] Apr 17 18:12:27.713828 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.713805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-key\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.713918 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.713865 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fb97\" (UniqueName: \"kubernetes.io/projected/4d82b3e8-9700-4585-baee-66c5d3a48d93-kube-api-access-2fb97\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.713977 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.713936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-cabundle\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.772894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.772866 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" event={"ID":"10a0f856-6ff0-4be0-a0ca-35f7df85b28a","Type":"ContainerStarted","Data":"ba1c115da37bc5c0d4c7608ab0a2f809cae10dfa93659ae85633177df60b6ed7"} Apr 17 18:12:27.773192 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.772902 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" event={"ID":"10a0f856-6ff0-4be0-a0ca-35f7df85b28a","Type":"ContainerStarted","Data":"b5f5ebf42756fd11c26d7604a9861c8d80a03934b91fc1ef0839fccbb0363ab4"} Apr 17 18:12:27.787606 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.787564 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-tnftj" podStartSLOduration=1.64921813 podStartE2EDuration="2.787553099s" podCreationTimestamp="2026-04-17 18:12:25 +0000 UTC" firstStartedPulling="2026-04-17 18:12:25.87454808 +0000 UTC m=+138.210048027" lastFinishedPulling="2026-04-17 18:12:27.012883058 +0000 UTC m=+139.348382996" observedRunningTime="2026-04-17 18:12:27.787445197 +0000 UTC m=+140.122945152" watchObservedRunningTime="2026-04-17 18:12:27.787553099 +0000 UTC m=+140.123053054" Apr 17 18:12:27.814820 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.814803 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-cabundle\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.814908 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.814829 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-key\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.814908 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.814878 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fb97\" (UniqueName: \"kubernetes.io/projected/4d82b3e8-9700-4585-baee-66c5d3a48d93-kube-api-access-2fb97\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.815425 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.815405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-cabundle\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.817266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.817246 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4d82b3e8-9700-4585-baee-66c5d3a48d93-signing-key\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.822935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.822913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fb97\" (UniqueName: \"kubernetes.io/projected/4d82b3e8-9700-4585-baee-66c5d3a48d93-kube-api-access-2fb97\") pod \"service-ca-865cb79987-v45ct\" (UID: \"4d82b3e8-9700-4585-baee-66c5d3a48d93\") " pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:27.972918 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:27.972859 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-865cb79987-v45ct" Apr 17 18:12:28.079568 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:28.079543 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-865cb79987-v45ct"] Apr 17 18:12:28.082777 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:28.082752 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d82b3e8_9700_4585_baee_66c5d3a48d93.slice/crio-00e7fb7f511e62c877c9f6fa00f4ebc18cd495c80c666ead20dbe4303fd278f7 WatchSource:0}: Error finding container 00e7fb7f511e62c877c9f6fa00f4ebc18cd495c80c666ead20dbe4303fd278f7: Status 404 returned error can't find the container with id 00e7fb7f511e62c877c9f6fa00f4ebc18cd495c80c666ead20dbe4303fd278f7 Apr 17 18:12:28.344571 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:28.344516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2mxld_7bd121bc-4898-442f-bbbb-e673a5c42e8d/dns-node-resolver/0.log" Apr 17 18:12:28.776816 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:28.776773 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-865cb79987-v45ct" event={"ID":"4d82b3e8-9700-4585-baee-66c5d3a48d93","Type":"ContainerStarted","Data":"00e7fb7f511e62c877c9f6fa00f4ebc18cd495c80c666ead20dbe4303fd278f7"} Apr 17 18:12:28.925322 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:28.925286 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:28.925474 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:28.925428 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Apr 17 18:12:28.925474 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:28.925446 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d9dc6798b-5nkml: secret "image-registry-tls" not found Apr 17 18:12:28.925557 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:28.925505 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls podName:8117fe13-a8cb-40fa-b1b5-facaa80ba064 nodeName:}" failed. No retries permitted until 2026-04-17 18:12:36.925484154 +0000 UTC m=+149.260984102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls") pod "image-registry-5d9dc6798b-5nkml" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064") : secret "image-registry-tls" not found Apr 17 18:12:29.344960 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:29.344932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6sq4b_3f583aa9-f0c5-4df6-baa8-1e00e0442078/node-ca/0.log" Apr 17 18:12:30.745939 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:30.745910 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-tnftj_10a0f856-6ff0-4be0-a0ca-35f7df85b28a/migrator/0.log" Apr 17 18:12:30.784712 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:30.784613 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-865cb79987-v45ct" event={"ID":"4d82b3e8-9700-4585-baee-66c5d3a48d93","Type":"ContainerStarted","Data":"be4af35ad4dd244b3538409b7e02ca249ed7ae23d757e3b8e26089e3dbe36dfc"} Apr 17 18:12:30.799969 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:30.799925 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-865cb79987-v45ct" podStartSLOduration=2.072569748 podStartE2EDuration="3.799912406s" podCreationTimestamp="2026-04-17 18:12:27 +0000 UTC" firstStartedPulling="2026-04-17 18:12:28.084936148 +0000 UTC m=+140.420436083" lastFinishedPulling="2026-04-17 18:12:29.812278803 +0000 UTC m=+142.147778741" observedRunningTime="2026-04-17 18:12:30.799596824 +0000 UTC m=+143.135096782" watchObservedRunningTime="2026-04-17 18:12:30.799912406 +0000 UTC m=+143.135412394" Apr 17 18:12:30.947581 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:30.947536 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-tnftj_10a0f856-6ff0-4be0-a0ca-35f7df85b28a/graceful-termination/0.log" Apr 17 18:12:31.502683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:31.502655 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:31.502683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:31.502688 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:31.503003 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:31.502992 2574 scope.go:117] "RemoveContainer" containerID="c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9" Apr 17 18:12:31.503152 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:31.503138 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-9d4b6777b-z9xc6_openshift-console-operator(924a9d74-9241-4ce3-b95c-e513695b73e7)\"" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" podUID="924a9d74-9241-4ce3-b95c-e513695b73e7" Apr 17 18:12:36.983530 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:36.983495 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:36.985828 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:36.985798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"image-registry-5d9dc6798b-5nkml\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:37.107280 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.107256 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:37.237664 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.237588 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:12:37.242748 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:37.242722 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8117fe13_a8cb_40fa_b1b5_facaa80ba064.slice/crio-b5f5dd79e9f264aee33f6836991657f739082f184fd514e84d580ec5152849a1 WatchSource:0}: Error finding container b5f5dd79e9f264aee33f6836991657f739082f184fd514e84d580ec5152849a1: Status 404 returned error can't find the container with id b5f5dd79e9f264aee33f6836991657f739082f184fd514e84d580ec5152849a1 Apr 17 18:12:37.804749 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.804708 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" event={"ID":"8117fe13-a8cb-40fa-b1b5-facaa80ba064","Type":"ContainerStarted","Data":"dbf7c7b7fed4bab4157bef8c88638ab8ed1453cdbc823373ec1d77a59f13033b"} Apr 17 18:12:37.804749 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.804752 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" event={"ID":"8117fe13-a8cb-40fa-b1b5-facaa80ba064","Type":"ContainerStarted","Data":"b5f5dd79e9f264aee33f6836991657f739082f184fd514e84d580ec5152849a1"} Apr 17 18:12:37.804940 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.804833 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:12:37.823017 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:37.822975 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" podStartSLOduration=16.822965406 podStartE2EDuration="16.822965406s" podCreationTimestamp="2026-04-17 18:12:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:12:37.822689614 +0000 UTC m=+150.158189569" watchObservedRunningTime="2026-04-17 18:12:37.822965406 +0000 UTC m=+150.158465361" Apr 17 18:12:42.009652 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:42.009585 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fmmdc" podUID="b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9" Apr 17 18:12:42.023818 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:42.023791 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8mp25" podUID="20e3ddf2-2561-496a-8a56-350b145462b9" Apr 17 18:12:42.816900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:42.816859 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:12:42.816900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:42.816875 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmmdc" Apr 17 18:12:43.305161 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:43.305121 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-snrz7" podUID="f716dbf1-bcde-4892-b9da-62d55e29f521" Apr 17 18:12:46.294098 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.294067 2574 scope.go:117] "RemoveContainer" containerID="c3065d00d8ec4ebd4892b77be7eb5332ed2843ff4608a5fb4a6bcdbf72cdb8a9" Apr 17 18:12:46.828358 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.828333 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:12:46.828483 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.828413 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" event={"ID":"924a9d74-9241-4ce3-b95c-e513695b73e7","Type":"ContainerStarted","Data":"2619067bacf19f99d567fce68b9c4e3b8d570599e5a63b8d20309ec46effe9e7"} Apr 17 18:12:46.828686 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.828667 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:46.845351 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.845314 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" podStartSLOduration=23.182084464 podStartE2EDuration="25.845303661s" podCreationTimestamp="2026-04-17 18:12:21 +0000 UTC" firstStartedPulling="2026-04-17 18:12:21.843820512 +0000 UTC m=+134.179320446" lastFinishedPulling="2026-04-17 18:12:24.50703969 +0000 UTC m=+136.842539643" observedRunningTime="2026-04-17 18:12:46.843508916 +0000 UTC m=+159.179008882" watchObservedRunningTime="2026-04-17 18:12:46.845303661 +0000 UTC m=+159.180803616" Apr 17 18:12:46.951902 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.951880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:12:46.952048 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.951913 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:12:46.954189 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.954167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9-metrics-tls\") pod \"dns-default-fmmdc\" (UID: \"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9\") " pod="openshift-dns/dns-default-fmmdc" Apr 17 18:12:46.954324 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.954309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e3ddf2-2561-496a-8a56-350b145462b9-cert\") pod \"ingress-canary-8mp25\" (UID: \"20e3ddf2-2561-496a-8a56-350b145462b9\") " pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:12:46.966752 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:46.966731 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-9d4b6777b-z9xc6" Apr 17 18:12:47.020089 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.020060 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hwgzd\"" Apr 17 18:12:47.020934 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.020918 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-46dtx\"" Apr 17 18:12:47.028092 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.028076 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmmdc" Apr 17 18:12:47.028154 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.028142 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8mp25" Apr 17 18:12:47.166332 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.166229 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmmdc"] Apr 17 18:12:47.168694 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:47.168668 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68cdfe5_fff2_4e67_b370_34c8a2b4fdc9.slice/crio-d0df6ac69cabc56ec61d430b29f8c2b44c405eaee4fe38b5d0e3239b023b33ac WatchSource:0}: Error finding container d0df6ac69cabc56ec61d430b29f8c2b44c405eaee4fe38b5d0e3239b023b33ac: Status 404 returned error can't find the container with id d0df6ac69cabc56ec61d430b29f8c2b44c405eaee4fe38b5d0e3239b023b33ac Apr 17 18:12:47.183123 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.183098 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8mp25"] Apr 17 18:12:47.185617 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:47.185584 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e3ddf2_2561_496a_8a56_350b145462b9.slice/crio-75d999f2830951773bad45cedfce2946ab7a4c8bb3b375c0d7871024b41bc7c0 WatchSource:0}: Error finding container 75d999f2830951773bad45cedfce2946ab7a4c8bb3b375c0d7871024b41bc7c0: Status 404 returned error can't find the container with id 75d999f2830951773bad45cedfce2946ab7a4c8bb3b375c0d7871024b41bc7c0 Apr 17 18:12:47.483720 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.483695 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:12:47.508701 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.508680 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6bcc868b7-9b9km"] Apr 17 18:12:47.511476 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.511461 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:12:47.515334 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.515277 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 17 18:12:47.515334 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.515292 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6f7jv\"" Apr 17 18:12:47.515334 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.515308 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 17 18:12:47.526278 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.525884 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l65jn"] Apr 17 18:12:47.529317 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.529178 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-9b9km"] Apr 17 18:12:47.529317 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.529305 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.532716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.532300 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 17 18:12:47.532716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.532440 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 17 18:12:47.532716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.532505 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s42m7\"" Apr 17 18:12:47.549315 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.549296 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l65jn"] Apr 17 18:12:47.656001 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.655969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.656136 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.656020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxltv\" (UniqueName: \"kubernetes.io/projected/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-api-access-fxltv\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.656136 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.656054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e423360-4d0b-459d-8174-d607ee0e67ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.656136 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.656091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2clz\" (UniqueName: \"kubernetes.io/projected/5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7-kube-api-access-v2clz\") pod \"downloads-6bcc868b7-9b9km\" (UID: \"5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7\") " pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:12:47.656136 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.656127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e423360-4d0b-459d-8174-d607ee0e67ba-crio-socket\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.656284 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.656160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e423360-4d0b-459d-8174-d607ee0e67ba-data-volume\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757340 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxltv\" (UniqueName: \"kubernetes.io/projected/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-api-access-fxltv\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757387 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e423360-4d0b-459d-8174-d607ee0e67ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757425 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2clz\" (UniqueName: \"kubernetes.io/projected/5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7-kube-api-access-v2clz\") pod \"downloads-6bcc868b7-9b9km\" (UID: \"5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7\") " pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:12:47.757623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757457 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e423360-4d0b-459d-8174-d607ee0e67ba-crio-socket\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757487 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e423360-4d0b-459d-8174-d607ee0e67ba-data-volume\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757557 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.757848 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.757736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e423360-4d0b-459d-8174-d607ee0e67ba-crio-socket\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.758212 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.758183 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.758702 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.758658 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e423360-4d0b-459d-8174-d607ee0e67ba-data-volume\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.761183 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.761161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e423360-4d0b-459d-8174-d607ee0e67ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.769269 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.769225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxltv\" (UniqueName: \"kubernetes.io/projected/3e423360-4d0b-459d-8174-d607ee0e67ba-kube-api-access-fxltv\") pod \"insights-runtime-extractor-l65jn\" (UID: \"3e423360-4d0b-459d-8174-d607ee0e67ba\") " pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:47.770072 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.770049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2clz\" (UniqueName: \"kubernetes.io/projected/5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7-kube-api-access-v2clz\") pod \"downloads-6bcc868b7-9b9km\" (UID: \"5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7\") " pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:12:47.822268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.822242 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:12:47.835276 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.835228 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8mp25" event={"ID":"20e3ddf2-2561-496a-8a56-350b145462b9","Type":"ContainerStarted","Data":"75d999f2830951773bad45cedfce2946ab7a4c8bb3b375c0d7871024b41bc7c0"} Apr 17 18:12:47.836936 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.836911 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmmdc" event={"ID":"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9","Type":"ContainerStarted","Data":"d0df6ac69cabc56ec61d430b29f8c2b44c405eaee4fe38b5d0e3239b023b33ac"} Apr 17 18:12:47.841120 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:47.841078 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l65jn" Apr 17 18:12:48.007290 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:48.007237 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-9b9km"] Apr 17 18:12:48.010667 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:48.010604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b5f60fe_5af8_4769_a8ea_9bcdbda2f1f7.slice/crio-8318443984e915671ac19baef2898fbeb4ac9284ed9f62868dce1e96ee6a419e WatchSource:0}: Error finding container 8318443984e915671ac19baef2898fbeb4ac9284ed9f62868dce1e96ee6a419e: Status 404 returned error can't find the container with id 8318443984e915671ac19baef2898fbeb4ac9284ed9f62868dce1e96ee6a419e Apr 17 18:12:48.026439 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:48.026400 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l65jn"] Apr 17 18:12:48.029324 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:48.029298 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e423360_4d0b_459d_8174_d607ee0e67ba.slice/crio-9f73ac32be737954f88a584ba7916e50161c1927479fd6a7f0644aa3c876907a WatchSource:0}: Error finding container 9f73ac32be737954f88a584ba7916e50161c1927479fd6a7f0644aa3c876907a: Status 404 returned error can't find the container with id 9f73ac32be737954f88a584ba7916e50161c1927479fd6a7f0644aa3c876907a Apr 17 18:12:48.841463 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:48.841417 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-9b9km" event={"ID":"5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7","Type":"ContainerStarted","Data":"8318443984e915671ac19baef2898fbeb4ac9284ed9f62868dce1e96ee6a419e"} Apr 17 18:12:48.843020 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:48.842989 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l65jn" event={"ID":"3e423360-4d0b-459d-8174-d607ee0e67ba","Type":"ContainerStarted","Data":"a915a2726cebd9150415876cefe91d65abfa5dbf482216501be089cbe3a7a567"} Apr 17 18:12:48.843151 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:48.843023 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l65jn" event={"ID":"3e423360-4d0b-459d-8174-d607ee0e67ba","Type":"ContainerStarted","Data":"9f73ac32be737954f88a584ba7916e50161c1927479fd6a7f0644aa3c876907a"} Apr 17 18:12:49.848900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.848858 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmmdc" event={"ID":"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9","Type":"ContainerStarted","Data":"96b742c5662968c033ef2f5a8c8e7e4d2eebf97676049308199e0cbee065bc11"} Apr 17 18:12:49.848900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.848904 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmmdc" event={"ID":"b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9","Type":"ContainerStarted","Data":"0c6109506f41ffb0e2bb020001742f1f77f734bdea996dfb9e886d6a1a5baac9"} Apr 17 18:12:49.849766 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.849739 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fmmdc" Apr 17 18:12:49.851458 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.851414 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8mp25" event={"ID":"20e3ddf2-2561-496a-8a56-350b145462b9","Type":"ContainerStarted","Data":"bcdc9e067eee702d509bcd56bf29ccb60c1a457c31e8de39594d14a6895eb247"} Apr 17 18:12:49.853408 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.853370 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l65jn" event={"ID":"3e423360-4d0b-459d-8174-d607ee0e67ba","Type":"ContainerStarted","Data":"15aa1cedfd7f367dbb631126717233ac404d5ec90bd130c55c7fbdde269cf84e"} Apr 17 18:12:49.868998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.868945 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fmmdc" podStartSLOduration=130.0300535 podStartE2EDuration="2m11.868931502s" podCreationTimestamp="2026-04-17 18:10:38 +0000 UTC" firstStartedPulling="2026-04-17 18:12:47.170469665 +0000 UTC m=+159.505969600" lastFinishedPulling="2026-04-17 18:12:49.009347657 +0000 UTC m=+161.344847602" observedRunningTime="2026-04-17 18:12:49.868277034 +0000 UTC m=+162.203776981" watchObservedRunningTime="2026-04-17 18:12:49.868931502 +0000 UTC m=+162.204431459" Apr 17 18:12:49.884123 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:49.884084 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8mp25" podStartSLOduration=130.059539977 podStartE2EDuration="2m11.884069282s" podCreationTimestamp="2026-04-17 18:10:38 +0000 UTC" firstStartedPulling="2026-04-17 18:12:47.187932005 +0000 UTC m=+159.523431953" lastFinishedPulling="2026-04-17 18:12:49.012461316 +0000 UTC m=+161.347961258" observedRunningTime="2026-04-17 18:12:49.88303987 +0000 UTC m=+162.218539829" watchObservedRunningTime="2026-04-17 18:12:49.884069282 +0000 UTC m=+162.219569239" Apr 17 18:12:50.857551 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:50.857502 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l65jn" event={"ID":"3e423360-4d0b-459d-8174-d607ee0e67ba","Type":"ContainerStarted","Data":"835c2985bf62f346c4ee59545d5253a796739191c8fca43bdbda3c0643e7446d"} Apr 17 18:12:50.875066 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:50.875014 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l65jn" podStartSLOduration=1.3036194509999999 podStartE2EDuration="3.875003393s" podCreationTimestamp="2026-04-17 18:12:47 +0000 UTC" firstStartedPulling="2026-04-17 18:12:48.105983287 +0000 UTC m=+160.441483224" lastFinishedPulling="2026-04-17 18:12:50.677367216 +0000 UTC m=+163.012867166" observedRunningTime="2026-04-17 18:12:50.874311794 +0000 UTC m=+163.209811749" watchObservedRunningTime="2026-04-17 18:12:50.875003393 +0000 UTC m=+163.210503340" Apr 17 18:12:55.685603 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.685569 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4"] Apr 17 18:12:55.689950 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.689919 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:55.692437 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.692411 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 17 18:12:55.692520 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.692483 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p5lg6\"" Apr 17 18:12:55.695589 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.695564 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4"] Apr 17 18:12:55.821129 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.821097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-rhdb4\" (UID: \"2887597d-dd0f-461b-93ec-713b7e01806a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:55.922379 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:55.922348 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-rhdb4\" (UID: \"2887597d-dd0f-461b-93ec-713b7e01806a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:55.922535 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:55.922500 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Apr 17 18:12:55.922598 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:12:55.922575 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates podName:2887597d-dd0f-461b-93ec-713b7e01806a nodeName:}" failed. No retries permitted until 2026-04-17 18:12:56.422554608 +0000 UTC m=+168.758054561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates") pod "prometheus-operator-admission-webhook-57cf98b594-rhdb4" (UID: "2887597d-dd0f-461b-93ec-713b7e01806a") : secret "prometheus-operator-admission-webhook-tls" not found Apr 17 18:12:56.425574 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:56.425535 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-rhdb4\" (UID: \"2887597d-dd0f-461b-93ec-713b7e01806a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:56.427885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:56.427853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2887597d-dd0f-461b-93ec-713b7e01806a-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-rhdb4\" (UID: \"2887597d-dd0f-461b-93ec-713b7e01806a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:56.601587 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:56.601560 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:56.727910 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:56.727880 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4"] Apr 17 18:12:56.732249 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:56.732218 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2887597d_dd0f_461b_93ec_713b7e01806a.slice/crio-06ffc585ba1a982626f97c194adfaefa8d1d28af1e6c1090322acc6d0b7d252d WatchSource:0}: Error finding container 06ffc585ba1a982626f97c194adfaefa8d1d28af1e6c1090322acc6d0b7d252d: Status 404 returned error can't find the container with id 06ffc585ba1a982626f97c194adfaefa8d1d28af1e6c1090322acc6d0b7d252d Apr 17 18:12:56.875962 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:56.875928 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" event={"ID":"2887597d-dd0f-461b-93ec-713b7e01806a","Type":"ContainerStarted","Data":"06ffc585ba1a982626f97c194adfaefa8d1d28af1e6c1090322acc6d0b7d252d"} Apr 17 18:12:57.056125 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.056057 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:12:57.060702 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.060677 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.064351 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064329 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 17 18:12:57.064482 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064410 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 17 18:12:57.064482 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064447 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lwnmm\"" Apr 17 18:12:57.064619 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064489 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 17 18:12:57.064619 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064507 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 17 18:12:57.064619 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.064546 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 17 18:12:57.070075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.070055 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:12:57.132124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.132256 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.132256 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.132256 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f99m\" (UniqueName: \"kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.132410 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.132410 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.132289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232601 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232572 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f99m\" (UniqueName: \"kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232656 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232724 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232794 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.232916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.232827 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.233538 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.233487 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.233538 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.233497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.233538 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.233523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.236156 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.236115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.236354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.236327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.241103 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.241074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f99m\" (UniqueName: \"kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m\") pod \"console-7ff4d8547d-vr4cq\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.293894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.293866 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:12:57.373504 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.373401 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:12:57.489238 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.489206 2574 patch_prober.go:28] interesting pod/image-registry-5d9dc6798b-5nkml container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Apr 17 18:12:57.489360 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.489267 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Apr 17 18:12:57.506680 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.506612 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:12:57.785150 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:12:57.785075 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cd90fc_a8cb_454f_995d_d5d566176515.slice/crio-4d8f7ec5125b07e820499a0d7ba6819e3b89b22ab74051a9bddb36f06454582a WatchSource:0}: Error finding container 4d8f7ec5125b07e820499a0d7ba6819e3b89b22ab74051a9bddb36f06454582a: Status 404 returned error can't find the container with id 4d8f7ec5125b07e820499a0d7ba6819e3b89b22ab74051a9bddb36f06454582a Apr 17 18:12:57.880374 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:57.880349 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff4d8547d-vr4cq" event={"ID":"b9cd90fc-a8cb-454f-995d-d5d566176515","Type":"ContainerStarted","Data":"4d8f7ec5125b07e820499a0d7ba6819e3b89b22ab74051a9bddb36f06454582a"} Apr 17 18:12:58.885244 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:58.885206 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" event={"ID":"2887597d-dd0f-461b-93ec-713b7e01806a","Type":"ContainerStarted","Data":"05cca5c18365f9201fe732d233db49df83a935ba3e4f5eb7311be50e6f33f555"} Apr 17 18:12:58.885673 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:58.885426 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:58.890703 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:58.890682 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" Apr 17 18:12:58.905434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:58.905382 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-rhdb4" podStartSLOduration=2.79914346 podStartE2EDuration="3.905366538s" podCreationTimestamp="2026-04-17 18:12:55 +0000 UTC" firstStartedPulling="2026-04-17 18:12:56.734821872 +0000 UTC m=+169.070321808" lastFinishedPulling="2026-04-17 18:12:57.841044951 +0000 UTC m=+170.176544886" observedRunningTime="2026-04-17 18:12:58.904312259 +0000 UTC m=+171.239812216" watchObservedRunningTime="2026-04-17 18:12:58.905366538 +0000 UTC m=+171.240866496" Apr 17 18:12:59.754175 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.754140 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-p8nd8"] Apr 17 18:12:59.758885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.758863 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.761574 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.761549 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 17 18:12:59.761682 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.761554 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 17 18:12:59.762560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.762537 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xgd2p\"" Apr 17 18:12:59.762674 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.762590 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 17 18:12:59.762809 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.762796 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 17 18:12:59.762866 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.762784 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 17 18:12:59.767037 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.767013 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-p8nd8"] Apr 17 18:12:59.854680 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.854647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.854817 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.854697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717793ea-4328-4db0-9f1b-32332e387b76-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.854817 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.854738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jk97\" (UniqueName: \"kubernetes.io/projected/717793ea-4328-4db0-9f1b-32332e387b76-kube-api-access-6jk97\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.854939 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.854843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.955822 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.955791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.956140 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.955855 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.956140 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.955886 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717793ea-4328-4db0-9f1b-32332e387b76-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.956140 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.955914 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jk97\" (UniqueName: \"kubernetes.io/projected/717793ea-4328-4db0-9f1b-32332e387b76-kube-api-access-6jk97\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.956643 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.956603 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/717793ea-4328-4db0-9f1b-32332e387b76-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.958430 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.958407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.958575 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.958551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/717793ea-4328-4db0-9f1b-32332e387b76-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:12:59.966593 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:12:59.966574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jk97\" (UniqueName: \"kubernetes.io/projected/717793ea-4328-4db0-9f1b-32332e387b76-kube-api-access-6jk97\") pod \"prometheus-operator-5676c8c784-p8nd8\" (UID: \"717793ea-4328-4db0-9f1b-32332e387b76\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:13:00.069794 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:00.069733 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" Apr 17 18:13:00.863994 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:00.863965 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fmmdc" Apr 17 18:13:04.556645 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.556603 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-p8nd8"] Apr 17 18:13:04.583083 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:04.583060 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717793ea_4328_4db0_9f1b_32332e387b76.slice/crio-db5431691e81d032667bf253bc0cf2bebbbeebffd0c8666b6e2f31758babd2af WatchSource:0}: Error finding container db5431691e81d032667bf253bc0cf2bebbbeebffd0c8666b6e2f31758babd2af: Status 404 returned error can't find the container with id db5431691e81d032667bf253bc0cf2bebbbeebffd0c8666b6e2f31758babd2af Apr 17 18:13:04.904537 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.904457 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-9b9km" event={"ID":"5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7","Type":"ContainerStarted","Data":"ff66772044f570be9a464c4b012d3094039d9f108158568de1eaefd83575da63"} Apr 17 18:13:04.904857 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.904830 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:13:04.906614 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.906537 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" event={"ID":"717793ea-4328-4db0-9f1b-32332e387b76","Type":"ContainerStarted","Data":"db5431691e81d032667bf253bc0cf2bebbbeebffd0c8666b6e2f31758babd2af"} Apr 17 18:13:04.913733 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.913710 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6bcc868b7-9b9km" Apr 17 18:13:04.922334 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:04.922265 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-6bcc868b7-9b9km" podStartSLOduration=1.303599701 podStartE2EDuration="17.922249175s" podCreationTimestamp="2026-04-17 18:12:47 +0000 UTC" firstStartedPulling="2026-04-17 18:12:48.013205632 +0000 UTC m=+160.348705574" lastFinishedPulling="2026-04-17 18:13:04.631855111 +0000 UTC m=+176.967355048" observedRunningTime="2026-04-17 18:13:04.922250932 +0000 UTC m=+177.257750887" watchObservedRunningTime="2026-04-17 18:13:04.922249175 +0000 UTC m=+177.257749132" Apr 17 18:13:06.919453 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:06.919416 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" event={"ID":"717793ea-4328-4db0-9f1b-32332e387b76","Type":"ContainerStarted","Data":"d51f623c26b384a94ed625e66e3eb7e1b14525e0555fd1bdff2dee1227c36d6d"} Apr 17 18:13:07.488357 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:07.488321 2574 patch_prober.go:28] interesting pod/image-registry-5d9dc6798b-5nkml container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Apr 17 18:13:07.488520 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:07.488376 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Apr 17 18:13:07.925025 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:07.924986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" event={"ID":"717793ea-4328-4db0-9f1b-32332e387b76","Type":"ContainerStarted","Data":"6f4d0054b6c4e6993cb63582671c70df54c04866cec691010e9ce6219ae90a52"} Apr 17 18:13:07.942476 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:07.942432 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-p8nd8" podStartSLOduration=7.471429053 podStartE2EDuration="8.942417044s" podCreationTimestamp="2026-04-17 18:12:59 +0000 UTC" firstStartedPulling="2026-04-17 18:13:04.590111898 +0000 UTC m=+176.925611835" lastFinishedPulling="2026-04-17 18:13:06.061099879 +0000 UTC m=+178.396599826" observedRunningTime="2026-04-17 18:13:07.942375637 +0000 UTC m=+180.277875593" watchObservedRunningTime="2026-04-17 18:13:07.942417044 +0000 UTC m=+180.277916999" Apr 17 18:13:08.929687 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:08.929643 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff4d8547d-vr4cq" event={"ID":"b9cd90fc-a8cb-454f-995d-d5d566176515","Type":"ContainerStarted","Data":"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972"} Apr 17 18:13:08.951582 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:08.951531 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7ff4d8547d-vr4cq" podStartSLOduration=1.804658845 podStartE2EDuration="11.951516017s" podCreationTimestamp="2026-04-17 18:12:57 +0000 UTC" firstStartedPulling="2026-04-17 18:12:57.78745339 +0000 UTC m=+170.122953330" lastFinishedPulling="2026-04-17 18:13:07.934310556 +0000 UTC m=+180.269810502" observedRunningTime="2026-04-17 18:13:08.950968499 +0000 UTC m=+181.286468455" watchObservedRunningTime="2026-04-17 18:13:08.951516017 +0000 UTC m=+181.287015975" Apr 17 18:13:10.098032 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.097999 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2"] Apr 17 18:13:10.129584 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.128904 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2"] Apr 17 18:13:10.129584 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.129041 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.129584 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.129574 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p2ds5"] Apr 17 18:13:10.131566 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.131547 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 17 18:13:10.131735 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.131701 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gwqng\"" Apr 17 18:13:10.131975 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.131957 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 17 18:13:10.150320 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.150303 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.153401 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.153386 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 17 18:13:10.154727 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.154712 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 17 18:13:10.155656 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.154599 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 17 18:13:10.155819 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.155136 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f528l\"" Apr 17 18:13:10.242467 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.242621 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242621 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjd5b\" (UniqueName: \"kubernetes.io/projected/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-kube-api-access-mjd5b\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.242621 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-sys\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242621 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-root\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-textfile\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.242859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg5t5\" (UniqueName: \"kubernetes.io/projected/1e24df65-62f1-4dd6-86ed-f754f833cb7e-kube-api-access-tg5t5\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.243062 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-wtmp\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.243062 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.242951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-metrics-client-ca\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343247 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343299 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343338 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-root\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343410 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-textfile\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343434 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tg5t5\" (UniqueName: \"kubernetes.io/projected/1e24df65-62f1-4dd6-86ed-f754f833cb7e-kube-api-access-tg5t5\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343481 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-wtmp\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343512 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-metrics-client-ca\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343543 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343569 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjd5b\" (UniqueName: \"kubernetes.io/projected/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-kube-api-access-mjd5b\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343621 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-sys\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.343676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:10.345052 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:10.345111 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls podName:1e24df65-62f1-4dd6-86ed-f754f833cb7e nodeName:}" failed. No retries permitted until 2026-04-17 18:13:10.845091721 +0000 UTC m=+183.180591667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls") pod "node-exporter-p2ds5" (UID: "1e24df65-62f1-4dd6-86ed-f754f833cb7e") : secret "node-exporter-tls" not found Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.345846 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.346647 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:10.345942 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Apr 17 18:13:10.347647 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:10.345988 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls podName:00da0e2b-668d-4a0c-8482-78e5ff9fa33f nodeName:}" failed. No retries permitted until 2026-04-17 18:13:10.845972831 +0000 UTC m=+183.181472779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls") pod "openshift-state-metrics-9d44df66c-zdfc2" (UID: "00da0e2b-668d-4a0c-8482-78e5ff9fa33f") : secret "openshift-state-metrics-tls" not found Apr 17 18:13:10.347647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.346033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-root\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.347647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.346532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-textfile\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.347647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.347303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.347647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.347463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-wtmp\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.348722 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.347982 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e24df65-62f1-4dd6-86ed-f754f833cb7e-metrics-client-ca\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.351955 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.349380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e24df65-62f1-4dd6-86ed-f754f833cb7e-sys\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.351955 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.351840 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.356014 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.355976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.373539 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.373185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg5t5\" (UniqueName: \"kubernetes.io/projected/1e24df65-62f1-4dd6-86ed-f754f833cb7e-kube-api-access-tg5t5\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.382876 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.377913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjd5b\" (UniqueName: \"kubernetes.io/projected/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-kube-api-access-mjd5b\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.848462 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.848419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.848722 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.848476 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:10.851099 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.851066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e24df65-62f1-4dd6-86ed-f754f833cb7e-node-exporter-tls\") pod \"node-exporter-p2ds5\" (UID: \"1e24df65-62f1-4dd6-86ed-f754f833cb7e\") " pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:10.851218 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:10.851183 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00da0e2b-668d-4a0c-8482-78e5ff9fa33f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-zdfc2\" (UID: \"00da0e2b-668d-4a0c-8482-78e5ff9fa33f\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:11.040421 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.040391 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" Apr 17 18:13:11.062805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.062288 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p2ds5" Apr 17 18:13:11.071739 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:11.071691 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e24df65_62f1_4dd6_86ed_f754f833cb7e.slice/crio-25875d0d1104a6987961e8be5b274d8b36ff5eaa80151352797a86cc2d2ead81 WatchSource:0}: Error finding container 25875d0d1104a6987961e8be5b274d8b36ff5eaa80151352797a86cc2d2ead81: Status 404 returned error can't find the container with id 25875d0d1104a6987961e8be5b274d8b36ff5eaa80151352797a86cc2d2ead81 Apr 17 18:13:11.188047 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.188013 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2"] Apr 17 18:13:11.193040 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:11.193010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00da0e2b_668d_4a0c_8482_78e5ff9fa33f.slice/crio-834a7bd2affb3357b592a108bc1f778c58c9f1a002bbaae87b51aeb698c08569 WatchSource:0}: Error finding container 834a7bd2affb3357b592a108bc1f778c58c9f1a002bbaae87b51aeb698c08569: Status 404 returned error can't find the container with id 834a7bd2affb3357b592a108bc1f778c58c9f1a002bbaae87b51aeb698c08569 Apr 17 18:13:11.213674 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.213623 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:13:11.246831 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.246772 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:13:11.246983 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.246953 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.249702 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.249683 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 18:13:11.249797 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.249697 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r8k5h\"" Apr 17 18:13:11.249797 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.249745 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 18:13:11.249908 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.249795 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 18:13:11.249961 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.249918 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 18:13:11.250082 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.250060 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 18:13:11.250316 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.250300 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 18:13:11.250386 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.250313 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 18:13:11.250936 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.250917 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 18:13:11.251816 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.251603 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 18:13:11.353588 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtvv\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353790 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353878 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353878 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.353986 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353974 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.354174 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.353999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.354174 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.354043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.354174 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.354067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.354174 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.354091 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.354174 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.354139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455349 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455317 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455465 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455383 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtvv\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455465 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455423 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455465 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455450 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455599 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455474 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455599 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455522 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455599 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455547 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455599 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455580 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455796 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455603 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455796 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.455796 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.455700 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.457891 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:11.456578 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle podName:e35b69e9-4f68-4351-bccf-9d420a02238f nodeName:}" failed. No retries permitted until 2026-04-17 18:13:11.956555924 +0000 UTC m=+184.292055877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f") : configmap references non-existent config key: ca-bundle.crt Apr 17 18:13:11.457891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.456737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.457891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.456813 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.457891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.456853 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.457891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.457086 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.460586 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.460561 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.461513 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.461229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.461513 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.461358 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.461513 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.461468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.461513 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.461465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.462226 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.462052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.462431 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.462408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.462831 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.462790 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.463434 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.463412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.469446 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.469425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtvv\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.941323 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.941262 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2ds5" event={"ID":"1e24df65-62f1-4dd6-86ed-f754f833cb7e","Type":"ContainerStarted","Data":"25875d0d1104a6987961e8be5b274d8b36ff5eaa80151352797a86cc2d2ead81"} Apr 17 18:13:11.943643 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.943594 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" event={"ID":"00da0e2b-668d-4a0c-8482-78e5ff9fa33f","Type":"ContainerStarted","Data":"3a7e9c13bcd8a01a2a1bb560672f417e91403c858bcaf63bb86755f2888a0702"} Apr 17 18:13:11.943872 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.943670 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" event={"ID":"00da0e2b-668d-4a0c-8482-78e5ff9fa33f","Type":"ContainerStarted","Data":"6aa41d1c13d978b58e70e6c80cd873099ee7c7d169812f8665b9554241910036"} Apr 17 18:13:11.943872 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.943688 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" event={"ID":"00da0e2b-668d-4a0c-8482-78e5ff9fa33f","Type":"ContainerStarted","Data":"834a7bd2affb3357b592a108bc1f778c58c9f1a002bbaae87b51aeb698c08569"} Apr 17 18:13:11.962076 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.962045 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:11.962957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:11.962932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:12.215556 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.215492 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:13:12.359007 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.358978 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:13:12.498157 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:12.498085 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35b69e9_4f68_4351_bccf_9d420a02238f.slice/crio-3bb6916479fe78976ac2a61779f3411cbf759a5d7f27889107142e9e0e97e958 WatchSource:0}: Error finding container 3bb6916479fe78976ac2a61779f3411cbf759a5d7f27889107142e9e0e97e958: Status 404 returned error can't find the container with id 3bb6916479fe78976ac2a61779f3411cbf759a5d7f27889107142e9e0e97e958 Apr 17 18:13:12.501372 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.501333 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" containerID="cri-o://dbf7c7b7fed4bab4157bef8c88638ab8ed1453cdbc823373ec1d77a59f13033b" gracePeriod=30 Apr 17 18:13:12.949411 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.949376 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"3bb6916479fe78976ac2a61779f3411cbf759a5d7f27889107142e9e0e97e958"} Apr 17 18:13:12.951355 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.951321 2574 generic.go:358] "Generic (PLEG): container finished" podID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerID="dbf7c7b7fed4bab4157bef8c88638ab8ed1453cdbc823373ec1d77a59f13033b" exitCode=0 Apr 17 18:13:12.951477 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.951400 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" event={"ID":"8117fe13-a8cb-40fa-b1b5-facaa80ba064","Type":"ContainerDied","Data":"dbf7c7b7fed4bab4157bef8c88638ab8ed1453cdbc823373ec1d77a59f13033b"} Apr 17 18:13:12.953196 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:12.953169 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2ds5" event={"ID":"1e24df65-62f1-4dd6-86ed-f754f833cb7e","Type":"ContainerStarted","Data":"4440280f9ea049eb41d382861d1d620b6c77399583ac9e040e0cfda90cf3839a"} Apr 17 18:13:13.119124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.119099 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:13:13.173672 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173640 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.173799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173699 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkccf\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.173799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173726 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.173799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173747 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.173799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173771 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.173799 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173791 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.174049 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173823 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.174049 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173860 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca\") pod \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\" (UID: \"8117fe13-a8cb-40fa-b1b5-facaa80ba064\") " Apr 17 18:13:13.174049 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.173943 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:13:13.174169 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.174079 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-certificates\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.174311 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.174283 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:13:13.176987 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.176943 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf" (OuterVolumeSpecName: "kube-api-access-lkccf") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "kube-api-access-lkccf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:13:13.177224 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.177194 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:13:13.177747 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.177721 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:13:13.177825 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.177790 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:13:13.178584 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.178558 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:13:13.185571 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.185540 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8117fe13-a8cb-40fa-b1b5-facaa80ba064" (UID: "8117fe13-a8cb-40fa-b1b5-facaa80ba064"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 18:13:13.274484 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274459 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-installation-pull-secrets\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274484 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274483 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-bound-sa-token\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274494 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8117fe13-a8cb-40fa-b1b5-facaa80ba064-ca-trust-extracted\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274504 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8117fe13-a8cb-40fa-b1b5-facaa80ba064-trusted-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274514 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkccf\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-kube-api-access-lkccf\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274523 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8117fe13-a8cb-40fa-b1b5-facaa80ba064-image-registry-private-configuration\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.274891 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.274533 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8117fe13-a8cb-40fa-b1b5-facaa80ba064-registry-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:13.958823 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.958790 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" Apr 17 18:13:13.958980 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.958780 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d9dc6798b-5nkml" event={"ID":"8117fe13-a8cb-40fa-b1b5-facaa80ba064","Type":"ContainerDied","Data":"b5f5dd79e9f264aee33f6836991657f739082f184fd514e84d580ec5152849a1"} Apr 17 18:13:13.959040 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.958975 2574 scope.go:117] "RemoveContainer" containerID="dbf7c7b7fed4bab4157bef8c88638ab8ed1453cdbc823373ec1d77a59f13033b" Apr 17 18:13:13.961158 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.961030 2574 generic.go:358] "Generic (PLEG): container finished" podID="1e24df65-62f1-4dd6-86ed-f754f833cb7e" containerID="4440280f9ea049eb41d382861d1d620b6c77399583ac9e040e0cfda90cf3839a" exitCode=0 Apr 17 18:13:13.961158 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.961118 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2ds5" event={"ID":"1e24df65-62f1-4dd6-86ed-f754f833cb7e","Type":"ContainerDied","Data":"4440280f9ea049eb41d382861d1d620b6c77399583ac9e040e0cfda90cf3839a"} Apr 17 18:13:13.964758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.964172 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" event={"ID":"00da0e2b-668d-4a0c-8482-78e5ff9fa33f","Type":"ContainerStarted","Data":"4a6c6a95f34b62cb9e7cbbb66a1912ffa8bdbcbbbeb710a29125cc69ed257a2e"} Apr 17 18:13:13.999120 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:13.999079 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-zdfc2" podStartSLOduration=1.9786586019999999 podStartE2EDuration="3.999067976s" podCreationTimestamp="2026-04-17 18:13:10 +0000 UTC" firstStartedPulling="2026-04-17 18:13:11.565202426 +0000 UTC m=+183.900702361" lastFinishedPulling="2026-04-17 18:13:13.585611792 +0000 UTC m=+185.921111735" observedRunningTime="2026-04-17 18:13:13.997970341 +0000 UTC m=+186.333470297" watchObservedRunningTime="2026-04-17 18:13:13.999067976 +0000 UTC m=+186.334567965" Apr 17 18:13:14.013770 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.013747 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:13:14.019764 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.019740 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d9dc6798b-5nkml"] Apr 17 18:13:14.299476 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.299396 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" path="/var/lib/kubelet/pods/8117fe13-a8cb-40fa-b1b5-facaa80ba064/volumes" Apr 17 18:13:14.406317 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.406283 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d875b6bdf-5m8ph"] Apr 17 18:13:14.406660 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.406642 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" Apr 17 18:13:14.406735 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.406664 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" Apr 17 18:13:14.406735 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.406727 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="8117fe13-a8cb-40fa-b1b5-facaa80ba064" containerName="registry" Apr 17 18:13:14.421052 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.420974 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d875b6bdf-5m8ph"] Apr 17 18:13:14.421180 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.421137 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.424416 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.424386 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Apr 17 18:13:14.424903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.424866 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Apr 17 18:13:14.424903 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.424899 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5wq6t\"" Apr 17 18:13:14.425058 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.425025 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 18:13:14.425867 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.425845 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-676bkllaslheh\"" Apr 17 18:13:14.425867 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.425857 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Apr 17 18:13:14.482781 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.482755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-tls\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.482880 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.482808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-metrics-server-audit-profiles\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.482927 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.482879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-client-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.482981 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.482963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.483025 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.482989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41f0ad6e-b5a5-4562-bae1-0174a388470e-audit-log\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.483025 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.483010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-client-certs\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.483103 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.483073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7lnb\" (UniqueName: \"kubernetes.io/projected/41f0ad6e-b5a5-4562-bae1-0174a388470e-kube-api-access-q7lnb\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583508 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583478 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583616 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583512 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41f0ad6e-b5a5-4562-bae1-0174a388470e-audit-log\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583616 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583546 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-client-certs\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583616 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7lnb\" (UniqueName: \"kubernetes.io/projected/41f0ad6e-b5a5-4562-bae1-0174a388470e-kube-api-access-q7lnb\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583800 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583650 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-tls\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583800 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583692 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-metrics-server-audit-profiles\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.583800 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.583730 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-client-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.584305 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.584276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.584305 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.584293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41f0ad6e-b5a5-4562-bae1-0174a388470e-audit-log\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.585267 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.585234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41f0ad6e-b5a5-4562-bae1-0174a388470e-metrics-server-audit-profiles\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.586874 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.586836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-client-ca-bundle\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.587071 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.587040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-client-certs\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.587662 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.587600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41f0ad6e-b5a5-4562-bae1-0174a388470e-secret-metrics-server-tls\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.591495 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.591470 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7lnb\" (UniqueName: \"kubernetes.io/projected/41f0ad6e-b5a5-4562-bae1-0174a388470e-kube-api-access-q7lnb\") pod \"metrics-server-7d875b6bdf-5m8ph\" (UID: \"41f0ad6e-b5a5-4562-bae1-0174a388470e\") " pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.733014 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.732979 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:14.891741 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.891714 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p"] Apr 17 18:13:14.915461 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.915439 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p"] Apr 17 18:13:14.915563 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.915552 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:14.921864 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.918506 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 17 18:13:14.921864 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.918672 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-pdcdc\"" Apr 17 18:13:14.970885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.970814 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2ds5" event={"ID":"1e24df65-62f1-4dd6-86ed-f754f833cb7e","Type":"ContainerStarted","Data":"f8dc87691d88e9312675d016d32578ab600523c471632665fb4cfe7e769f42d7"} Apr 17 18:13:14.970885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.970858 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p2ds5" event={"ID":"1e24df65-62f1-4dd6-86ed-f754f833cb7e","Type":"ContainerStarted","Data":"fc8ee1e6b9b64c2cf090ccab7dee817862263c8bd5f3fd14ebfb474544fb2898"} Apr 17 18:13:14.987949 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.987924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-dcv7p\" (UID: \"85f584da-e5e6-4e89-a6b2-a11e0da71f80\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:14.988920 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.988883 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p2ds5" podStartSLOduration=3.538625984 podStartE2EDuration="4.988870241s" podCreationTimestamp="2026-04-17 18:13:10 +0000 UTC" firstStartedPulling="2026-04-17 18:13:11.073906931 +0000 UTC m=+183.409406866" lastFinishedPulling="2026-04-17 18:13:12.524151174 +0000 UTC m=+184.859651123" observedRunningTime="2026-04-17 18:13:14.987994238 +0000 UTC m=+187.323494194" watchObservedRunningTime="2026-04-17 18:13:14.988870241 +0000 UTC m=+187.324370203" Apr 17 18:13:14.993520 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:14.993502 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d875b6bdf-5m8ph"] Apr 17 18:13:14.997531 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:14.997503 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f0ad6e_b5a5_4562_bae1_0174a388470e.slice/crio-e333382094a02387eb9d1407f8234c697207d42f43a9acbf3a4863889c469568 WatchSource:0}: Error finding container e333382094a02387eb9d1407f8234c697207d42f43a9acbf3a4863889c469568: Status 404 returned error can't find the container with id e333382094a02387eb9d1407f8234c697207d42f43a9acbf3a4863889c469568 Apr 17 18:13:15.088592 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.088562 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-dcv7p\" (UID: \"85f584da-e5e6-4e89-a6b2-a11e0da71f80\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:15.088739 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:15.088715 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Apr 17 18:13:15.088789 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:15.088782 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert podName:85f584da-e5e6-4e89-a6b2-a11e0da71f80 nodeName:}" failed. No retries permitted until 2026-04-17 18:13:15.588767394 +0000 UTC m=+187.924267328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert") pod "monitoring-plugin-7dccd58f55-dcv7p" (UID: "85f584da-e5e6-4e89-a6b2-a11e0da71f80") : secret "monitoring-plugin-cert" not found Apr 17 18:13:15.592490 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.592463 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-dcv7p\" (UID: \"85f584da-e5e6-4e89-a6b2-a11e0da71f80\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:15.594710 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.594692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/85f584da-e5e6-4e89-a6b2-a11e0da71f80-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-dcv7p\" (UID: \"85f584da-e5e6-4e89-a6b2-a11e0da71f80\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:15.831454 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.831424 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:15.948360 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.948326 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p"] Apr 17 18:13:15.975184 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.975157 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f" exitCode=0 Apr 17 18:13:15.975335 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.975263 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f"} Apr 17 18:13:15.976403 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:15.976378 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" event={"ID":"41f0ad6e-b5a5-4562-bae1-0174a388470e","Type":"ContainerStarted","Data":"e333382094a02387eb9d1407f8234c697207d42f43a9acbf3a4863889c469568"} Apr 17 18:13:16.298676 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.298582 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:13:16.362494 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.362458 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:13:16.392994 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.392967 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:13:16.393145 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.393068 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396588 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396653 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396660 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396785 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396838 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 18:13:16.397000 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.396982 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 18:13:16.397409 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.397065 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 18:13:16.398138 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398111 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 18:13:16.398429 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398255 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 18:13:16.398429 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398319 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 18:13:16.398429 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398326 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw7dh\"" Apr 17 18:13:16.398429 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398373 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 18:13:16.398714 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.398451 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f1va360jaralp\"" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.401960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.402137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.402030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wp2q\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404724 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.405906 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.404800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.407178 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.407130 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 18:13:16.506050 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506020 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506051 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506071 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506091 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506109 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506124 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506508 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506671 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506553 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506766 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506709 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506766 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506741 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wp2q\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506880 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506779 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506880 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506813 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.506880 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506860 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506894 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506899 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506927 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506952 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.506979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507036 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.507006 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507319 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.507038 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.507319 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.507217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.508197 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.508171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.510169 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.510119 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.510275 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.510190 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.511830 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.511785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.512071 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.512047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.512474 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.512423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.512671 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.512583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.512671 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.512585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.512671 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.512591 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.513056 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.513017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.513509 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.513327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.514755 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.514481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.514755 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.514497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.514755 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.514550 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.516355 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.516333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wp2q\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q\") pod \"prometheus-k8s-0\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.708597 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.708567 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:16.852340 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.852314 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:13:16.869560 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.869535 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:13:16.869706 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.869660 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.879218 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.879193 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 17 18:13:16.911054 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911204 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911204 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxf6w\" (UniqueName: \"kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911204 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911204 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911399 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.911399 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.911286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:16.915125 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.915103 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:13:16.923870 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:16.923848 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92008ea_74e8_4842_b557_815248c336ef.slice/crio-05902707c3fe398c2caf643e6765d40939e4e95415930503e01ecd9da8ff7eca WatchSource:0}: Error finding container 05902707c3fe398c2caf643e6765d40939e4e95415930503e01ecd9da8ff7eca: Status 404 returned error can't find the container with id 05902707c3fe398c2caf643e6765d40939e4e95415930503e01ecd9da8ff7eca Apr 17 18:13:16.982548 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.982522 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" event={"ID":"85f584da-e5e6-4e89-a6b2-a11e0da71f80","Type":"ContainerStarted","Data":"7b0244af2cf48f620675838e22efce38a8f8f1cdd7af62837750f18912dd234c"} Apr 17 18:13:16.984370 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.984326 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" event={"ID":"41f0ad6e-b5a5-4562-bae1-0174a388470e","Type":"ContainerStarted","Data":"5b5dcafcae62cefcc9031b6fa2967745afd969b4a38c16ccbb15ebf4779c8c79"} Apr 17 18:13:16.985622 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:16.985597 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"05902707c3fe398c2caf643e6765d40939e4e95415930503e01ecd9da8ff7eca"} Apr 17 18:13:17.001019 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.000977 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" podStartSLOduration=1.2168772429999999 podStartE2EDuration="3.000962723s" podCreationTimestamp="2026-04-17 18:13:14 +0000 UTC" firstStartedPulling="2026-04-17 18:13:14.999218254 +0000 UTC m=+187.334718190" lastFinishedPulling="2026-04-17 18:13:16.783303723 +0000 UTC m=+189.118803670" observedRunningTime="2026-04-17 18:13:17.000914188 +0000 UTC m=+189.336414175" watchObservedRunningTime="2026-04-17 18:13:17.000962723 +0000 UTC m=+189.336462705" Apr 17 18:13:17.012472 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012453 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012565 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012497 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012652 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012556 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxf6w\" (UniqueName: \"kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012652 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012601 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012763 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012658 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012763 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012686 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.012763 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.012757 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.013953 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.013326 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.013953 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.013406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.013953 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.013722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.014150 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.013964 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.015531 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.015457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.016142 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.016122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.027610 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.027587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxf6w\" (UniqueName: \"kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w\") pod \"console-6dc58748df-59jsg\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.180936 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.180895 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:17.328917 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.328754 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:13:17.332745 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:13:17.332711 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32016184_cd57_4bc3_a42c_c77287069d77.slice/crio-a89d6efb6c204566a82c3c3b0043c1a71c9e8dd38dd5318feb4cf36b5484d578 WatchSource:0}: Error finding container a89d6efb6c204566a82c3c3b0043c1a71c9e8dd38dd5318feb4cf36b5484d578: Status 404 returned error can't find the container with id a89d6efb6c204566a82c3c3b0043c1a71c9e8dd38dd5318feb4cf36b5484d578 Apr 17 18:13:17.373538 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.373514 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:13:17.990482 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.990443 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc58748df-59jsg" event={"ID":"32016184-cd57-4bc3-a42c-c77287069d77","Type":"ContainerStarted","Data":"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99"} Apr 17 18:13:17.991016 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.990487 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc58748df-59jsg" event={"ID":"32016184-cd57-4bc3-a42c-c77287069d77","Type":"ContainerStarted","Data":"a89d6efb6c204566a82c3c3b0043c1a71c9e8dd38dd5318feb4cf36b5484d578"} Apr 17 18:13:17.991962 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.991933 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" exitCode=0 Apr 17 18:13:17.992061 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:17.992008 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} Apr 17 18:13:18.007242 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:18.007203 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6dc58748df-59jsg" podStartSLOduration=2.007192043 podStartE2EDuration="2.007192043s" podCreationTimestamp="2026-04-17 18:13:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:13:18.006823137 +0000 UTC m=+190.342323091" watchObservedRunningTime="2026-04-17 18:13:18.007192043 +0000 UTC m=+190.342691999" Apr 17 18:13:18.997121 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:18.997090 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88"} Apr 17 18:13:18.997415 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:18.997133 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663"} Apr 17 18:13:18.997415 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:18.997151 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb"} Apr 17 18:13:19.002110 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:19.002087 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" event={"ID":"85f584da-e5e6-4e89-a6b2-a11e0da71f80","Type":"ContainerStarted","Data":"daf6c089742666a8d03e8b73cb0dcfcf6f540e9160a8fb1d8ec5d7f7a2789854"} Apr 17 18:13:19.016706 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:19.016684 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:19.021976 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:19.021954 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" Apr 17 18:13:19.036152 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:19.033127 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-dcv7p" podStartSLOduration=2.8593311359999998 podStartE2EDuration="5.03311358s" podCreationTimestamp="2026-04-17 18:13:14 +0000 UTC" firstStartedPulling="2026-04-17 18:13:16.437914853 +0000 UTC m=+188.773414790" lastFinishedPulling="2026-04-17 18:13:18.611697297 +0000 UTC m=+190.947197234" observedRunningTime="2026-04-17 18:13:19.031449351 +0000 UTC m=+191.366949307" watchObservedRunningTime="2026-04-17 18:13:19.03311358 +0000 UTC m=+191.368613538" Apr 17 18:13:20.008478 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:20.008426 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e"} Apr 17 18:13:20.008933 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:20.008490 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7"} Apr 17 18:13:22.018094 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:22.018052 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerStarted","Data":"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8"} Apr 17 18:13:22.019998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:22.019974 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} Apr 17 18:13:22.019998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:22.020000 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} Apr 17 18:13:22.046127 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:22.046086 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.098514839 podStartE2EDuration="11.046073792s" podCreationTimestamp="2026-04-17 18:13:11 +0000 UTC" firstStartedPulling="2026-04-17 18:13:12.520621701 +0000 UTC m=+184.856121650" lastFinishedPulling="2026-04-17 18:13:21.468180666 +0000 UTC m=+193.803680603" observedRunningTime="2026-04-17 18:13:22.045054018 +0000 UTC m=+194.380553974" watchObservedRunningTime="2026-04-17 18:13:22.046073792 +0000 UTC m=+194.381573742" Apr 17 18:13:24.034347 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:24.034319 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} Apr 17 18:13:25.041154 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:25.041108 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} Apr 17 18:13:25.041154 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:25.041150 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} Apr 17 18:13:25.041154 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:25.041161 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerStarted","Data":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} Apr 17 18:13:25.074452 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:25.074393 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.15538413 podStartE2EDuration="9.074378495s" podCreationTimestamp="2026-04-17 18:13:16 +0000 UTC" firstStartedPulling="2026-04-17 18:13:17.993326197 +0000 UTC m=+190.328826145" lastFinishedPulling="2026-04-17 18:13:23.912320572 +0000 UTC m=+196.247820510" observedRunningTime="2026-04-17 18:13:25.072956424 +0000 UTC m=+197.408456382" watchObservedRunningTime="2026-04-17 18:13:25.074378495 +0000 UTC m=+197.409878451" Apr 17 18:13:26.709691 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:26.709653 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:13:27.181847 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:27.181819 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:27.181988 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:27.181857 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:27.186350 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:27.186328 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:28.055494 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:28.055463 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:13:34.733088 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:34.733031 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:34.733735 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:34.733107 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:41.322117 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.322036 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7ff4d8547d-vr4cq" podUID="b9cd90fc-a8cb-454f-995d-d5d566176515" containerName="console" containerID="cri-o://b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972" gracePeriod=15 Apr 17 18:13:41.634362 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.634343 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ff4d8547d-vr4cq_b9cd90fc-a8cb-454f-995d-d5d566176515/console/0.log" Apr 17 18:13:41.634465 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.634401 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:13:41.728782 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728753 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.728879 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728800 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.728879 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728826 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.728879 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728865 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.728997 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728922 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.728997 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.728982 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f99m\" (UniqueName: \"kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m\") pod \"b9cd90fc-a8cb-454f-995d-d5d566176515\" (UID: \"b9cd90fc-a8cb-454f-995d-d5d566176515\") " Apr 17 18:13:41.729278 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.729249 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:13:41.729379 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.729257 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config" (OuterVolumeSpecName: "console-config") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:13:41.729379 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.729306 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca" (OuterVolumeSpecName: "service-ca") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:13:41.731035 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.731001 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m" (OuterVolumeSpecName: "kube-api-access-8f99m") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "kube-api-access-8f99m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:13:41.731139 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.731086 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:13:41.731139 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.731099 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b9cd90fc-a8cb-454f-995d-d5d566176515" (UID: "b9cd90fc-a8cb-454f-995d-d5d566176515"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:13:41.829526 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829505 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-console-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:41.829526 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829525 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-service-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:41.829678 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829534 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f99m\" (UniqueName: \"kubernetes.io/projected/b9cd90fc-a8cb-454f-995d-d5d566176515-kube-api-access-8f99m\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:41.829678 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829544 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-serving-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:41.829678 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829553 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9cd90fc-a8cb-454f-995d-d5d566176515-oauth-serving-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:41.829678 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:41.829562 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9cd90fc-a8cb-454f-995d-d5d566176515-console-oauth-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:13:42.095772 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ff4d8547d-vr4cq_b9cd90fc-a8cb-454f-995d-d5d566176515/console/0.log" Apr 17 18:13:42.095772 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095752 2574 generic.go:358] "Generic (PLEG): container finished" podID="b9cd90fc-a8cb-454f-995d-d5d566176515" containerID="b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972" exitCode=2 Apr 17 18:13:42.095935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095812 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff4d8547d-vr4cq" event={"ID":"b9cd90fc-a8cb-454f-995d-d5d566176515","Type":"ContainerDied","Data":"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972"} Apr 17 18:13:42.095935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095837 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ff4d8547d-vr4cq" event={"ID":"b9cd90fc-a8cb-454f-995d-d5d566176515","Type":"ContainerDied","Data":"4d8f7ec5125b07e820499a0d7ba6819e3b89b22ab74051a9bddb36f06454582a"} Apr 17 18:13:42.095935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095852 2574 scope.go:117] "RemoveContainer" containerID="b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972" Apr 17 18:13:42.095935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.095849 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ff4d8547d-vr4cq" Apr 17 18:13:42.104533 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.104509 2574 scope.go:117] "RemoveContainer" containerID="b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972" Apr 17 18:13:42.104855 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:13:42.104833 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972\": container with ID starting with b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972 not found: ID does not exist" containerID="b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972" Apr 17 18:13:42.104931 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.104863 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972"} err="failed to get container status \"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972\": rpc error: code = NotFound desc = could not find container \"b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972\": container with ID starting with b90e81f5000ea1b055e4087a50e15357904b0a87c5201e33295dff76f426f972 not found: ID does not exist" Apr 17 18:13:42.119177 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.119153 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:13:42.126741 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.126718 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ff4d8547d-vr4cq"] Apr 17 18:13:42.297781 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:42.297757 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9cd90fc-a8cb-454f-995d-d5d566176515" path="/var/lib/kubelet/pods/b9cd90fc-a8cb-454f-995d-d5d566176515/volumes" Apr 17 18:13:46.111341 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:46.111305 2574 generic.go:358] "Generic (PLEG): container finished" podID="358063c2-5e0c-4278-8b52-bd8bab0d8c13" containerID="de0dc2e9c67847277246f37609098e966b58fe6d99b7e98d556fcfa47a4f4cee" exitCode=0 Apr 17 18:13:46.111866 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:46.111365 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" event={"ID":"358063c2-5e0c-4278-8b52-bd8bab0d8c13","Type":"ContainerDied","Data":"de0dc2e9c67847277246f37609098e966b58fe6d99b7e98d556fcfa47a4f4cee"} Apr 17 18:13:46.111866 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:46.111715 2574 scope.go:117] "RemoveContainer" containerID="de0dc2e9c67847277246f37609098e966b58fe6d99b7e98d556fcfa47a4f4cee" Apr 17 18:13:47.116173 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:47.116146 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-585dfdc468-tlzlj" event={"ID":"358063c2-5e0c-4278-8b52-bd8bab0d8c13","Type":"ContainerStarted","Data":"4250c19512165d2df49ba63bd728ede251834290b5eace44543b72d893f01d1a"} Apr 17 18:13:54.739563 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:54.739529 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:13:54.743688 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:13:54.743661 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d875b6bdf-5m8ph" Apr 17 18:14:16.709321 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:16.709284 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:16.728998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:16.728974 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:17.225056 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:17.225032 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:19.012058 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:19.012021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:14:19.014532 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:19.014497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f716dbf1-bcde-4892-b9da-62d55e29f521-metrics-certs\") pod \"network-metrics-daemon-snrz7\" (UID: \"f716dbf1-bcde-4892-b9da-62d55e29f521\") " pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:14:19.197454 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:19.197423 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c85k4\"" Apr 17 18:14:19.204838 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:19.204813 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-snrz7" Apr 17 18:14:19.323334 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:19.323308 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-snrz7"] Apr 17 18:14:19.327317 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:14:19.327287 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf716dbf1_bcde_4892_b9da_62d55e29f521.slice/crio-85051034d23cab01660714940fd483036d40edd599b86d35f9784a46e03677e0 WatchSource:0}: Error finding container 85051034d23cab01660714940fd483036d40edd599b86d35f9784a46e03677e0: Status 404 returned error can't find the container with id 85051034d23cab01660714940fd483036d40edd599b86d35f9784a46e03677e0 Apr 17 18:14:20.220065 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:20.220029 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snrz7" event={"ID":"f716dbf1-bcde-4892-b9da-62d55e29f521","Type":"ContainerStarted","Data":"85051034d23cab01660714940fd483036d40edd599b86d35f9784a46e03677e0"} Apr 17 18:14:21.227865 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:21.227826 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snrz7" event={"ID":"f716dbf1-bcde-4892-b9da-62d55e29f521","Type":"ContainerStarted","Data":"cef024505cc1b73e78e00a82ee4b05d392fddcf0e54de0bf8bc06a8a69fbfb8e"} Apr 17 18:14:21.227865 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:21.227867 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-snrz7" event={"ID":"f716dbf1-bcde-4892-b9da-62d55e29f521","Type":"ContainerStarted","Data":"1da34298b2f80c485151549fd975a817c5cbdd6c43c58d7034658353abaa72c7"} Apr 17 18:14:21.249660 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:21.249595 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-snrz7" podStartSLOduration=252.212473148 podStartE2EDuration="4m13.249580527s" podCreationTimestamp="2026-04-17 18:10:08 +0000 UTC" firstStartedPulling="2026-04-17 18:14:19.329481288 +0000 UTC m=+251.664981222" lastFinishedPulling="2026-04-17 18:14:20.366588666 +0000 UTC m=+252.702088601" observedRunningTime="2026-04-17 18:14:21.247706386 +0000 UTC m=+253.583206344" watchObservedRunningTime="2026-04-17 18:14:21.249580527 +0000 UTC m=+253.585080482" Apr 17 18:14:30.660795 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.660763 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:30.661189 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661146 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="alertmanager" containerID="cri-o://ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" gracePeriod=120 Apr 17 18:14:30.661247 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661224 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-metric" containerID="cri-o://9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" gracePeriod=120 Apr 17 18:14:30.661301 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661269 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="config-reloader" containerID="cri-o://94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" gracePeriod=120 Apr 17 18:14:30.661347 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661265 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="prom-label-proxy" containerID="cri-o://985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" gracePeriod=120 Apr 17 18:14:30.661347 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661300 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy" containerID="cri-o://1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" gracePeriod=120 Apr 17 18:14:30.661347 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:30.661270 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-web" containerID="cri-o://07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" gracePeriod=120 Apr 17 18:14:31.265232 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265190 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" exitCode=0 Apr 17 18:14:31.265232 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265221 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" exitCode=0 Apr 17 18:14:31.265232 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265228 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" exitCode=0 Apr 17 18:14:31.265232 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265236 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" exitCode=0 Apr 17 18:14:31.265491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265260 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8"} Apr 17 18:14:31.265491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265295 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7"} Apr 17 18:14:31.265491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265307 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663"} Apr 17 18:14:31.265491 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.265320 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb"} Apr 17 18:14:31.890921 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:31.890899 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.026500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026431 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026486 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026532 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026557 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026716 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026589 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026877 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026751 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026877 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026814 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.026877 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026850 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026877 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026909 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026944 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026974 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdtvv\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.026997 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") pod \"e35b69e9-4f68-4351-bccf-9d420a02238f\" (UID: \"e35b69e9-4f68-4351-bccf-9d420a02238f\") " Apr 17 18:14:32.027254 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.027129 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:32.027439 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.027417 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-metrics-client-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.027507 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.027435 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:32.028392 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.027711 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 18:14:32.029180 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.029155 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.029534 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.029507 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.029610 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.029531 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume" (OuterVolumeSpecName: "config-volume") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.029779 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.029756 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:14:32.030331 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.030307 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv" (OuterVolumeSpecName: "kube-api-access-jdtvv") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "kube-api-access-jdtvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:14:32.030331 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.030316 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.031368 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.031344 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.031426 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.031394 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out" (OuterVolumeSpecName: "config-out") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 18:14:32.034764 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.034542 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.040305 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.040287 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config" (OuterVolumeSpecName: "web-config") pod "e35b69e9-4f68-4351-bccf-9d420a02238f" (UID: "e35b69e9-4f68-4351-bccf-9d420a02238f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:32.128709 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128687 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-cluster-tls-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128709 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128708 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-config-out\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128718 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-main-db\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128729 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-tls-assets\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128740 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128753 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdtvv\" (UniqueName: \"kubernetes.io/projected/e35b69e9-4f68-4351-bccf-9d420a02238f-kube-api-access-jdtvv\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128762 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e35b69e9-4f68-4351-bccf-9d420a02238f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128771 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128780 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-main-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128789 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128797 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-config-volume\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.128826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.128805 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e35b69e9-4f68-4351-bccf-9d420a02238f-web-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:32.270918 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.270892 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" exitCode=0 Apr 17 18:14:32.270918 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.270918 2574 generic.go:358] "Generic (PLEG): container finished" podID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerID="07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" exitCode=0 Apr 17 18:14:32.271039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.270970 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e"} Apr 17 18:14:32.271039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.271008 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88"} Apr 17 18:14:32.271039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.271018 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e35b69e9-4f68-4351-bccf-9d420a02238f","Type":"ContainerDied","Data":"3bb6916479fe78976ac2a61779f3411cbf759a5d7f27889107142e9e0e97e958"} Apr 17 18:14:32.271039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.271022 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.271039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.271034 2574 scope.go:117] "RemoveContainer" containerID="985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" Apr 17 18:14:32.278505 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.278382 2574 scope.go:117] "RemoveContainer" containerID="9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" Apr 17 18:14:32.285051 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.285036 2574 scope.go:117] "RemoveContainer" containerID="1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" Apr 17 18:14:32.290928 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.290913 2574 scope.go:117] "RemoveContainer" containerID="07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" Apr 17 18:14:32.297087 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.297069 2574 scope.go:117] "RemoveContainer" containerID="94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" Apr 17 18:14:32.299207 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.299185 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:32.304390 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.304372 2574 scope.go:117] "RemoveContainer" containerID="ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" Apr 17 18:14:32.307815 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.307799 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:32.310580 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.310565 2574 scope.go:117] "RemoveContainer" containerID="30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f" Apr 17 18:14:32.316539 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.316523 2574 scope.go:117] "RemoveContainer" containerID="985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" Apr 17 18:14:32.316785 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.316767 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8\": container with ID starting with 985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8 not found: ID does not exist" containerID="985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" Apr 17 18:14:32.316839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.316791 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8"} err="failed to get container status \"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8\": rpc error: code = NotFound desc = could not find container \"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8\": container with ID starting with 985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8 not found: ID does not exist" Apr 17 18:14:32.316839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.316809 2574 scope.go:117] "RemoveContainer" containerID="9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" Apr 17 18:14:32.317060 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.317043 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e\": container with ID starting with 9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e not found: ID does not exist" containerID="9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" Apr 17 18:14:32.317109 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317065 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e"} err="failed to get container status \"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e\": rpc error: code = NotFound desc = could not find container \"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e\": container with ID starting with 9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e not found: ID does not exist" Apr 17 18:14:32.317109 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317085 2574 scope.go:117] "RemoveContainer" containerID="1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" Apr 17 18:14:32.317319 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.317301 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7\": container with ID starting with 1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7 not found: ID does not exist" containerID="1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" Apr 17 18:14:32.317356 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317326 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7"} err="failed to get container status \"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7\": rpc error: code = NotFound desc = could not find container \"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7\": container with ID starting with 1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7 not found: ID does not exist" Apr 17 18:14:32.317356 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317349 2574 scope.go:117] "RemoveContainer" containerID="07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" Apr 17 18:14:32.317549 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.317534 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88\": container with ID starting with 07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88 not found: ID does not exist" containerID="07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" Apr 17 18:14:32.317588 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317553 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88"} err="failed to get container status \"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88\": rpc error: code = NotFound desc = could not find container \"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88\": container with ID starting with 07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88 not found: ID does not exist" Apr 17 18:14:32.317588 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317571 2574 scope.go:117] "RemoveContainer" containerID="94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" Apr 17 18:14:32.317807 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.317790 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663\": container with ID starting with 94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663 not found: ID does not exist" containerID="94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" Apr 17 18:14:32.317859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317810 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663"} err="failed to get container status \"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663\": rpc error: code = NotFound desc = could not find container \"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663\": container with ID starting with 94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663 not found: ID does not exist" Apr 17 18:14:32.317859 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.317826 2574 scope.go:117] "RemoveContainer" containerID="ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" Apr 17 18:14:32.318054 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.318035 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb\": container with ID starting with ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb not found: ID does not exist" containerID="ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" Apr 17 18:14:32.318098 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318058 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb"} err="failed to get container status \"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb\": rpc error: code = NotFound desc = could not find container \"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb\": container with ID starting with ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb not found: ID does not exist" Apr 17 18:14:32.318098 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318071 2574 scope.go:117] "RemoveContainer" containerID="30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f" Apr 17 18:14:32.318277 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:32.318258 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f\": container with ID starting with 30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f not found: ID does not exist" containerID="30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f" Apr 17 18:14:32.318331 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318280 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f"} err="failed to get container status \"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f\": rpc error: code = NotFound desc = could not find container \"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f\": container with ID starting with 30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f not found: ID does not exist" Apr 17 18:14:32.318331 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318302 2574 scope.go:117] "RemoveContainer" containerID="985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8" Apr 17 18:14:32.318492 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318477 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8"} err="failed to get container status \"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8\": rpc error: code = NotFound desc = could not find container \"985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8\": container with ID starting with 985f4a4558948ddeb5d080976004d97385dbb6eb4f844e35766803b37254cdd8 not found: ID does not exist" Apr 17 18:14:32.318531 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318492 2574 scope.go:117] "RemoveContainer" containerID="9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e" Apr 17 18:14:32.318715 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318700 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e"} err="failed to get container status \"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e\": rpc error: code = NotFound desc = could not find container \"9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e\": container with ID starting with 9d68463fb6c0af476dc1b118c5bb0db58399a394bf48995ba29512db414be05e not found: ID does not exist" Apr 17 18:14:32.318768 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318715 2574 scope.go:117] "RemoveContainer" containerID="1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7" Apr 17 18:14:32.318896 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318882 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7"} err="failed to get container status \"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7\": rpc error: code = NotFound desc = could not find container \"1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7\": container with ID starting with 1b5c63b11f9ac0fed4a3c38aa28d6d5c744d4be12a8d879b3ad6ae669e490ff7 not found: ID does not exist" Apr 17 18:14:32.318937 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.318896 2574 scope.go:117] "RemoveContainer" containerID="07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88" Apr 17 18:14:32.319094 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319076 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88"} err="failed to get container status \"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88\": rpc error: code = NotFound desc = could not find container \"07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88\": container with ID starting with 07638609cedc718eb79c8335f8663055a98bd3b6d1fa946a08d13f7efbeced88 not found: ID does not exist" Apr 17 18:14:32.319143 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319094 2574 scope.go:117] "RemoveContainer" containerID="94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663" Apr 17 18:14:32.319281 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319264 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663"} err="failed to get container status \"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663\": rpc error: code = NotFound desc = could not find container \"94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663\": container with ID starting with 94e024cc7b230db05f0732a0e53adba892415100fa8ac8e839408e59796a5663 not found: ID does not exist" Apr 17 18:14:32.319320 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319282 2574 scope.go:117] "RemoveContainer" containerID="ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb" Apr 17 18:14:32.319467 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319453 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb"} err="failed to get container status \"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb\": rpc error: code = NotFound desc = could not find container \"ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb\": container with ID starting with ba4dec91609f25fe4429e91b174c26fb02efd33e5fc14e4e5250c8d973d9a0bb not found: ID does not exist" Apr 17 18:14:32.319515 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319467 2574 scope.go:117] "RemoveContainer" containerID="30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f" Apr 17 18:14:32.319659 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.319624 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f"} err="failed to get container status \"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f\": rpc error: code = NotFound desc = could not find container \"30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f\": container with ID starting with 30fbf94d93891f367fa3bc8f4fe41519765cecfc465380e34d2858928f82ef2f not found: ID does not exist" Apr 17 18:14:32.345467 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345444 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:32.345757 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345744 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-web" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345760 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-web" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345772 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345778 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345784 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="prom-label-proxy" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345789 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="prom-label-proxy" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345795 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="init-config-reloader" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345800 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="init-config-reloader" Apr 17 18:14:32.345805 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345808 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="alertmanager" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345813 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="alertmanager" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345821 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9cd90fc-a8cb-454f-995d-d5d566176515" containerName="console" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345826 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9cd90fc-a8cb-454f-995d-d5d566176515" containerName="console" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345831 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="config-reloader" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345836 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="config-reloader" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345841 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-metric" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345846 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-metric" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345893 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="prom-label-proxy" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345901 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="config-reloader" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345908 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-metric" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345914 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="alertmanager" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345921 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy-web" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345931 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9cd90fc-a8cb-454f-995d-d5d566176515" containerName="console" Apr 17 18:14:32.346024 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.345939 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" containerName="kube-rbac-proxy" Apr 17 18:14:32.350967 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.350952 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.353884 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.353867 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 18:14:32.353975 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.353901 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 18:14:32.354232 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.354217 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 18:14:32.354824 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.354796 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 18:14:32.354943 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.354905 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r8k5h\"" Apr 17 18:14:32.355068 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.355052 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 18:14:32.355132 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.355120 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 18:14:32.355895 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.355861 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 18:14:32.357737 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.357721 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 18:14:32.362582 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.362565 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 18:14:32.368040 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.368021 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:32.430277 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-out\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-web-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430398 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430506 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430724 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm7gg\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-kube-api-access-nm7gg\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.430724 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.430574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531556 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531507 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531556 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531542 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531724 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531724 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531713 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-web-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531792 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531741 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531862 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531845 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531913 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.531964 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.531928 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.532659 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.532624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534541 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-web-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534662 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm7gg\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-kube-api-access-nm7gg\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534726 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534728 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534764 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-out\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534779 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.534916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.535447 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.534965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-volume\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.535447 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.535034 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.535447 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.535293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.535624 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.535595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.536564 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.536548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-config-out\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.544045 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.544022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm7gg\" (UniqueName: \"kubernetes.io/projected/f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67-kube-api-access-nm7gg\") pod \"alertmanager-main-0\" (UID: \"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.660122 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.660102 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 18:14:32.796052 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:32.795616 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 18:14:32.798619 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:14:32.798577 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97cf2c4_263c_4baa_8eb4_cbdb8bc4ed67.slice/crio-78238b6928d4a77797266523344d5404b11d883d449049810080f49dbffdb443 WatchSource:0}: Error finding container 78238b6928d4a77797266523344d5404b11d883d449049810080f49dbffdb443: Status 404 returned error can't find the container with id 78238b6928d4a77797266523344d5404b11d883d449049810080f49dbffdb443 Apr 17 18:14:33.281361 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:33.281329 2574 generic.go:358] "Generic (PLEG): container finished" podID="f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67" containerID="7035ab9b365e352fe9a0eefcb74a6a1f004266819c64e7931098bda03c8f3a45" exitCode=0 Apr 17 18:14:33.281763 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:33.281417 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerDied","Data":"7035ab9b365e352fe9a0eefcb74a6a1f004266819c64e7931098bda03c8f3a45"} Apr 17 18:14:33.281763 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:33.281460 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"78238b6928d4a77797266523344d5404b11d883d449049810080f49dbffdb443"} Apr 17 18:14:34.289752 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289718 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"34fb75c5ec5f970a051d97de1e888eb680c3720ff42fa73114dbbc339c809b01"} Apr 17 18:14:34.289752 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289756 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"abc3810f0aea184a2bd06f404d8c55b935484e5acd8ae461eeb5424f67f4d389"} Apr 17 18:14:34.290130 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289768 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"9c811fb6d4d05b407bf7941850b9698d9288f59b97669593b9527a8849438685"} Apr 17 18:14:34.290130 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289777 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"aa12747ee9a5cc902159317eb774f00d263a1f9936b47cf56e98de673b77f3cf"} Apr 17 18:14:34.290130 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289787 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"7eadaba4cc2c6ad645fb8f3f57b46e4e6a10cac31ee0506ee5ac5ac8037f7a21"} Apr 17 18:14:34.290130 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.289795 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67","Type":"ContainerStarted","Data":"554d5a983ac9adf6286373b68ee5683ced07ad288da4f1f11eda0327beb059de"} Apr 17 18:14:34.298068 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.298042 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e35b69e9-4f68-4351-bccf-9d420a02238f" path="/var/lib/kubelet/pods/e35b69e9-4f68-4351-bccf-9d420a02238f/volumes" Apr 17 18:14:34.320276 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.320234 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.320219066 podStartE2EDuration="2.320219066s" podCreationTimestamp="2026-04-17 18:14:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:14:34.31876491 +0000 UTC m=+266.654264895" watchObservedRunningTime="2026-04-17 18:14:34.320219066 +0000 UTC m=+266.655719021" Apr 17 18:14:34.959363 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959062 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959559 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="prometheus" containerID="cri-o://9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" gracePeriod=600 Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959584 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="thanos-sidecar" containerID="cri-o://87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" gracePeriod=600 Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959605 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-thanos" containerID="cri-o://31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" gracePeriod=600 Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959620 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="config-reloader" containerID="cri-o://85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" gracePeriod=600 Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959559 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy" containerID="cri-o://01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" gracePeriod=600 Apr 17 18:14:34.959839 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:34.959611 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-web" containerID="cri-o://335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" gracePeriod=600 Apr 17 18:14:35.198441 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.198417 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.259843 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.259764 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.259843 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.259812 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260230 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260208 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260256 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260283 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260312 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260336 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260376 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260403 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260450 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260479 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260547 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260509 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260564 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260656 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wp2q\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260680 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260714 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260764 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260805 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:35.260868 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.260816 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs\") pod \"d92008ea-74e8-4842-b557-815248c336ef\" (UID: \"d92008ea-74e8-4842-b557-815248c336ef\") " Apr 17 18:14:35.261218 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.261124 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.262424 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.261530 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:35.262424 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.262202 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:35.263084 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.262884 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.263084 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.263010 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:35.265738 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.265515 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:14:35.265967 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.265930 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 18:14:35.267331 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.267303 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.267520 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.267481 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.268083 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.268051 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.268729 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.268689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out" (OuterVolumeSpecName: "config-out") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 18:14:35.269256 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.269231 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config" (OuterVolumeSpecName: "config") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.269718 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.269681 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:14:35.269804 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.269749 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.269804 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.269781 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.269935 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.269914 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q" (OuterVolumeSpecName: "kube-api-access-4wp2q") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "kube-api-access-4wp2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:14:35.273395 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.273369 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.281723 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.281696 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config" (OuterVolumeSpecName: "web-config") pod "d92008ea-74e8-4842-b557-815248c336ef" (UID: "d92008ea-74e8-4842-b557-815248c336ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:14:35.296316 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296292 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" exitCode=0 Apr 17 18:14:35.296316 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296313 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" exitCode=0 Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296320 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" exitCode=0 Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296326 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" exitCode=0 Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296332 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" exitCode=0 Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296337 2574 generic.go:358] "Generic (PLEG): container finished" podID="d92008ea-74e8-4842-b557-815248c336ef" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" exitCode=0 Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296376 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296408 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296417 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296432 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296446 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296459 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296472 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296485 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d92008ea-74e8-4842-b557-815248c336ef","Type":"ContainerDied","Data":"05902707c3fe398c2caf643e6765d40939e4e95415930503e01ecd9da8ff7eca"} Apr 17 18:14:35.296785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.296494 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.303802 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.303733 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.312332 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.312320 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.318303 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.318289 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.324414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.324398 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.330530 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.330516 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.335523 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.335500 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:35.337528 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.337514 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.344384 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.344363 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:35.350196 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.350166 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.350570 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.350547 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.350614 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.350587 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.350683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.350617 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.350938 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.350906 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.351016 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.350954 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.351016 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.350984 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.351249 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.351229 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.351286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351257 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.351286 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351277 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.351490 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.351475 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.351528 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351494 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.351528 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351507 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.351729 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.351713 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.351788 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351732 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.351788 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.351744 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.352067 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.352051 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.352137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352068 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.352137 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352080 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.352281 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:14:35.352266 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.352319 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352285 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.352319 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352298 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.352486 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352468 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.352535 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352487 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.352723 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352705 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.352796 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352723 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.352949 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352934 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.352994 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.352949 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.353146 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353129 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.353189 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353147 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.353318 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353304 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.353373 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353318 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.353525 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353505 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.353579 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353525 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.353759 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353743 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.353759 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353759 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.353955 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353939 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.353998 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.353954 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.354128 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354113 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.354210 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354129 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.354299 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354285 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.354333 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354299 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.354454 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354440 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.354489 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354454 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.354623 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354605 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.354682 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354637 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.354811 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354796 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.354851 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354812 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.354995 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354979 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.355030 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.354997 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.355162 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355146 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.355197 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355161 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.355311 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355297 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.355346 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355312 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.355463 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355448 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.355497 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355463 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.355613 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355598 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.355713 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355613 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.355818 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355801 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.355854 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355820 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.356013 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.355996 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.356055 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356014 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.356193 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356176 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.356235 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356194 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.356359 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356345 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.356404 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356359 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.356515 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356500 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.356559 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356516 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.356707 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356689 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.356761 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356708 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.356897 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356882 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.356934 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.356896 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.357055 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357041 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.357090 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357056 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.357212 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357197 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.357249 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357212 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.357377 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357363 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.357413 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357377 2574 scope.go:117] "RemoveContainer" containerID="31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a" Apr 17 18:14:35.357567 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357553 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a"} err="failed to get container status \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": rpc error: code = NotFound desc = could not find container \"31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a\": container with ID starting with 31e4a51b6000f5ec8a81235e60204b39639b4a60d07cdcdbf44bf84ba44a293a not found: ID does not exist" Apr 17 18:14:35.357610 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357568 2574 scope.go:117] "RemoveContainer" containerID="01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74" Apr 17 18:14:35.357748 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357733 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74"} err="failed to get container status \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": rpc error: code = NotFound desc = could not find container \"01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74\": container with ID starting with 01e9b6fda9ba388238ec33341f958112ea53c33b660823d8991c3c281243ad74 not found: ID does not exist" Apr 17 18:14:35.357784 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357747 2574 scope.go:117] "RemoveContainer" containerID="335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a" Apr 17 18:14:35.357921 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357905 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a"} err="failed to get container status \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": rpc error: code = NotFound desc = could not find container \"335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a\": container with ID starting with 335e9b91f44502e4412864ed9e43e75638ce986f185a5591c3f514b1a368d49a not found: ID does not exist" Apr 17 18:14:35.358020 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.357921 2574 scope.go:117] "RemoveContainer" containerID="87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3" Apr 17 18:14:35.358165 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358145 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3"} err="failed to get container status \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": rpc error: code = NotFound desc = could not find container \"87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3\": container with ID starting with 87c70d52adc006e632543dd24699094e1e58fdfab39bda5e6bf2c063bee25aa3 not found: ID does not exist" Apr 17 18:14:35.358212 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358166 2574 scope.go:117] "RemoveContainer" containerID="85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f" Apr 17 18:14:35.358344 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358329 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f"} err="failed to get container status \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": rpc error: code = NotFound desc = could not find container \"85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f\": container with ID starting with 85fac3f01faa6f1035c0e30ddac0f7672691445543c5aac151de1fd6d80feb8f not found: ID does not exist" Apr 17 18:14:35.358398 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358344 2574 scope.go:117] "RemoveContainer" containerID="9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243" Apr 17 18:14:35.358490 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358475 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243"} err="failed to get container status \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": rpc error: code = NotFound desc = could not find container \"9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243\": container with ID starting with 9c3a17feed4774c86fcc1025c84a19e797a5187c48600a152c9083b70e7f3243 not found: ID does not exist" Apr 17 18:14:35.358534 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358490 2574 scope.go:117] "RemoveContainer" containerID="fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e" Apr 17 18:14:35.358683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.358668 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e"} err="failed to get container status \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": rpc error: code = NotFound desc = could not find container \"fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e\": container with ID starting with fd9e4dd261325c81d48d1644d897ce08ffb92c2ad8221cc308c4da6748a42d3e not found: ID does not exist" Apr 17 18:14:35.362234 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362211 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-web-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362241 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362259 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-config-out\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362274 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-tls-assets\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362289 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362304 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wp2q\" (UniqueName: \"kubernetes.io/projected/d92008ea-74e8-4842-b557-815248c336ef-kube-api-access-4wp2q\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362317 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362329 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362342 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-configmap-metrics-client-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362352 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-metrics-client-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362360 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362369 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-kube-rbac-proxy\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362380 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92008ea-74e8-4842-b557-815248c336ef-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362395 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362408 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-grpc-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362422 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d92008ea-74e8-4842-b557-815248c336ef-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.362499 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.362435 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d92008ea-74e8-4842-b557-815248c336ef-prometheus-k8s-db\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:14:35.378002 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.377982 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:35.378262 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378250 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="init-config-reloader" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378264 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="init-config-reloader" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378276 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-web" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378281 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-web" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378290 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="prometheus" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378295 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="prometheus" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378301 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-thanos" Apr 17 18:14:35.378307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378305 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-thanos" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378311 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="config-reloader" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378316 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="config-reloader" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378332 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="thanos-sidecar" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378337 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="thanos-sidecar" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378345 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378350 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378393 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-web" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378400 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="thanos-sidecar" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378407 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy-thanos" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378413 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="config-reloader" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378419 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="prometheus" Apr 17 18:14:35.378500 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.378425 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d92008ea-74e8-4842-b557-815248c336ef" containerName="kube-rbac-proxy" Apr 17 18:14:35.383346 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.383331 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.388924 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.388902 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 18:14:35.389831 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.389813 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 18:14:35.389909 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.389827 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 18:14:35.390269 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.390254 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 18:14:35.390346 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.390288 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 18:14:35.390539 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.390521 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 18:14:35.392654 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.392622 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 18:14:35.392654 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.392648 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw7dh\"" Apr 17 18:14:35.392791 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.392654 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 18:14:35.392791 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.392622 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f1va360jaralp\"" Apr 17 18:14:35.393111 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.393096 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 18:14:35.393150 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.393131 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 18:14:35.394753 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.394737 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 18:14:35.398470 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.398455 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 18:14:35.405645 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.405607 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:35.463683 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463783 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463783 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463783 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463929 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463929 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463929 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.463929 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.463995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464024 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464039 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464059 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.464266 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.464107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhc8f\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-kube-api-access-nhc8f\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564703 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564730 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564758 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564754 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564934 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564775 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564934 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564884 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.564934 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564921 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565066 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564952 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565066 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.564979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565066 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565006 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565066 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565036 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565068 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565093 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhc8f\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-kube-api-access-nhc8f\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565126 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565149 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565183 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565211 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565238 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.565264 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565263 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567297 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567297 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.565125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567297 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.566258 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567297 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.566809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567297 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.567009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.567989 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.567963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.568432 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.568379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.568432 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.568379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.568788 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.568764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.568885 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.568871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.569576 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.569552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7264f82-242c-435b-8b86-1391590bbf2f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.569692 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.569609 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.569826 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.569804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.570178 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.570155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.570226 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.570192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7264f82-242c-435b-8b86-1391590bbf2f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.570382 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.570364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.570774 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.570756 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7264f82-242c-435b-8b86-1391590bbf2f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.575175 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.575156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhc8f\" (UniqueName: \"kubernetes.io/projected/b7264f82-242c-435b-8b86-1391590bbf2f-kube-api-access-nhc8f\") pod \"prometheus-k8s-0\" (UID: \"b7264f82-242c-435b-8b86-1391590bbf2f\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.692510 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.692483 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:35.819936 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:35.819874 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 18:14:35.822365 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:14:35.822335 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7264f82_242c_435b_8b86_1391590bbf2f.slice/crio-c86eaa4590872f3d3b1ebbe633a76c1459005c15c67e3be6ca52c1fc88bc34fc WatchSource:0}: Error finding container c86eaa4590872f3d3b1ebbe633a76c1459005c15c67e3be6ca52c1fc88bc34fc: Status 404 returned error can't find the container with id c86eaa4590872f3d3b1ebbe633a76c1459005c15c67e3be6ca52c1fc88bc34fc Apr 17 18:14:36.298104 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:36.298076 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d92008ea-74e8-4842-b557-815248c336ef" path="/var/lib/kubelet/pods/d92008ea-74e8-4842-b557-815248c336ef/volumes" Apr 17 18:14:36.300562 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:36.300534 2574 generic.go:358] "Generic (PLEG): container finished" podID="b7264f82-242c-435b-8b86-1391590bbf2f" containerID="0483bd330a1d64191e79e0b51efa36e097caee04e753982cf37d98f9644189ee" exitCode=0 Apr 17 18:14:36.300663 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:36.300607 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerDied","Data":"0483bd330a1d64191e79e0b51efa36e097caee04e753982cf37d98f9644189ee"} Apr 17 18:14:36.300663 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:36.300645 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"c86eaa4590872f3d3b1ebbe633a76c1459005c15c67e3be6ca52c1fc88bc34fc"} Apr 17 18:14:37.307596 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307564 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"edd13c3301994c0ad878ebb9bdd6959c3a1a8822bce6ce93c39917ad708d3c8c"} Apr 17 18:14:37.307596 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307601 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"3c4bb412948dd021192836bed6c0acd96c0e3dea8f0f75ca06556eee65aad571"} Apr 17 18:14:37.307991 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307610 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"53679af7b97d5fd61ff7f42d6b5e91c4440eb05781aa7662041bc5febac0543d"} Apr 17 18:14:37.307991 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307618 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"396f72745d8e64afa17e962da05a0e214da18b1b1476e50572d4ff4c1a9dcd30"} Apr 17 18:14:37.307991 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307640 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"ae6aab3005bc49c23052f6a732f544c9535af31a39cc1fbdc427dc0d6e0a038f"} Apr 17 18:14:37.307991 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.307648 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7264f82-242c-435b-8b86-1391590bbf2f","Type":"ContainerStarted","Data":"1d51f48dada4f725cbc177c8dde94be47f9ed396b216d6fcf943d432db227b7c"} Apr 17 18:14:37.350154 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:37.350106 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.3500912 podStartE2EDuration="2.3500912s" podCreationTimestamp="2026-04-17 18:14:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:14:37.347029408 +0000 UTC m=+269.682529375" watchObservedRunningTime="2026-04-17 18:14:37.3500912 +0000 UTC m=+269.685591155" Apr 17 18:14:40.692978 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:40.692937 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:14:50.586300 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:14:50.586265 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:15:08.184892 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:08.184858 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:15:08.186341 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:08.186318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:15:08.190130 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:08.190107 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:15:08.191806 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:08.191775 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:15:08.196940 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:08.196881 2574 kubelet.go:1628] "Image garbage collection succeeded" Apr 17 18:15:15.605709 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.605661 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6dc58748df-59jsg" podUID="32016184-cd57-4bc3-a42c-c77287069d77" containerName="console" containerID="cri-o://e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99" gracePeriod=15 Apr 17 18:15:15.828385 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.828367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc58748df-59jsg_32016184-cd57-4bc3-a42c-c77287069d77/console/0.log" Apr 17 18:15:15.828485 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.828424 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:15:15.971200 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971172 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971239 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971271 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971306 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971354 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971335 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxf6w\" (UniqueName: \"kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971553 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971380 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971553 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971423 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle\") pod \"32016184-cd57-4bc3-a42c-c77287069d77\" (UID: \"32016184-cd57-4bc3-a42c-c77287069d77\") " Apr 17 18:15:15.971765 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971710 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca" (OuterVolumeSpecName: "service-ca") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:15:15.971765 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971733 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:15:15.971765 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.971743 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config" (OuterVolumeSpecName: "console-config") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:15:15.972105 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.972023 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 18:15:15.973382 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.973353 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:15:15.973481 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.973391 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w" (OuterVolumeSpecName: "kube-api-access-nxf6w") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "kube-api-access-nxf6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 18:15:15.973481 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:15.973445 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "32016184-cd57-4bc3-a42c-c77287069d77" (UID: "32016184-cd57-4bc3-a42c-c77287069d77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 18:15:16.072039 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072015 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-serving-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072039 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-oauth-serving-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072055 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-service-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072068 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-console-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072080 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxf6w\" (UniqueName: \"kubernetes.io/projected/32016184-cd57-4bc3-a42c-c77287069d77-kube-api-access-nxf6w\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072093 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32016184-cd57-4bc3-a42c-c77287069d77-console-oauth-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.072144 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.072106 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32016184-cd57-4bc3-a42c-c77287069d77-trusted-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\"" Apr 17 18:15:16.436755 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436724 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6dc58748df-59jsg_32016184-cd57-4bc3-a42c-c77287069d77/console/0.log" Apr 17 18:15:16.436900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436768 2574 generic.go:358] "Generic (PLEG): container finished" podID="32016184-cd57-4bc3-a42c-c77287069d77" containerID="e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99" exitCode=2 Apr 17 18:15:16.436900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436801 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc58748df-59jsg" event={"ID":"32016184-cd57-4bc3-a42c-c77287069d77","Type":"ContainerDied","Data":"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99"} Apr 17 18:15:16.436900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436822 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc58748df-59jsg" event={"ID":"32016184-cd57-4bc3-a42c-c77287069d77","Type":"ContainerDied","Data":"a89d6efb6c204566a82c3c3b0043c1a71c9e8dd38dd5318feb4cf36b5484d578"} Apr 17 18:15:16.436900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436837 2574 scope.go:117] "RemoveContainer" containerID="e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99" Apr 17 18:15:16.436900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.436876 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc58748df-59jsg" Apr 17 18:15:16.444424 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.444407 2574 scope.go:117] "RemoveContainer" containerID="e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99" Apr 17 18:15:16.444714 ip-10-0-139-47 kubenswrapper[2574]: E0417 18:15:16.444695 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99\": container with ID starting with e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99 not found: ID does not exist" containerID="e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99" Apr 17 18:15:16.444775 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.444722 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99"} err="failed to get container status \"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99\": rpc error: code = NotFound desc = could not find container \"e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99\": container with ID starting with e08660c6f468e27b29799622973773ba3c6162da031e9fb4573b718ea53f8e99 not found: ID does not exist" Apr 17 18:15:16.465295 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.465270 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:15:16.469431 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:16.469411 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc58748df-59jsg"] Apr 17 18:15:18.298060 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:18.298015 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32016184-cd57-4bc3-a42c-c77287069d77" path="/var/lib/kubelet/pods/32016184-cd57-4bc3-a42c-c77287069d77/volumes" Apr 17 18:15:35.693160 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:35.693113 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:15:35.709357 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:35.709330 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:15:36.510726 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:15:36.510700 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 18:16:19.275353 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.275321 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vmp6g"] Apr 17 18:16:19.275900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.275689 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32016184-cd57-4bc3-a42c-c77287069d77" containerName="console" Apr 17 18:16:19.275900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.275704 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="32016184-cd57-4bc3-a42c-c77287069d77" containerName="console" Apr 17 18:16:19.275900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.275772 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="32016184-cd57-4bc3-a42c-c77287069d77" containerName="console" Apr 17 18:16:19.279999 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.279976 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.284049 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.284026 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 17 18:16:19.297564 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.297541 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmp6g"] Apr 17 18:16:19.334333 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.334311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-dbus\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.334426 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.334340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-kubelet-config\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.334426 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.334380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d19562bc-c46d-49b3-8e6a-7141edee135f-original-pull-secret\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.434671 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.434648 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-dbus\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.434785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.434680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-kubelet-config\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.434785 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.434717 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d19562bc-c46d-49b3-8e6a-7141edee135f-original-pull-secret\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.434894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.434795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-kubelet-config\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.434894 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.434868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d19562bc-c46d-49b3-8e6a-7141edee135f-dbus\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.437026 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.436998 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d19562bc-c46d-49b3-8e6a-7141edee135f-original-pull-secret\") pod \"global-pull-secret-syncer-vmp6g\" (UID: \"d19562bc-c46d-49b3-8e6a-7141edee135f\") " pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.589828 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.589776 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vmp6g" Apr 17 18:16:19.732967 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.732933 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vmp6g"] Apr 17 18:16:19.738492 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:16:19.738465 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19562bc_c46d_49b3_8e6a_7141edee135f.slice/crio-758ef9e7d09d93d2bae0e91676d6dc9c16571d8c444c847f2d5eb82eba4c336a WatchSource:0}: Error finding container 758ef9e7d09d93d2bae0e91676d6dc9c16571d8c444c847f2d5eb82eba4c336a: Status 404 returned error can't find the container with id 758ef9e7d09d93d2bae0e91676d6dc9c16571d8c444c847f2d5eb82eba4c336a Apr 17 18:16:19.740253 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:19.740237 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 18:16:20.638291 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:20.638253 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmp6g" event={"ID":"d19562bc-c46d-49b3-8e6a-7141edee135f","Type":"ContainerStarted","Data":"758ef9e7d09d93d2bae0e91676d6dc9c16571d8c444c847f2d5eb82eba4c336a"} Apr 17 18:16:24.651449 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:24.651422 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vmp6g" event={"ID":"d19562bc-c46d-49b3-8e6a-7141edee135f","Type":"ContainerStarted","Data":"2e1e14c8c6a2ee516007718a66c6fc5eb024a27be6023f1fd072adb04d109762"} Apr 17 18:16:24.676307 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:16:24.676259 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vmp6g" podStartSLOduration=0.89465405 podStartE2EDuration="5.676241241s" podCreationTimestamp="2026-04-17 18:16:19 +0000 UTC" firstStartedPulling="2026-04-17 18:16:19.740357938 +0000 UTC m=+372.075857872" lastFinishedPulling="2026-04-17 18:16:24.521945129 +0000 UTC m=+376.857445063" observedRunningTime="2026-04-17 18:16:24.675547864 +0000 UTC m=+377.011047821" watchObservedRunningTime="2026-04-17 18:16:24.676241241 +0000 UTC m=+377.011741196" Apr 17 18:17:08.226436 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.226402 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-g7g5h"] Apr 17 18:17:08.229124 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.229106 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.232102 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.232077 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Apr 17 18:17:08.232467 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.232452 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Apr 17 18:17:08.234589 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.234563 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r6wws\"" Apr 17 18:17:08.260121 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.260101 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-g7g5h"] Apr 17 18:17:08.377189 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.377156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.377364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.377344 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kmwk\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-kube-api-access-7kmwk\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.478368 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.478318 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kmwk\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-kube-api-access-7kmwk\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.478368 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.478353 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.487302 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.487283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-bound-sa-token\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.487462 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.487446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kmwk\" (UniqueName: \"kubernetes.io/projected/ef102485-28b6-4fa3-9b55-28db89a635d7-kube-api-access-7kmwk\") pod \"cert-manager-webhook-597b96b99b-g7g5h\" (UID: \"ef102485-28b6-4fa3-9b55-28db89a635d7\") " pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.546402 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.546380 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:08.662647 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.662601 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-597b96b99b-g7g5h"] Apr 17 18:17:08.665000 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:17:08.664971 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef102485_28b6_4fa3_9b55_28db89a635d7.slice/crio-feb0a7cb64af2647b91cbc1ab9ab62edee5053504bf8a6d59c9192db19186278 WatchSource:0}: Error finding container feb0a7cb64af2647b91cbc1ab9ab62edee5053504bf8a6d59c9192db19186278: Status 404 returned error can't find the container with id feb0a7cb64af2647b91cbc1ab9ab62edee5053504bf8a6d59c9192db19186278 Apr 17 18:17:08.786055 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:08.785999 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" event={"ID":"ef102485-28b6-4fa3-9b55-28db89a635d7","Type":"ContainerStarted","Data":"feb0a7cb64af2647b91cbc1ab9ab62edee5053504bf8a6d59c9192db19186278"} Apr 17 18:17:12.801392 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:12.801352 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" event={"ID":"ef102485-28b6-4fa3-9b55-28db89a635d7","Type":"ContainerStarted","Data":"64a5be252ea7e9f59cf766591d039d5d8424d41b2768b39bd076ecf6bce9c985"} Apr 17 18:17:12.801822 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:12.801423 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:12.820427 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:12.820357 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" podStartSLOduration=1.554053225 podStartE2EDuration="4.820342308s" podCreationTimestamp="2026-04-17 18:17:08 +0000 UTC" firstStartedPulling="2026-04-17 18:17:08.666803137 +0000 UTC m=+421.002303084" lastFinishedPulling="2026-04-17 18:17:11.93309223 +0000 UTC m=+424.268592167" observedRunningTime="2026-04-17 18:17:12.818878122 +0000 UTC m=+425.154378098" watchObservedRunningTime="2026-04-17 18:17:12.820342308 +0000 UTC m=+425.155842264" Apr 17 18:17:18.807322 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:18.807293 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-597b96b99b-g7g5h" Apr 17 18:17:37.937140 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.937064 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7"] Apr 17 18:17:37.940396 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.940379 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:37.948353 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.948329 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Apr 17 18:17:37.948447 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.948329 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-rtvk6\"" Apr 17 18:17:37.948533 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.948513 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Apr 17 18:17:37.956848 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.956823 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7"] Apr 17 18:17:37.990377 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.990356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-tmp\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:37.990463 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:37.990400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjp7\" (UniqueName: \"kubernetes.io/projected/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-kube-api-access-chjp7\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.090929 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.090906 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chjp7\" (UniqueName: \"kubernetes.io/projected/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-kube-api-access-chjp7\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.091022 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.090967 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-tmp\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.091251 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.091237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-tmp\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.099239 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.099222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjp7\" (UniqueName: \"kubernetes.io/projected/4df037d4-6bed-4d8e-8fa6-1fe291dd353a-kube-api-access-chjp7\") pod \"jobset-operator-747c5859c7-2g9z7\" (UID: \"4df037d4-6bed-4d8e-8fa6-1fe291dd353a\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.249365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.249310 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" Apr 17 18:17:38.381667 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.381645 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7"] Apr 17 18:17:38.384130 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:17:38.384093 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4df037d4_6bed_4d8e_8fa6_1fe291dd353a.slice/crio-f943a2d8eb42bd48235fa9791ff25b44955d5ea725bbbf8690881ef137ab85db WatchSource:0}: Error finding container f943a2d8eb42bd48235fa9791ff25b44955d5ea725bbbf8690881ef137ab85db: Status 404 returned error can't find the container with id f943a2d8eb42bd48235fa9791ff25b44955d5ea725bbbf8690881ef137ab85db Apr 17 18:17:38.886119 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:38.886084 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" event={"ID":"4df037d4-6bed-4d8e-8fa6-1fe291dd353a","Type":"ContainerStarted","Data":"f943a2d8eb42bd48235fa9791ff25b44955d5ea725bbbf8690881ef137ab85db"} Apr 17 18:17:41.897789 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:41.897754 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" event={"ID":"4df037d4-6bed-4d8e-8fa6-1fe291dd353a","Type":"ContainerStarted","Data":"4e103efdb8d20a9fca58029586cd08299ace819cc68fe3713f191d1e9263b02a"} Apr 17 18:17:41.919178 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:17:41.919135 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-2g9z7" podStartSLOduration=1.724860987 podStartE2EDuration="4.919122226s" podCreationTimestamp="2026-04-17 18:17:37 +0000 UTC" firstStartedPulling="2026-04-17 18:17:38.38540575 +0000 UTC m=+450.720905684" lastFinishedPulling="2026-04-17 18:17:41.579666985 +0000 UTC m=+453.915166923" observedRunningTime="2026-04-17 18:17:41.919011091 +0000 UTC m=+454.254511047" watchObservedRunningTime="2026-04-17 18:17:41.919122226 +0000 UTC m=+454.254622183" Apr 17 18:18:11.632171 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.632138 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt"] Apr 17 18:18:11.637523 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.637506 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.642043 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.642024 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-69xvk\"" Apr 17 18:18:11.642274 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.642257 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Apr 17 18:18:11.642828 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.642808 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Apr 17 18:18:11.642926 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.642813 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Apr 17 18:18:11.643378 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.643363 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Apr 17 18:18:11.650469 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.650450 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt"] Apr 17 18:18:11.741005 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.740986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlr6\" (UniqueName: \"kubernetes.io/projected/67305f02-b312-47ed-826e-829044acac6d-kube-api-access-7hlr6\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.741118 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.741021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67305f02-b312-47ed-826e-829044acac6d-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.741118 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.741052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/67305f02-b312-47ed-826e-829044acac6d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.841874 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.841852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlr6\" (UniqueName: \"kubernetes.io/projected/67305f02-b312-47ed-826e-829044acac6d-kube-api-access-7hlr6\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.841963 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.841888 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67305f02-b312-47ed-826e-829044acac6d-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.841963 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.841918 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/67305f02-b312-47ed-826e-829044acac6d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.842447 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.842421 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/67305f02-b312-47ed-826e-829044acac6d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.844109 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.844088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67305f02-b312-47ed-826e-829044acac6d-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.852459 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.852439 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlr6\" (UniqueName: \"kubernetes.io/projected/67305f02-b312-47ed-826e-829044acac6d-kube-api-access-7hlr6\") pod \"kubeflow-trainer-controller-manager-55f5694779-lrkwt\" (UID: \"67305f02-b312-47ed-826e-829044acac6d\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:11.946581 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:11.946529 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:12.066041 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:12.066018 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt"] Apr 17 18:18:12.068399 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:18:12.068372 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67305f02_b312_47ed_826e_829044acac6d.slice/crio-18e7944743069a32b161cbd2661182ac1da1e7447e35c56522e0ab5604c426f7 WatchSource:0}: Error finding container 18e7944743069a32b161cbd2661182ac1da1e7447e35c56522e0ab5604c426f7: Status 404 returned error can't find the container with id 18e7944743069a32b161cbd2661182ac1da1e7447e35c56522e0ab5604c426f7 Apr 17 18:18:13.011679 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:13.011621 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" event={"ID":"67305f02-b312-47ed-826e-829044acac6d","Type":"ContainerStarted","Data":"18e7944743069a32b161cbd2661182ac1da1e7447e35c56522e0ab5604c426f7"} Apr 17 18:18:15.020414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:15.020382 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" event={"ID":"67305f02-b312-47ed-826e-829044acac6d","Type":"ContainerStarted","Data":"ad850e560f4dcd56c63184e0d7551fcf2bdcc80d0bcd425991c144c2a04750e8"} Apr 17 18:18:15.020829 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:15.020428 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:18:15.037621 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:15.037582 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" podStartSLOduration=1.87102645 podStartE2EDuration="4.037569134s" podCreationTimestamp="2026-04-17 18:18:11 +0000 UTC" firstStartedPulling="2026-04-17 18:18:12.070094563 +0000 UTC m=+484.405594498" lastFinishedPulling="2026-04-17 18:18:14.236637233 +0000 UTC m=+486.572137182" observedRunningTime="2026-04-17 18:18:15.036727036 +0000 UTC m=+487.372226984" watchObservedRunningTime="2026-04-17 18:18:15.037569134 +0000 UTC m=+487.373069088" Apr 17 18:18:31.029062 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:18:31.029027 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-lrkwt" Apr 17 18:20:08.215312 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:08.215265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:20:08.215916 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:08.215402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:20:08.219915 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:08.219890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:20:08.220123 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:08.220092 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:20:19.610217 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:19.610139 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-lrkwt_67305f02-b312-47ed-826e-829044acac6d/manager/0.log" Apr 17 18:20:20.088976 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:20.088944 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-lrkwt_67305f02-b312-47ed-826e-829044acac6d/manager/0.log" Apr 17 18:20:20.546063 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:20.546031 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-lrkwt_67305f02-b312-47ed-826e-829044acac6d/manager/0.log" Apr 17 18:20:57.570975 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.570941 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zls8/must-gather-ztw94"] Apr 17 18:20:57.573381 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.573365 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.576030 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.576010 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zls8\"/\"kube-root-ca.crt\"" Apr 17 18:20:57.577088 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.577070 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9zls8\"/\"openshift-service-ca.crt\"" Apr 17 18:20:57.577180 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.577108 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9zls8\"/\"default-dockercfg-49jmw\"" Apr 17 18:20:57.581743 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.581723 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zls8/must-gather-ztw94"] Apr 17 18:20:57.696957 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.696931 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6klh\" (UniqueName: \"kubernetes.io/projected/f5db02f9-617d-4706-825e-7b18408c1602-kube-api-access-r6klh\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.697054 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.697012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5db02f9-617d-4706-825e-7b18408c1602-must-gather-output\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.798244 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.798201 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r6klh\" (UniqueName: \"kubernetes.io/projected/f5db02f9-617d-4706-825e-7b18408c1602-kube-api-access-r6klh\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.798365 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.798325 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5db02f9-617d-4706-825e-7b18408c1602-must-gather-output\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.798661 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.798613 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f5db02f9-617d-4706-825e-7b18408c1602-must-gather-output\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.806945 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.806923 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6klh\" (UniqueName: \"kubernetes.io/projected/f5db02f9-617d-4706-825e-7b18408c1602-kube-api-access-r6klh\") pod \"must-gather-ztw94\" (UID: \"f5db02f9-617d-4706-825e-7b18408c1602\") " pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.882740 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.882707 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zls8/must-gather-ztw94" Apr 17 18:20:57.996850 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:57.996804 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zls8/must-gather-ztw94"] Apr 17 18:20:57.999200 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:20:57.999173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5db02f9_617d_4706_825e_7b18408c1602.slice/crio-f0abfff3b8d999898a3c7473b4cdb3e2bd393a33d4070cda9e34ba62a26613c2 WatchSource:0}: Error finding container f0abfff3b8d999898a3c7473b4cdb3e2bd393a33d4070cda9e34ba62a26613c2: Status 404 returned error can't find the container with id f0abfff3b8d999898a3c7473b4cdb3e2bd393a33d4070cda9e34ba62a26613c2 Apr 17 18:20:58.602713 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:58.602682 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zls8/must-gather-ztw94" event={"ID":"f5db02f9-617d-4706-825e-7b18408c1602","Type":"ContainerStarted","Data":"f0abfff3b8d999898a3c7473b4cdb3e2bd393a33d4070cda9e34ba62a26613c2"} Apr 17 18:20:59.607975 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:59.607942 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zls8/must-gather-ztw94" event={"ID":"f5db02f9-617d-4706-825e-7b18408c1602","Type":"ContainerStarted","Data":"f2955c7f1cbb2a97a09f9de613cf8eb0a895ea9c0bec36dddc9e3c99c65c608c"} Apr 17 18:20:59.607975 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:59.607977 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zls8/must-gather-ztw94" event={"ID":"f5db02f9-617d-4706-825e-7b18408c1602","Type":"ContainerStarted","Data":"bec871c3bbfa6bf05b402c7c4e79b3e9759883ddf14a18b24a75206f8075f571"} Apr 17 18:20:59.631777 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:20:59.631721 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9zls8/must-gather-ztw94" podStartSLOduration=1.7903186290000002 podStartE2EDuration="2.63170136s" podCreationTimestamp="2026-04-17 18:20:57 +0000 UTC" firstStartedPulling="2026-04-17 18:20:58.000940807 +0000 UTC m=+650.336440741" lastFinishedPulling="2026-04-17 18:20:58.842323538 +0000 UTC m=+651.177823472" observedRunningTime="2026-04-17 18:20:59.629775424 +0000 UTC m=+651.965275391" watchObservedRunningTime="2026-04-17 18:20:59.63170136 +0000 UTC m=+651.967201317" Apr 17 18:21:00.287999 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:00.287952 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vmp6g_d19562bc-c46d-49b3-8e6a-7141edee135f/global-pull-secret-syncer/0.log" Apr 17 18:21:00.381854 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:00.381826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmkjn_9d00a606-a143-4c76-9411-c88c0cded84f/konnectivity-agent/0.log" Apr 17 18:21:00.459569 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:00.459538 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-47.ec2.internal_a103039f5ca79ac6a4c1f769b0a80c09/haproxy/0.log" Apr 17 18:21:03.066750 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.066711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/alertmanager/0.log" Apr 17 18:21:03.104950 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.104906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/config-reloader/0.log" Apr 17 18:21:03.142089 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.141970 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/kube-rbac-proxy-web/0.log" Apr 17 18:21:03.171461 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.171404 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/kube-rbac-proxy/0.log" Apr 17 18:21:03.205851 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.205826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/kube-rbac-proxy-metric/0.log" Apr 17 18:21:03.246985 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.246949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/prom-label-proxy/0.log" Apr 17 18:21:03.287223 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.287197 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f97cf2c4-263c-4baa-8eb4-cbdb8bc4ed67/init-config-reloader/0.log" Apr 17 18:21:03.483745 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.483703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d875b6bdf-5m8ph_41f0ad6e-b5a5-4562-bae1-0174a388470e/metrics-server/0.log" Apr 17 18:21:03.516648 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.516601 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-dcv7p_85f584da-e5e6-4e89-a6b2-a11e0da71f80/monitoring-plugin/0.log" Apr 17 18:21:03.642009 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.641984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2ds5_1e24df65-62f1-4dd6-86ed-f754f833cb7e/node-exporter/0.log" Apr 17 18:21:03.671384 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.671353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2ds5_1e24df65-62f1-4dd6-86ed-f754f833cb7e/kube-rbac-proxy/0.log" Apr 17 18:21:03.701367 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.701337 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p2ds5_1e24df65-62f1-4dd6-86ed-f754f833cb7e/init-textfile/0.log" Apr 17 18:21:03.826610 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.826583 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-zdfc2_00da0e2b-668d-4a0c-8482-78e5ff9fa33f/kube-rbac-proxy-main/0.log" Apr 17 18:21:03.851744 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.851718 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-zdfc2_00da0e2b-668d-4a0c-8482-78e5ff9fa33f/kube-rbac-proxy-self/0.log" Apr 17 18:21:03.876831 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.876798 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-zdfc2_00da0e2b-668d-4a0c-8482-78e5ff9fa33f/openshift-state-metrics/0.log" Apr 17 18:21:03.922540 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.922505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/prometheus/0.log" Apr 17 18:21:03.954746 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.954720 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/config-reloader/0.log" Apr 17 18:21:03.986923 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:03.986893 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/thanos-sidecar/0.log" Apr 17 18:21:04.015920 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.015837 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/kube-rbac-proxy-web/0.log" Apr 17 18:21:04.049753 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.049724 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/kube-rbac-proxy/0.log" Apr 17 18:21:04.079233 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.079200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/kube-rbac-proxy-thanos/0.log" Apr 17 18:21:04.111880 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.111833 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7264f82-242c-435b-8b86-1391590bbf2f/init-config-reloader/0.log" Apr 17 18:21:04.141248 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.141217 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-p8nd8_717793ea-4328-4db0-9f1b-32332e387b76/prometheus-operator/0.log" Apr 17 18:21:04.164188 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.164165 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-p8nd8_717793ea-4328-4db0-9f1b-32332e387b76/kube-rbac-proxy/0.log" Apr 17 18:21:04.192088 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:04.192064 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-rhdb4_2887597d-dd0f-461b-93ec-713b7e01806a/prometheus-operator-admission-webhook/0.log" Apr 17 18:21:06.057213 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.057145 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/1.log" Apr 17 18:21:06.068483 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.068350 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-9d4b6777b-z9xc6_924a9d74-9241-4ce3-b95c-e513695b73e7/console-operator/2.log" Apr 17 18:21:06.440541 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.440507 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6bcc868b7-9b9km_5b5f60fe-5af8-4769-a8ea-9bcdbda2f1f7/download-server/0.log" Apr 17 18:21:06.600304 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.600268 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk"] Apr 17 18:21:06.605075 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.605052 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.611597 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.611576 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk"] Apr 17 18:21:06.699477 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.699381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-podres\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.699658 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.699502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzkbs\" (UniqueName: \"kubernetes.io/projected/54b74246-e319-4175-aefe-b6fc0d509fa8-kube-api-access-pzkbs\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.699658 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.699530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-proc\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.699658 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.699566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-lib-modules\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.699658 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.699605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-sys\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800261 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzkbs\" (UniqueName: \"kubernetes.io/projected/54b74246-e319-4175-aefe-b6fc0d509fa8-kube-api-access-pzkbs\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800425 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800272 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-proc\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800425 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800320 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-lib-modules\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800425 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800349 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-proc\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800425 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800418 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-sys\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800697 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800466 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-podres\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800697 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-lib-modules\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800697 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800530 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-sys\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.800697 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.800622 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54b74246-e319-4175-aefe-b6fc0d509fa8-podres\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.808511 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.808489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzkbs\" (UniqueName: \"kubernetes.io/projected/54b74246-e319-4175-aefe-b6fc0d509fa8-kube-api-access-pzkbs\") pod \"perf-node-gather-daemonset-9vqqk\" (UID: \"54b74246-e319-4175-aefe-b6fc0d509fa8\") " pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:06.918582 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:06.918559 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:07.049097 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.049071 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk"] Apr 17 18:21:07.051928 ip-10-0-139-47 kubenswrapper[2574]: W0417 18:21:07.051899 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod54b74246_e319_4175_aefe_b6fc0d509fa8.slice/crio-6e1624d78bea39c7d94bd9872b8782118d0626b2503c86f9cc5a2975a1dd56d1 WatchSource:0}: Error finding container 6e1624d78bea39c7d94bd9872b8782118d0626b2503c86f9cc5a2975a1dd56d1: Status 404 returned error can't find the container with id 6e1624d78bea39c7d94bd9872b8782118d0626b2503c86f9cc5a2975a1dd56d1 Apr 17 18:21:07.539721 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.539688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmmdc_b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9/dns/0.log" Apr 17 18:21:07.563844 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.563821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmmdc_b68cdfe5-fff2-4e67-b370-34c8a2b4fdc9/kube-rbac-proxy/0.log" Apr 17 18:21:07.639157 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.639132 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" event={"ID":"54b74246-e319-4175-aefe-b6fc0d509fa8","Type":"ContainerStarted","Data":"7c4570b4704987172872f55fe4b621f1542cc3a943879ca18bc9827dce88cc87"} Apr 17 18:21:07.639268 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.639162 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" event={"ID":"54b74246-e319-4175-aefe-b6fc0d509fa8","Type":"ContainerStarted","Data":"6e1624d78bea39c7d94bd9872b8782118d0626b2503c86f9cc5a2975a1dd56d1"} Apr 17 18:21:07.639321 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.639274 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:07.646409 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.646389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2mxld_7bd121bc-4898-442f-bbbb-e673a5c42e8d/dns-node-resolver/0.log" Apr 17 18:21:07.658350 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:07.658308 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" podStartSLOduration=1.658291934 podStartE2EDuration="1.658291934s" podCreationTimestamp="2026-04-17 18:21:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 18:21:07.657538766 +0000 UTC m=+659.993038723" watchObservedRunningTime="2026-04-17 18:21:07.658291934 +0000 UTC m=+659.993791891" Apr 17 18:21:08.127505 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:08.127471 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6sq4b_3f583aa9-f0c5-4df6-baa8-1e00e0442078/node-ca/0.log" Apr 17 18:21:09.202520 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.202492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8mp25_20e3ddf2-2561-496a-8a56-350b145462b9/serve-healthcheck-canary/0.log" Apr 17 18:21:09.554922 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.554831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-585dfdc468-tlzlj_358063c2-5e0c-4278-8b52-bd8bab0d8c13/insights-operator/1.log" Apr 17 18:21:09.560363 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.560336 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-585dfdc468-tlzlj_358063c2-5e0c-4278-8b52-bd8bab0d8c13/insights-operator/0.log" Apr 17 18:21:09.658417 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.658396 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l65jn_3e423360-4d0b-459d-8174-d607ee0e67ba/kube-rbac-proxy/0.log" Apr 17 18:21:09.683406 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.683383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l65jn_3e423360-4d0b-459d-8174-d607ee0e67ba/exporter/0.log" Apr 17 18:21:09.706282 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:09.706262 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l65jn_3e423360-4d0b-459d-8174-d607ee0e67ba/extractor/0.log" Apr 17 18:21:11.370726 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:11.370687 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-2g9z7_4df037d4-6bed-4d8e-8fa6-1fe291dd353a/jobset-operator/0.log" Apr 17 18:21:13.652987 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:13.652957 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9zls8/perf-node-gather-daemonset-9vqqk" Apr 17 18:21:14.666853 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:14.666812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-tnftj_10a0f856-6ff0-4be0-a0ca-35f7df85b28a/migrator/0.log" Apr 17 18:21:14.690900 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:14.690876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-tnftj_10a0f856-6ff0-4be0-a0ca-35f7df85b28a/graceful-termination/0.log" Apr 17 18:21:16.149521 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.149487 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-75gtp_1b354b11-c37f-439d-876a-c2b9ba90c04a/kube-multus/0.log" Apr 17 18:21:16.215183 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.215144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/kube-multus-additional-cni-plugins/0.log" Apr 17 18:21:16.242308 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.242282 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/egress-router-binary-copy/0.log" Apr 17 18:21:16.268291 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.268264 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/cni-plugins/0.log" Apr 17 18:21:16.296729 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.296688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/bond-cni-plugin/0.log" Apr 17 18:21:16.328789 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.328760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/routeoverride-cni/0.log" Apr 17 18:21:16.358549 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.358526 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/whereabouts-cni-bincopy/0.log" Apr 17 18:21:16.385605 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.385558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ptfqc_4b57a1dd-f9f2-4315-889b-19e7f4b51454/whereabouts-cni/0.log" Apr 17 18:21:16.887518 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.887489 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-snrz7_f716dbf1-bcde-4892-b9da-62d55e29f521/network-metrics-daemon/0.log" Apr 17 18:21:16.915155 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:16.915129 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-snrz7_f716dbf1-bcde-4892-b9da-62d55e29f521/kube-rbac-proxy/0.log" Apr 17 18:21:18.300111 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.300030 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-controller/0.log" Apr 17 18:21:18.342414 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.342391 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/0.log" Apr 17 18:21:18.345293 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.345274 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovn-acl-logging/1.log" Apr 17 18:21:18.385532 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.385511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/kube-rbac-proxy-node/0.log" Apr 17 18:21:18.434982 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.434949 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/kube-rbac-proxy-ovn-metrics/0.log" Apr 17 18:21:18.479765 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.479746 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/northd/0.log" Apr 17 18:21:18.525320 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.525303 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/nbdb/0.log" Apr 17 18:21:18.567330 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.567280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/sbdb/0.log" Apr 17 18:21:18.693235 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:18.693214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sk45l_90cffb2f-3b60-4f42-b9c0-a8a1b430bdff/ovnkube-controller/0.log" Apr 17 18:21:19.671247 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:19.671219 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-8894fc9bd-5qnqd_e7b2da7d-be8d-4a3e-a490-2906d6b8299f/check-endpoints/0.log" Apr 17 18:21:19.705485 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:19.705461 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f529d_e385f165-5bc7-4270-8367-299a14868662/network-check-target-container/0.log" Apr 17 18:21:20.772315 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:20.772289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6ql96_cc9e76ee-0f23-4da8-ac35-76f4927ab685/iptables-alerter/0.log" Apr 17 18:21:21.482364 ip-10-0-139-47 kubenswrapper[2574]: I0417 18:21:21.482335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dhqmw_859128d1-b8f5-4792-b699-05e8bc2cef37/tuned/0.log"