Apr 17 10:17:49.796977 ip-10-0-137-54 systemd[1]: Starting Kubernetes Kubelet... Apr 17 10:17:50.237772 ip-10-0-137-54 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 10:17:50.237772 ip-10-0-137-54 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 17 10:17:50.237772 ip-10-0-137-54 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 10:17:50.237772 ip-10-0-137-54 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 17 10:17:50.237772 ip-10-0-137-54 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 10:17:50.241132 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.241018 2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 17 10:17:50.244268 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244253 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 10:17:50.244268 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244268 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244272 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244276 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244279 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244282 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244285 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244289 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244291 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244294 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244297 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244300 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244311 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244319 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244322 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244325 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244328 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244330 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244333 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244336 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 10:17:50.244329 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244339 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244341 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244344 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244347 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244349 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244352 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244354 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244357 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244360 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244362 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244364 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244367 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244371 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244375 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244378 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244380 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244383 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244385 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244388 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244390 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 10:17:50.244789 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244392 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244395 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244397 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244400 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244402 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244404 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244412 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244415 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244418 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244420 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244422 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244425 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244427 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244430 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244433 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244436 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244438 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244441 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244444 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 10:17:50.245382 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244447 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244449 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244451 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244455 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244457 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244460 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244464 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244467 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244470 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244473 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244476 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244479 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244482 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244485 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244488 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244492 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244495 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244497 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244500 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244502 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 10:17:50.245887 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244512 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244514 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244517 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244520 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244522 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244525 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244528 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244943 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244949 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244952 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244955 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244958 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244961 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244964 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244967 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244969 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244972 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244975 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244977 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 10:17:50.246369 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244981 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244985 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244987 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244990 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244993 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.244997 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245000 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245003 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245007 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245010 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245012 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245014 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245017 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245024 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245026 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245030 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245033 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245036 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245038 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245041 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 10:17:50.246872 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245043 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245045 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245048 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245050 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245053 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245055 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245057 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245060 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245063 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245065 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245067 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245070 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245072 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245075 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245078 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245080 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245082 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245085 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245088 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245090 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 10:17:50.247391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245093 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245096 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245098 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245101 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245104 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245106 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245109 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245112 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245114 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245117 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245120 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245122 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245124 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245127 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245130 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245132 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245135 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245137 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245140 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245142 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 10:17:50.247907 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245145 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245147 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245149 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245152 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245155 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245158 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245160 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245163 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245165 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245168 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245170 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245173 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245180 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.245182 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.245981 2573 flags.go:64] FLAG: --address="0.0.0.0" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.245991 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.245998 2573 flags.go:64] FLAG: --anonymous-auth="true" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246003 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246007 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246011 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246016 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 17 10:17:50.248712 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246021 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246024 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246027 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246031 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246034 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246037 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246040 2573 flags.go:64] FLAG: --cgroup-root="" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246043 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246046 2573 flags.go:64] FLAG: --client-ca-file="" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246048 2573 flags.go:64] FLAG: --cloud-config="" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246051 2573 flags.go:64] FLAG: --cloud-provider="external" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246054 2573 flags.go:64] FLAG: --cluster-dns="[]" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246058 2573 flags.go:64] FLAG: --cluster-domain="" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246061 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246064 2573 flags.go:64] FLAG: --config-dir="" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246067 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246070 2573 flags.go:64] FLAG: --container-log-max-files="5" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246074 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246077 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246080 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246083 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246086 2573 flags.go:64] FLAG: --contention-profiling="false" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246090 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246095 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246098 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 17 10:17:50.249304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246101 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246106 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246109 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246111 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246114 2573 flags.go:64] FLAG: --enable-load-reader="false" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246117 2573 flags.go:64] FLAG: --enable-server="true" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246121 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246125 2573 flags.go:64] FLAG: --event-burst="100" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246129 2573 flags.go:64] FLAG: --event-qps="50" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246132 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246135 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246138 2573 flags.go:64] FLAG: --eviction-hard="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246142 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246144 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246147 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246151 2573 flags.go:64] FLAG: --eviction-soft="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246154 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246157 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246160 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246163 2573 flags.go:64] FLAG: --experimental-mounter-path="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246166 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246169 2573 flags.go:64] FLAG: --fail-swap-on="true" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246172 2573 flags.go:64] FLAG: --feature-gates="" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246175 2573 flags.go:64] FLAG: --file-check-frequency="20s" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246178 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 17 10:17:50.249948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246181 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246184 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246188 2573 flags.go:64] FLAG: --healthz-port="10248" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246191 2573 flags.go:64] FLAG: --help="false" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246194 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246198 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246201 2573 flags.go:64] FLAG: --http-check-frequency="20s" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246204 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246207 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246211 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246214 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246216 2573 flags.go:64] FLAG: --image-service-endpoint="" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246219 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246222 2573 flags.go:64] FLAG: --kube-api-burst="100" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246225 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246229 2573 flags.go:64] FLAG: --kube-api-qps="50" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246232 2573 flags.go:64] FLAG: --kube-reserved="" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246235 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246237 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246240 2573 flags.go:64] FLAG: --kubelet-cgroups="" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246243 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246246 2573 flags.go:64] FLAG: --lock-file="" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246249 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246252 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 17 10:17:50.250562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246255 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246260 2573 flags.go:64] FLAG: --log-json-split-stream="false" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246263 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246265 2573 flags.go:64] FLAG: --log-text-split-stream="false" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246269 2573 flags.go:64] FLAG: --logging-format="text" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246272 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246275 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246277 2573 flags.go:64] FLAG: --manifest-url="" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246280 2573 flags.go:64] FLAG: --manifest-url-header="" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246285 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246287 2573 flags.go:64] FLAG: --max-open-files="1000000" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246291 2573 flags.go:64] FLAG: --max-pods="110" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246295 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246299 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246302 2573 flags.go:64] FLAG: --memory-manager-policy="None" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246304 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246307 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246310 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246313 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246321 2573 flags.go:64] FLAG: --node-status-max-images="50" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246324 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246327 2573 flags.go:64] FLAG: --oom-score-adj="-999" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246330 2573 flags.go:64] FLAG: --pod-cidr="" Apr 17 10:17:50.251156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246333 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246339 2573 flags.go:64] FLAG: --pod-manifest-path="" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246342 2573 flags.go:64] FLAG: --pod-max-pids="-1" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246345 2573 flags.go:64] FLAG: --pods-per-core="0" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246348 2573 flags.go:64] FLAG: --port="10250" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246351 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246354 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdee20fcfc9ba7c6" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246357 2573 flags.go:64] FLAG: --qos-reserved="" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246360 2573 flags.go:64] FLAG: --read-only-port="10255" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246362 2573 flags.go:64] FLAG: --register-node="true" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246365 2573 flags.go:64] FLAG: --register-schedulable="true" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246368 2573 flags.go:64] FLAG: --register-with-taints="" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246372 2573 flags.go:64] FLAG: --registry-burst="10" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246376 2573 flags.go:64] FLAG: --registry-qps="5" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246379 2573 flags.go:64] FLAG: --reserved-cpus="" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246382 2573 flags.go:64] FLAG: --reserved-memory="" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246386 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246389 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246392 2573 flags.go:64] FLAG: --rotate-certificates="false" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246394 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246397 2573 flags.go:64] FLAG: --runonce="false" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246400 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246403 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246408 2573 flags.go:64] FLAG: --seccomp-default="false" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246411 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246414 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 17 10:17:50.251699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246417 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246420 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246423 2573 flags.go:64] FLAG: --storage-driver-password="root" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246426 2573 flags.go:64] FLAG: --storage-driver-secure="false" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246428 2573 flags.go:64] FLAG: --storage-driver-table="stats" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246431 2573 flags.go:64] FLAG: --storage-driver-user="root" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246434 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246438 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246441 2573 flags.go:64] FLAG: --system-cgroups="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246447 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246453 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246456 2573 flags.go:64] FLAG: --tls-cert-file="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246459 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246463 2573 flags.go:64] FLAG: --tls-min-version="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246466 2573 flags.go:64] FLAG: --tls-private-key-file="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246468 2573 flags.go:64] FLAG: --topology-manager-policy="none" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246471 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246474 2573 flags.go:64] FLAG: --topology-manager-scope="container" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246477 2573 flags.go:64] FLAG: --v="2" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246482 2573 flags.go:64] FLAG: --version="false" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246486 2573 flags.go:64] FLAG: --vmodule="" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246490 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246494 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246587 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246591 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 10:17:50.252338 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246594 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246596 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246599 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246602 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246606 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246609 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246611 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246614 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246616 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246619 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246621 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246624 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246626 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246629 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246631 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246634 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246637 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246639 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246642 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246644 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 10:17:50.252939 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246647 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246649 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246652 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246654 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246657 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246661 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246663 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246665 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246668 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246671 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246673 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246676 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246679 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246683 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246686 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246688 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246692 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246694 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246697 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246699 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 10:17:50.253486 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246702 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246704 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246708 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246711 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246714 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246717 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246720 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246722 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246736 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246740 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246742 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246745 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246748 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246750 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246753 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246756 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246758 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246763 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246765 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 10:17:50.253996 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246767 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246770 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246772 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246775 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246777 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246780 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246783 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246785 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246788 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246792 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246795 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246798 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246801 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246803 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246806 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246808 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246811 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246813 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246816 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 10:17:50.254464 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246818 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246821 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246823 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246826 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246829 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.246847 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.246853 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.254612 2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.254628 2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254672 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254677 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254681 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254686 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254689 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254692 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 10:17:50.254952 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254695 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254698 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254701 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254703 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254706 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254709 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254712 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254714 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254717 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254719 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254722 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254725 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254743 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254746 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254749 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254751 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254754 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254757 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254760 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254763 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 10:17:50.255321 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254767 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254769 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254772 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254774 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254777 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254780 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254782 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254785 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254787 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254790 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254792 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254795 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254798 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254800 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254803 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254806 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254808 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254810 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254813 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254816 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 10:17:50.255846 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254819 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254821 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254824 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254827 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254830 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254832 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254835 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254837 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254840 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254842 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254845 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254847 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254850 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254853 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254855 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254858 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254860 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254863 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254865 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254868 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 10:17:50.256327 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254870 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254873 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254875 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254878 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254880 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254883 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254885 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254887 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254890 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254893 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254896 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254898 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254901 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254903 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254906 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254909 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254911 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254915 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254919 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 10:17:50.256853 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.254921 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.254926 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255025 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255030 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255033 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255036 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255039 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255042 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255044 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255047 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255050 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255052 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255055 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255058 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255060 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255063 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 10:17:50.257324 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255065 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255068 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255070 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255073 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255075 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255077 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255080 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255083 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255086 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255088 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255091 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255094 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255097 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255100 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255103 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255106 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255108 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255110 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255113 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255116 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 10:17:50.257737 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255118 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255121 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255123 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255126 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255128 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255130 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255133 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255137 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255140 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255143 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255145 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255148 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255151 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255153 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255156 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255158 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255161 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255163 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255165 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 10:17:50.258220 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255168 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255171 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255173 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255176 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255179 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255181 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255184 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255186 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255190 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255193 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255196 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255198 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255200 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255203 2573 feature_gate.go:328] unrecognized feature gate: Example Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255205 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255208 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255210 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255213 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255215 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255217 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 10:17:50.258681 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255220 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255222 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255225 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255227 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255230 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255232 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255234 2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255237 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255240 2573 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255242 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255245 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255247 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:50.255249 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.255254 2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 10:17:50.259177 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.255834 2573 server.go:962] "Client rotation is on, will bootstrap in background" Apr 17 10:17:50.260407 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.260393 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 17 10:17:50.261259 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.261248 2573 server.go:1019] "Starting client certificate rotation" Apr 17 10:17:50.261373 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.261352 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 10:17:50.261425 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.261405 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 10:17:50.285209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.285191 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 10:17:50.290812 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.290798 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 10:17:50.304050 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.304030 2573 log.go:25] "Validated CRI v1 runtime API" Apr 17 10:17:50.309839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.309820 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 10:17:50.310101 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.310089 2573 log.go:25] "Validated CRI v1 image API" Apr 17 10:17:50.312050 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.312036 2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 17 10:17:50.315442 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.315424 2573 fs.go:135] Filesystem UUIDs: map[7773e6f7-8755-49ca-a40a-a1ef9a508ba5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 97d3cb81-b1ec-4ada-ba33-8dfbabe69df1:/dev/nvme0n1p4] Apr 17 10:17:50.315488 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.315442 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 17 10:17:50.320800 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.320685 2573 manager.go:217] Machine: {Timestamp:2026-04-17 10:17:50.31954177 +0000 UTC m=+0.404328916 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103564 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fd5c5e1aa8b808a3dd837a660d7fa SystemUUID:ec2fd5c5-e1aa-8b80-8a3d-d837a660d7fa BootID:9e1ce162-351e-44de-bf2d-591287b65ae2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7a:58:4d:1c:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7a:58:4d:1c:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:52:1c:03:58:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 17 10:17:50.320800 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.320796 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 17 10:17:50.320897 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.320866 2573 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 17 10:17:50.323506 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.323482 2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 17 10:17:50.323643 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.323508 2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 17 10:17:50.324290 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.324280 2573 topology_manager.go:138] "Creating topology manager with none policy" Apr 17 10:17:50.324328 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.324292 2573 container_manager_linux.go:306] "Creating device plugin manager" Apr 17 10:17:50.324328 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.324304 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 10:17:50.325046 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.325036 2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 10:17:50.326708 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.326697 2573 state_mem.go:36] "Initialized new in-memory state store" Apr 17 10:17:50.326850 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.326840 2573 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 17 10:17:50.329127 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.329117 2573 kubelet.go:491] "Attempting to sync node with API server" Apr 17 10:17:50.329159 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.329131 2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 17 10:17:50.329159 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.329142 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 17 10:17:50.329159 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.329151 2573 kubelet.go:397] "Adding apiserver pod source" Apr 17 10:17:50.329240 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.329160 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 17 10:17:50.330158 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.330146 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 10:17:50.330204 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.330164 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 10:17:50.333223 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.333206 2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 17 10:17:50.334586 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.334573 2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 17 10:17:50.336461 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336446 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 17 10:17:50.336497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336470 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 17 10:17:50.336497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336480 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 17 10:17:50.336497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336488 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 17 10:17:50.336497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336496 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336503 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336508 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336514 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336520 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336526 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336543 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 17 10:17:50.336608 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.336552 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 17 10:17:50.337282 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.337271 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 17 10:17:50.337282 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.337281 2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 17 10:17:50.340649 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.340637 2573 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 17 10:17:50.340688 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.340672 2573 server.go:1295] "Started kubelet" Apr 17 10:17:50.340805 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.340780 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 17 10:17:50.341172 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.341123 2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 17 10:17:50.341238 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.341195 2573 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 17 10:17:50.341448 ip-10-0-137-54 systemd[1]: Started Kubernetes Kubelet. Apr 17 10:17:50.342647 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.342623 2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 17 10:17:50.343171 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.343154 2573 server.go:317] "Adding debug handlers to kubelet server" Apr 17 10:17:50.344489 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.344435 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 17 10:17:50.344588 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.344558 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Apr 17 10:17:50.346651 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.346630 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvdvb" Apr 17 10:17:50.348243 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.347624 2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Apr 17 10:17:50.350689 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.350666 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 17 10:17:50.351202 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.351187 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 17 10:17:50.352267 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352205 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 17 10:17:50.352267 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352226 2573 factory.go:55] Registering systemd factory Apr 17 10:17:50.352267 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352236 2573 factory.go:223] Registration of the systemd container factory successfully Apr 17 10:17:50.352485 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352467 2573 factory.go:153] Registering CRI-O factory Apr 17 10:17:50.352537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352488 2573 factory.go:223] Registration of the crio container factory successfully Apr 17 10:17:50.352537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352515 2573 factory.go:103] Registering Raw factory Apr 17 10:17:50.352537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352528 2573 manager.go:1196] Started watching for new ooms in manager Apr 17 10:17:50.352872 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352850 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvdvb" Apr 17 10:17:50.352990 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352970 2573 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 17 10:17:50.352990 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.352988 2573 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 17 10:17:50.353143 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.353080 2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 17 10:17:50.353143 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.353093 2573 manager.go:319] Starting recovery of all containers Apr 17 10:17:50.353143 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.353143 2573 reconstruct.go:97] "Volume reconstruction finished" Apr 17 10:17:50.353279 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.353150 2573 reconciler.go:26] "Reconciler: start to sync state" Apr 17 10:17:50.353279 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.353209 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.354197 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.354162 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 17 10:17:50.354281 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.354262 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Apr 17 10:17:50.355310 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.354327 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-54.ec2.internal.18a71d8d352c74cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-54.ec2.internal,UID:ip-10-0-137-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-54.ec2.internal,},FirstTimestamp:2026-04-17 10:17:50.340650188 +0000 UTC m=+0.425437332,LastTimestamp:2026-04-17 10:17:50.340650188 +0000 UTC m=+0.425437332,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-54.ec2.internal,}" Apr 17 10:17:50.356253 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.355996 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Apr 17 10:17:50.363007 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.362870 2573 manager.go:324] Recovery completed Apr 17 10:17:50.366989 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.366973 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.371756 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.371741 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.371843 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.371770 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.371843 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.371786 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.372236 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.372223 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 17 10:17:50.372289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.372236 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 17 10:17:50.372289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.372255 2573 state_mem.go:36] "Initialized new in-memory state store" Apr 17 10:17:50.374984 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.374968 2573 policy_none.go:49] "None policy: Start" Apr 17 10:17:50.374984 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.374983 2573 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 17 10:17:50.375069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.374993 2573 state_mem.go:35] "Initializing new in-memory state store" Apr 17 10:17:50.419255 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419235 2573 manager.go:341] "Starting Device Plugin manager" Apr 17 10:17:50.419372 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.419267 2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 17 10:17:50.419372 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419279 2573 server.go:85] "Starting device plugin registration server" Apr 17 10:17:50.419507 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419495 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 17 10:17:50.419566 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419508 2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 17 10:17:50.419614 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419582 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 17 10:17:50.419717 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419683 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 17 10:17:50.419717 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.419704 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 17 10:17:50.420098 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.420078 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 17 10:17:50.420159 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.420118 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.472077 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.472057 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 17 10:17:50.473170 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.473151 2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 17 10:17:50.473237 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.473174 2573 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 17 10:17:50.473237 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.473194 2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 17 10:17:50.473237 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.473201 2573 kubelet.go:2451] "Starting kubelet main sync loop" Apr 17 10:17:50.473237 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.473230 2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 17 10:17:50.475692 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.475670 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 10:17:50.519616 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.519570 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.520384 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.520371 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.520443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.520398 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.520443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.520414 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.520443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.520442 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.526637 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.526623 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.526687 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.526643 2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-54.ec2.internal\": node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.546092 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.546074 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.573802 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.573781 2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal"] Apr 17 10:17:50.573865 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.573836 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.574604 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.574588 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.574654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.574620 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.574654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.574631 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.575811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.575799 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.575963 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.575948 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.576002 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.575985 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.577551 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577537 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.577609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577561 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.577609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577573 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.577609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577598 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.577714 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577618 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.577714 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.577628 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.578567 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.578554 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.578632 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.578577 2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 10:17:50.579140 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.579125 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientMemory" Apr 17 10:17:50.579216 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.579152 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 10:17:50.579216 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.579166 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeHasSufficientPID" Apr 17 10:17:50.604274 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.604256 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-54.ec2.internal\" not found" node="ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.608477 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.608462 2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-54.ec2.internal\" not found" node="ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.646638 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.646620 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.747472 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.747447 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.755978 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.755963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.756034 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.755985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.756034 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.756001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1864926e2034b566e595c9007c5b736f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-54.ec2.internal\" (UID: \"1864926e2034b566e595c9007c5b736f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.848370 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.848321 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:50.856802 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856785 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.856858 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856807 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.856858 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856823 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1864926e2034b566e595c9007c5b736f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-54.ec2.internal\" (UID: \"1864926e2034b566e595c9007c5b736f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.856928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856864 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1864926e2034b566e595c9007c5b736f-config\") pod \"kube-apiserver-proxy-ip-10-0-137-54.ec2.internal\" (UID: \"1864926e2034b566e595c9007c5b736f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.856928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856885 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.856928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.856890 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c3f6b6e86e354ce469790597636bd09-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal\" (UID: \"2c3f6b6e86e354ce469790597636bd09\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.905924 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.905903 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.911669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:50.911655 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:50.949079 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:50.949058 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.049623 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.049604 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.150235 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.150211 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.250789 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.250767 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.261866 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.261849 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 17 10:17:51.262011 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.261987 2573 request.go:1360] "Unexpected error when reading response body" err="read tcp 10.0.137.54:38714->32.193.118.12:6443: use of closed network connection" Apr 17 10:17:51.262011 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.262000 2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 10:17:51.262101 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.262063 2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.137.54:38714->32.193.118.12:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Apr 17 10:17:51.349595 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:51.349558 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3f6b6e86e354ce469790597636bd09.slice/crio-9ee824c8795eef1f762292f2e1a99532382665c0448b9f6ee09a23aa13308f46 WatchSource:0}: Error finding container 9ee824c8795eef1f762292f2e1a99532382665c0448b9f6ee09a23aa13308f46: Status 404 returned error can't find the container with id 9ee824c8795eef1f762292f2e1a99532382665c0448b9f6ee09a23aa13308f46 Apr 17 10:17:51.349801 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:51.349788 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1864926e2034b566e595c9007c5b736f.slice/crio-ba0de85a62e9e47987c43f7297db57277626bf87f9d0d286a49799cd427eb79e WatchSource:0}: Error finding container ba0de85a62e9e47987c43f7297db57277626bf87f9d0d286a49799cd427eb79e: Status 404 returned error can't find the container with id ba0de85a62e9e47987c43f7297db57277626bf87f9d0d286a49799cd427eb79e Apr 17 10:17:51.351684 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.351666 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.351751 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.351686 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 17 10:17:51.354176 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.354161 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 10:17:51.356037 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.356011 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-16 10:12:50 +0000 UTC" deadline="2027-09-15 20:10:43.817176075 +0000 UTC" Apr 17 10:17:51.356037 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.356035 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12393h52m52.461143843s" Apr 17 10:17:51.365468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.365450 2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 10:17:51.386565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.386542 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hmtcf" Apr 17 10:17:51.393662 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.393644 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hmtcf" Apr 17 10:17:51.451931 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.451872 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.476106 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.476064 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" event={"ID":"2c3f6b6e86e354ce469790597636bd09","Type":"ContainerStarted","Data":"9ee824c8795eef1f762292f2e1a99532382665c0448b9f6ee09a23aa13308f46"} Apr 17 10:17:51.477076 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.477058 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" event={"ID":"1864926e2034b566e595c9007c5b736f","Type":"ContainerStarted","Data":"ba0de85a62e9e47987c43f7297db57277626bf87f9d0d286a49799cd427eb79e"} Apr 17 10:17:51.552267 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.552244 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.652711 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:51.652681 2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-54.ec2.internal\" not found" Apr 17 10:17:51.686398 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.686378 2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 10:17:51.752135 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.752071 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" Apr 17 10:17:51.763459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.763427 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 10:17:51.765073 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.765054 2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" Apr 17 10:17:51.772011 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.771990 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 10:17:51.861290 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:51.861266 2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 10:17:52.302685 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.302655 2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 10:17:52.329823 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.329797 2573 apiserver.go:52] "Watching apiserver" Apr 17 10:17:52.336990 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.336957 2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 17 10:17:52.337382 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.337354 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-7pp2p","openshift-network-diagnostics/network-check-target-vtvnj","openshift-network-operator/iptables-alerter-qlxms","openshift-ovn-kubernetes/ovnkube-node-hcw2v","kube-system/konnectivity-agent-wv4jf","kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2","openshift-cluster-node-tuning-operator/tuned-t7m6g","openshift-dns/node-resolver-ggkjk","openshift-image-registry/node-ca-vcqsp","openshift-multus/multus-additional-cni-plugins-9nt26","openshift-multus/network-metrics-daemon-m98nc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal"] Apr 17 10:17:52.340177 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.340152 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.341449 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.341160 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:52.341449 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.341255 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.341449 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.341262 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:17:52.342227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.342205 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 17 10:17:52.342362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.342217 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tv4kt\"" Apr 17 10:17:52.342362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.342347 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.342667 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.342636 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.342667 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.342664 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.343401 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.343366 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.343674 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.343655 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dvbjs\"" Apr 17 10:17:52.343823 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.343703 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 17 10:17:52.343823 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.343659 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.344413 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.344390 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.344527 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.344510 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 17 10:17:52.344616 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.344599 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 17 10:17:52.344959 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.344926 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.345048 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.345009 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.345048 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.345024 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-glgn2\"" Apr 17 10:17:52.345152 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.345069 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 17 10:17:52.345447 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.345430 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 17 10:17:52.346443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.346423 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.347179 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.347161 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 17 10:17:52.347266 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.347180 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gjf8s\"" Apr 17 10:17:52.347266 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.347180 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 17 10:17:52.347870 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.347682 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.347870 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.347799 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.349070 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.348361 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349162 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349175 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349220 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349299 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzmwn\"" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349222 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.349610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.349535 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.350399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350118 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.350399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350221 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.350399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350268 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wrk6p\"" Apr 17 10:17:52.350399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350309 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.350641 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350622 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4cpp5\"" Apr 17 10:17:52.350752 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.350643 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.351450 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.351431 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 17 10:17:52.351549 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.351438 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 17 10:17:52.352228 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.352199 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tbk5h\"" Apr 17 10:17:52.352340 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.352295 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 17 10:17:52.353788 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.352692 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.353788 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.352789 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:17:52.353788 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.352903 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 17 10:17:52.353788 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.352959 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 17 10:17:52.353788 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.353205 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c4lzl\"" Apr 17 10:17:52.355320 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.355300 2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 17 10:17:52.365100 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-config\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.365192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a56c223-6f9a-4c5a-8392-334fd6dc816a-konnectivity-ca\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.365192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1e743b-6e54-4775-8d57-1fa715225b0c-tmp-dir\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.365192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-sys-fs\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-hostroot\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-daemon-config\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-tmp\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a56c223-6f9a-4c5a-8392-334fd6dc816a-agent-certs\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.365347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63c112ba-178e-4698-98b1-86e360e40e1f-iptables-alerter-script\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-socket-dir-parent\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365442 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-var-lib-kubelet\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-netns\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365501 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-systemd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365536 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-var-lib-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365575 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwc97\" (UniqueName: \"kubernetes.io/projected/dcddce02-c375-4299-ad44-c965e1124126-kube-api-access-xwc97\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-multus\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-systemd-units\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.365668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-script-lib\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-os-release\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-etc-kubernetes\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-tuned\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365835 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cp9\" (UniqueName: \"kubernetes.io/projected/63c112ba-178e-4698-98b1-86e360e40e1f-kube-api-access-d6cp9\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-kubelet\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-ovn\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-bin\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-os-release\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cni-binary-copy\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-modprobe-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.365990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcddce02-c375-4299-ad44-c965e1124126-ovn-node-metrics-cert\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366048 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysconfig\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dz8\" (UniqueName: \"kubernetes.io/projected/30812199-596c-4ab1-b17b-ef92026124e6-kube-api-access-h7dz8\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.366178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-etc-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-log-socket\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c1e743b-6e54-4775-8d57-1fa715225b0c-hosts-file\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-registration-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-multus-certs\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-run\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-sys\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-host\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-node-log\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366357 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-env-overrides\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-cnibin\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366411 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c112ba-178e-4698-98b1-86e360e40e1f-host-slash\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366448 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cnibin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-k8s-cni-cncf-io\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366494 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-conf-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42effdd5-51bf-43b7-8555-1a026f723453-host\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-netns\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.366958 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvgn\" (UniqueName: \"kubernetes.io/projected/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kube-api-access-txvgn\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-kubernetes\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-slash\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366790 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42effdd5-51bf-43b7-8555-1a026f723453-serviceca\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366814 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366839 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzrnk\" (UniqueName: \"kubernetes.io/projected/4c1e743b-6e54-4775-8d57-1fa715225b0c-kube-api-access-xzrnk\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-system-cni-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gmwg\" (UniqueName: \"kubernetes.io/projected/ac14beab-8114-493d-a919-16f44a7217f1-kube-api-access-9gmwg\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-socket-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.366982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxdsd\" (UniqueName: \"kubernetes.io/projected/42effdd5-51bf-43b7-8555-1a026f723453-kube-api-access-pxdsd\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-netd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.367669 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367036 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-bin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-systemd\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjfc2\" (UniqueName: \"kubernetes.io/projected/aacb1d0c-ad9c-456a-854d-00b4fc54085b-kube-api-access-sjfc2\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-device-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-system-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-kubelet\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b85m\" (UniqueName: \"kubernetes.io/projected/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-kube-api-access-6b85m\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-conf\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-lib-modules\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.368303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.367306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.394305 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.394284 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 10:12:51 +0000 UTC" deadline="2027-09-20 02:42:48.974540149 +0000 UTC" Apr 17 10:17:52.394305 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.394305 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12496h24m56.580238515s" Apr 17 10:17:52.467641 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467613 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-env-overrides\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467650 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-cnibin\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467672 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c112ba-178e-4698-98b1-86e360e40e1f-host-slash\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467694 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cnibin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467764 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-k8s-cni-cncf-io\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467786 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-conf-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467808 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42effdd5-51bf-43b7-8555-1a026f723453-host\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467833 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-netns\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.467874 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467857 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467879 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txvgn\" (UniqueName: \"kubernetes.io/projected/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kube-api-access-txvgn\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467905 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-kubernetes\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467930 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467954 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-slash\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.467997 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468023 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42effdd5-51bf-43b7-8555-1a026f723453-serviceca\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468049 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468075 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468127 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzrnk\" (UniqueName: \"kubernetes.io/projected/4c1e743b-6e54-4775-8d57-1fa715225b0c-kube-api-access-xzrnk\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468156 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-system-cni-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468184 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gmwg\" (UniqueName: \"kubernetes.io/projected/ac14beab-8114-493d-a919-16f44a7217f1-kube-api-access-9gmwg\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.468262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468212 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-socket-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-system-cni-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-kubernetes\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-socket-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468389 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468437 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxdsd\" (UniqueName: \"kubernetes.io/projected/42effdd5-51bf-43b7-8555-1a026f723453-kube-api-access-pxdsd\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468455 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-netd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468480 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-bin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468506 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-systemd\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468560 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-systemd\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-k8s-cni-cncf-io\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.468836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-slash\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-env-overrides\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.468628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-cnibin\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-netd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-bin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469162 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63c112ba-178e-4698-98b1-86e360e40e1f-host-slash\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469079 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42effdd5-51bf-43b7-8555-1a026f723453-serviceca\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-conf-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42effdd5-51bf-43b7-8555-1a026f723453-host\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-run-netns\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cnibin\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.469426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469275 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.469938 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469803 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjfc2\" (UniqueName: \"kubernetes.io/projected/aacb1d0c-ad9c-456a-854d-00b4fc54085b-kube-api-access-sjfc2\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.469938 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469864 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-device-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.469938 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469934 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-system-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469977 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-kubelet\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.469978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-device-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-system-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470067 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b85m\" (UniqueName: \"kubernetes.io/projected/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-kube-api-access-6b85m\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470084 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-kubelet\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470135 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-conf\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470185 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-lib-modules\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470213 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-conf\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470246 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.470330 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:52.470350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470342 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-config\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-lib-modules\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470385 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a56c223-6f9a-4c5a-8392-334fd6dc816a-konnectivity-ca\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.470416 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:52.970380064 +0000 UTC m=+3.055167220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470456 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1e743b-6e54-4775-8d57-1fa715225b0c-tmp-dir\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470487 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-sys-fs\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470511 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-hostroot\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470542 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-daemon-config\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470573 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470602 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-tmp\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.470655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470633 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a56c223-6f9a-4c5a-8392-334fd6dc816a-agent-certs\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470660 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470668 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-hostroot\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470711 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470812 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-sys-fs\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470858 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63c112ba-178e-4698-98b1-86e360e40e1f-iptables-alerter-script\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470883 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysctl-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470903 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-socket-dir-parent\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-config\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470938 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-var-lib-kubelet\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470981 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-netns\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.470995 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-var-lib-kubelet\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471016 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-systemd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471044 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-var-lib-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471077 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwc97\" (UniqueName: \"kubernetes.io/projected/dcddce02-c375-4299-ad44-c965e1124126-kube-api-access-xwc97\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c1e743b-6e54-4775-8d57-1fa715225b0c-tmp-dir\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471109 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471153 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-socket-dir-parent\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471161 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-multus\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471208 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-systemd\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-var-lib-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471390 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-systemd-units\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471423 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-script-lib\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471459 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471490 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-os-release\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471515 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-etc-kubernetes\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471544 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-tuned\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471579 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cp9\" (UniqueName: \"kubernetes.io/projected/63c112ba-178e-4698-98b1-86e360e40e1f-kube-api-access-d6cp9\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471613 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-kubelet\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471646 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-ovn\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471673 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-bin\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.471710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471705 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-os-release\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471779 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cni-binary-copy\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471814 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-modprobe-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471926 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcddce02-c375-4299-ad44-c965e1124126-ovn-node-metrics-cert\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.471971 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472001 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysconfig\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472038 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dz8\" (UniqueName: \"kubernetes.io/projected/30812199-596c-4ab1-b17b-ef92026124e6-kube-api-access-h7dz8\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63c112ba-178e-4698-98b1-86e360e40e1f-iptables-alerter-script\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472075 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-etc-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472127 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-netns\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472130 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-log-socket\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-var-lib-cni-multus\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-log-socket\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472169 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c1e743b-6e54-4775-8d57-1fa715225b0c-hosts-file\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472208 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-registration-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c1e743b-6e54-4775-8d57-1fa715225b0c-hosts-file\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-etc-openvswitch\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.472452 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472242 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-multus-certs\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472259 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-systemd-units\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472274 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-run\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472256 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472307 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-sys\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472331 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-host\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472361 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-node-log\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472453 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-node-log\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472070 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-daemon-config\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccb0777e-660e-4973-a4b3-53a5e504b9b3-registration-dir\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-host-run-multus-certs\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-run\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-sys\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472770 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a56c223-6f9a-4c5a-8392-334fd6dc816a-konnectivity-ca\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-host\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472775 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dcddce02-c375-4299-ad44-c965e1124126-ovnkube-script-lib\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472867 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-os-release\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-multus-cni-dir\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472958 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-kubelet\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.473227 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.473011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-run-ovn\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.472878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dcddce02-c375-4299-ad44-c965e1124126-host-cni-bin\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.473035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.473076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac14beab-8114-493d-a919-16f44a7217f1-os-release\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.473706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac14beab-8114-493d-a919-16f44a7217f1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.473800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-cni-binary-copy\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.473920 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.473942 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.473956 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:52.474087 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.474026 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:52.974008548 +0000 UTC m=+3.058795696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:52.474555 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.474090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-etc-kubernetes\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.474555 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.474094 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-sysconfig\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.474555 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.474375 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-modprobe-d\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.477307 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.477276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvgn\" (UniqueName: \"kubernetes.io/projected/ccb0777e-660e-4973-a4b3-53a5e504b9b3-kube-api-access-txvgn\") pod \"aws-ebs-csi-driver-node-44mf2\" (UID: \"ccb0777e-660e-4973-a4b3-53a5e504b9b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.477429 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.477340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-tmp\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.477844 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.477823 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dcddce02-c375-4299-ad44-c965e1124126-ovn-node-metrics-cert\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.478664 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.478566 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aacb1d0c-ad9c-456a-854d-00b4fc54085b-etc-tuned\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.479368 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.478931 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxdsd\" (UniqueName: \"kubernetes.io/projected/42effdd5-51bf-43b7-8555-1a026f723453-kube-api-access-pxdsd\") pod \"node-ca-vcqsp\" (UID: \"42effdd5-51bf-43b7-8555-1a026f723453\") " pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.479459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.479418 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwc97\" (UniqueName: \"kubernetes.io/projected/dcddce02-c375-4299-ad44-c965e1124126-kube-api-access-xwc97\") pod \"ovnkube-node-hcw2v\" (UID: \"dcddce02-c375-4299-ad44-c965e1124126\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.480333 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.480247 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b85m\" (UniqueName: \"kubernetes.io/projected/cc3d69b7-3456-4bb2-9cd0-7aa46415f224-kube-api-access-6b85m\") pod \"multus-7pp2p\" (UID: \"cc3d69b7-3456-4bb2-9cd0-7aa46415f224\") " pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.480672 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.480652 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gmwg\" (UniqueName: \"kubernetes.io/projected/ac14beab-8114-493d-a919-16f44a7217f1-kube-api-access-9gmwg\") pod \"multus-additional-cni-plugins-9nt26\" (UID: \"ac14beab-8114-493d-a919-16f44a7217f1\") " pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.481037 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.481011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a56c223-6f9a-4c5a-8392-334fd6dc816a-agent-certs\") pod \"konnectivity-agent-wv4jf\" (UID: \"0a56c223-6f9a-4c5a-8392-334fd6dc816a\") " pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.481654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.481630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzrnk\" (UniqueName: \"kubernetes.io/projected/4c1e743b-6e54-4775-8d57-1fa715225b0c-kube-api-access-xzrnk\") pod \"node-resolver-ggkjk\" (UID: \"4c1e743b-6e54-4775-8d57-1fa715225b0c\") " pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.482824 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.482792 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cp9\" (UniqueName: \"kubernetes.io/projected/63c112ba-178e-4698-98b1-86e360e40e1f-kube-api-access-d6cp9\") pod \"iptables-alerter-qlxms\" (UID: \"63c112ba-178e-4698-98b1-86e360e40e1f\") " pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.484481 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.484464 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjfc2\" (UniqueName: \"kubernetes.io/projected/aacb1d0c-ad9c-456a-854d-00b4fc54085b-kube-api-access-sjfc2\") pod \"tuned-t7m6g\" (UID: \"aacb1d0c-ad9c-456a-854d-00b4fc54085b\") " pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.484838 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.484816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dz8\" (UniqueName: \"kubernetes.io/projected/30812199-596c-4ab1-b17b-ef92026124e6-kube-api-access-h7dz8\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.652816 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.652784 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" Apr 17 10:17:52.661592 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.661569 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlxms" Apr 17 10:17:52.671192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.671169 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:17:52.674807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.674786 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:17:52.681359 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.681336 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7pp2p" Apr 17 10:17:52.687911 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.687892 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" Apr 17 10:17:52.693436 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.693408 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggkjk" Apr 17 10:17:52.699911 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.699890 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcqsp" Apr 17 10:17:52.703437 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.703419 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9nt26" Apr 17 10:17:52.974980 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.974901 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:52.974980 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:52.974961 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:52.975196 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975059 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:52.975196 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975136 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:53.975119024 +0000 UTC m=+4.059906161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:52.975196 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975063 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:17:52.975196 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975157 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:17:52.975196 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975170 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:52.975487 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:52.975219 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:53.97520524 +0000 UTC m=+4.059992376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:53.017257 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.017237 2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 10:17:53.019139 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.019106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaacb1d0c_ad9c_456a_854d_00b4fc54085b.slice/crio-c39fc3bb261d8e11bbfbb67d10d12c539bd22a2411062b37fa666c5ae1cd6bce WatchSource:0}: Error finding container c39fc3bb261d8e11bbfbb67d10d12c539bd22a2411062b37fa666c5ae1cd6bce: Status 404 returned error can't find the container with id c39fc3bb261d8e11bbfbb67d10d12c539bd22a2411062b37fa666c5ae1cd6bce Apr 17 10:17:53.020830 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.020637 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb0777e_660e_4973_a4b3_53a5e504b9b3.slice/crio-c61dd9c20e841a4123a76e904e76874cea4a1170007edf1411aa77b928e1de43 WatchSource:0}: Error finding container c61dd9c20e841a4123a76e904e76874cea4a1170007edf1411aa77b928e1de43: Status 404 returned error can't find the container with id c61dd9c20e841a4123a76e904e76874cea4a1170007edf1411aa77b928e1de43 Apr 17 10:17:53.025945 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.025918 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a56c223_6f9a_4c5a_8392_334fd6dc816a.slice/crio-5978f93833fe244958976b34fac37ac6b0fea31326dd590fe4ab246d5435a2d9 WatchSource:0}: Error finding container 5978f93833fe244958976b34fac37ac6b0fea31326dd590fe4ab246d5435a2d9: Status 404 returned error can't find the container with id 5978f93833fe244958976b34fac37ac6b0fea31326dd590fe4ab246d5435a2d9 Apr 17 10:17:53.026688 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.026597 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3d69b7_3456_4bb2_9cd0_7aa46415f224.slice/crio-255b148ff2a18e263ef7c4162ae01297f9f7a512e0c41beb7b1ddbf56e30c56c WatchSource:0}: Error finding container 255b148ff2a18e263ef7c4162ae01297f9f7a512e0c41beb7b1ddbf56e30c56c: Status 404 returned error can't find the container with id 255b148ff2a18e263ef7c4162ae01297f9f7a512e0c41beb7b1ddbf56e30c56c Apr 17 10:17:53.027475 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.027451 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42effdd5_51bf_43b7_8555_1a026f723453.slice/crio-269d4da8bcc203852cb05e2b4a4be30e8018cca33aeec1f6f11387a84392c8fd WatchSource:0}: Error finding container 269d4da8bcc203852cb05e2b4a4be30e8018cca33aeec1f6f11387a84392c8fd: Status 404 returned error can't find the container with id 269d4da8bcc203852cb05e2b4a4be30e8018cca33aeec1f6f11387a84392c8fd Apr 17 10:17:53.028281 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.028236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c112ba_178e_4698_98b1_86e360e40e1f.slice/crio-72a2bbe1bb378d6246da7b4a1cc2eab11a2802df06794a768d64d55303f8c057 WatchSource:0}: Error finding container 72a2bbe1bb378d6246da7b4a1cc2eab11a2802df06794a768d64d55303f8c057: Status 404 returned error can't find the container with id 72a2bbe1bb378d6246da7b4a1cc2eab11a2802df06794a768d64d55303f8c057 Apr 17 10:17:53.029265 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.029215 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1e743b_6e54_4775_8d57_1fa715225b0c.slice/crio-ca01a4d8ce069e5e3ce6a49dd745d710ea8873388e616b0161765d312fb638d1 WatchSource:0}: Error finding container ca01a4d8ce069e5e3ce6a49dd745d710ea8873388e616b0161765d312fb638d1: Status 404 returned error can't find the container with id ca01a4d8ce069e5e3ce6a49dd745d710ea8873388e616b0161765d312fb638d1 Apr 17 10:17:53.030462 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.030432 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac14beab_8114_493d_a919_16f44a7217f1.slice/crio-1cca760444f8134d20ee058ba2d07ee60f8baa7ad165a18d7f1fb94457874654 WatchSource:0}: Error finding container 1cca760444f8134d20ee058ba2d07ee60f8baa7ad165a18d7f1fb94457874654: Status 404 returned error can't find the container with id 1cca760444f8134d20ee058ba2d07ee60f8baa7ad165a18d7f1fb94457874654 Apr 17 10:17:53.031157 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:17:53.031138 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcddce02_c375_4299_ad44_c965e1124126.slice/crio-eac715707396c075f45f39ec2716eb40091963d0a63e83a192cf2e8b03d1c8ea WatchSource:0}: Error finding container eac715707396c075f45f39ec2716eb40091963d0a63e83a192cf2e8b03d1c8ea: Status 404 returned error can't find the container with id eac715707396c075f45f39ec2716eb40091963d0a63e83a192cf2e8b03d1c8ea Apr 17 10:17:53.395243 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.394979 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 10:12:51 +0000 UTC" deadline="2027-12-23 16:43:14.12207185 +0000 UTC" Apr 17 10:17:53.395243 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.395213 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14766h25m20.726862669s" Apr 17 10:17:53.474873 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.474380 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:53.474873 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.474503 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:17:53.488667 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.488633 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" event={"ID":"1864926e2034b566e595c9007c5b736f","Type":"ContainerStarted","Data":"1dd9181111163d80acccb6b8835ea74ef641dae632a9e9637c6ad96155abfad1"} Apr 17 10:17:53.491138 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.491002 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"eac715707396c075f45f39ec2716eb40091963d0a63e83a192cf2e8b03d1c8ea"} Apr 17 10:17:53.494922 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.494896 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggkjk" event={"ID":"4c1e743b-6e54-4775-8d57-1fa715225b0c","Type":"ContainerStarted","Data":"ca01a4d8ce069e5e3ce6a49dd745d710ea8873388e616b0161765d312fb638d1"} Apr 17 10:17:53.496969 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.496942 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wv4jf" event={"ID":"0a56c223-6f9a-4c5a-8392-334fd6dc816a","Type":"ContainerStarted","Data":"5978f93833fe244958976b34fac37ac6b0fea31326dd590fe4ab246d5435a2d9"} Apr 17 10:17:53.499643 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.499396 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" event={"ID":"aacb1d0c-ad9c-456a-854d-00b4fc54085b","Type":"ContainerStarted","Data":"c39fc3bb261d8e11bbfbb67d10d12c539bd22a2411062b37fa666c5ae1cd6bce"} Apr 17 10:17:53.503495 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.503105 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-54.ec2.internal" podStartSLOduration=2.5030901869999997 podStartE2EDuration="2.503090187s" podCreationTimestamp="2026-04-17 10:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:17:53.502311537 +0000 UTC m=+3.587098691" watchObservedRunningTime="2026-04-17 10:17:53.503090187 +0000 UTC m=+3.587877341" Apr 17 10:17:53.506272 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.506234 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerStarted","Data":"1cca760444f8134d20ee058ba2d07ee60f8baa7ad165a18d7f1fb94457874654"} Apr 17 10:17:53.508294 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.508219 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlxms" event={"ID":"63c112ba-178e-4698-98b1-86e360e40e1f","Type":"ContainerStarted","Data":"72a2bbe1bb378d6246da7b4a1cc2eab11a2802df06794a768d64d55303f8c057"} Apr 17 10:17:53.512499 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.512473 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7pp2p" event={"ID":"cc3d69b7-3456-4bb2-9cd0-7aa46415f224","Type":"ContainerStarted","Data":"255b148ff2a18e263ef7c4162ae01297f9f7a512e0c41beb7b1ddbf56e30c56c"} Apr 17 10:17:53.515086 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.515062 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcqsp" event={"ID":"42effdd5-51bf-43b7-8555-1a026f723453","Type":"ContainerStarted","Data":"269d4da8bcc203852cb05e2b4a4be30e8018cca33aeec1f6f11387a84392c8fd"} Apr 17 10:17:53.520811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.520382 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" event={"ID":"ccb0777e-660e-4973-a4b3-53a5e504b9b3","Type":"ContainerStarted","Data":"c61dd9c20e841a4123a76e904e76874cea4a1170007edf1411aa77b928e1de43"} Apr 17 10:17:53.985762 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.985722 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:53.985881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:53.985792 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:53.985981 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.985935 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:53.986044 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.985992 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:55.985972572 +0000 UTC m=+6.070759707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:53.986104 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.986078 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:17:53.986104 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.986092 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:17:53.986198 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.986104 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:53.986198 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:53.986141 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:17:55.986128252 +0000 UTC m=+6.070915388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:54.476538 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:54.475967 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:54.476538 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:54.476095 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:17:54.533167 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:54.533122 2573 generic.go:358] "Generic (PLEG): container finished" podID="2c3f6b6e86e354ce469790597636bd09" containerID="385891e0e9c6a6a3cc5c1da93760ae5e263a211e0b87d69815cb9b6bec0d2f8b" exitCode=0 Apr 17 10:17:54.534025 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:54.533787 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" event={"ID":"2c3f6b6e86e354ce469790597636bd09","Type":"ContainerDied","Data":"385891e0e9c6a6a3cc5c1da93760ae5e263a211e0b87d69815cb9b6bec0d2f8b"} Apr 17 10:17:55.474444 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:55.474411 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:55.474602 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:55.474543 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:17:55.542935 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:55.542548 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" event={"ID":"2c3f6b6e86e354ce469790597636bd09","Type":"ContainerStarted","Data":"b39921b219408b3365a85e1b911825eff154acca59b4eecfcdcd9238837bcb81"} Apr 17 10:17:56.001543 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:56.001507 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:56.001811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:56.001569 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:56.001811 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001703 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:56.001811 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001758 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:17:56.001811 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001783 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:17:56.001811 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001799 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:56.002085 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001785 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:00.001763914 +0000 UTC m=+10.086551052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:17:56.002085 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.001861 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:00.001843427 +0000 UTC m=+10.086630569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:17:56.474418 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:56.473944 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:56.474418 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:56.474081 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:17:57.473799 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:57.473765 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:57.474235 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:57.473913 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:17:58.474015 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:58.473832 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:17:58.474015 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:58.473976 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:17:59.473755 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:17:59.473709 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:17:59.473929 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:17:59.473850 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:00.034670 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:00.034634 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:00.034692 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034821 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034887 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:08.034866843 +0000 UTC m=+18.119653975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034822 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034927 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034941 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:00.035129 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.034997 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:08.034980151 +0000 UTC m=+18.119767285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:00.475543 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:00.474998 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:00.475543 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:00.475119 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:01.474256 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:01.474218 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:01.474712 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:01.474338 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:02.476536 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:02.476500 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:02.476959 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:02.476598 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:03.473655 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:03.473625 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:03.473859 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:03.473759 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:04.473640 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:04.473615 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:04.474090 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:04.473749 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:05.473999 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:05.473971 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:05.474344 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:05.474072 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:06.473811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:06.473776 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:06.473988 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:06.473907 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:07.474050 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:07.474016 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:07.474509 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:07.474126 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:08.093488 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:08.093447 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:08.093639 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:08.093510 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:08.093639 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093603 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:08.093771 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093665 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:24.093650176 +0000 UTC m=+34.178437312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:08.093771 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093612 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:18:08.093771 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093719 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:18:08.093771 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093752 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:08.093927 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.093803 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:24.093786786 +0000 UTC m=+34.178573923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:08.473659 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:08.473624 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:08.473886 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:08.473781 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:09.473602 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:09.473571 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:09.474013 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:09.473684 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:10.475294 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.475056 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:10.475637 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:10.475420 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:10.566491 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.566458 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggkjk" event={"ID":"4c1e743b-6e54-4775-8d57-1fa715225b0c","Type":"ContainerStarted","Data":"6d1f40943caa10bc2e39b89539e3f23c831e99c6a3946a8d96014ca072e91e29"} Apr 17 10:18:10.568365 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.568335 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wv4jf" event={"ID":"0a56c223-6f9a-4c5a-8392-334fd6dc816a","Type":"ContainerStarted","Data":"cba9b98835fb1751e438a8fe33785c41c9ab19337cfe194369557bd8e8a5594e"} Apr 17 10:18:10.570034 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.570010 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" event={"ID":"aacb1d0c-ad9c-456a-854d-00b4fc54085b","Type":"ContainerStarted","Data":"017d252cb44cda7e1c73defc015d4f226082bd8eab6617e0e6b35fca017220df"} Apr 17 10:18:10.571422 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.571383 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerStarted","Data":"880ddb316f5f2ace6d2fd20da50af45be764721d3e54aab7932e8a8474346b8b"} Apr 17 10:18:10.572843 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.572820 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7pp2p" event={"ID":"cc3d69b7-3456-4bb2-9cd0-7aa46415f224","Type":"ContainerStarted","Data":"0c829bcbda187d48414f557b9fe4cf3dd5e8e561e46f41e01311d6243f1747f3"} Apr 17 10:18:10.574067 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.574045 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcqsp" event={"ID":"42effdd5-51bf-43b7-8555-1a026f723453","Type":"ContainerStarted","Data":"23e5ffa99f5c6532bed3265025ea77b276c15ec2b661125299e73500d2f71bc3"} Apr 17 10:18:10.578589 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.578557 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" event={"ID":"ccb0777e-660e-4973-a4b3-53a5e504b9b3","Type":"ContainerStarted","Data":"51334c65e96425dd6216bd91f13b1887411392c4e87cc95a81aa85b0cff4ca4a"} Apr 17 10:18:10.578974 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.578930 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-54.ec2.internal" podStartSLOduration=19.578890236 podStartE2EDuration="19.578890236s" podCreationTimestamp="2026-04-17 10:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:17:55.558518119 +0000 UTC m=+5.643305275" watchObservedRunningTime="2026-04-17 10:18:10.578890236 +0000 UTC m=+20.663677383" Apr 17 10:18:10.579522 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.579495 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ggkjk" podStartSLOduration=3.561136349 podStartE2EDuration="20.579486018s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.03179751 +0000 UTC m=+3.116584643" lastFinishedPulling="2026-04-17 10:18:10.050147176 +0000 UTC m=+20.134934312" observedRunningTime="2026-04-17 10:18:10.579242629 +0000 UTC m=+20.664029784" watchObservedRunningTime="2026-04-17 10:18:10.579486018 +0000 UTC m=+20.664273171" Apr 17 10:18:10.613704 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.613669 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t7m6g" podStartSLOduration=3.582701445 podStartE2EDuration="20.613657356s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.021025248 +0000 UTC m=+3.105812392" lastFinishedPulling="2026-04-17 10:18:10.051981158 +0000 UTC m=+20.136768303" observedRunningTime="2026-04-17 10:18:10.595388331 +0000 UTC m=+20.680175484" watchObservedRunningTime="2026-04-17 10:18:10.613657356 +0000 UTC m=+20.698444513" Apr 17 10:18:10.625472 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.625427 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vcqsp" podStartSLOduration=8.306561188 podStartE2EDuration="20.625402001s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.029467158 +0000 UTC m=+3.114254297" lastFinishedPulling="2026-04-17 10:18:05.348307972 +0000 UTC m=+15.433095110" observedRunningTime="2026-04-17 10:18:10.625020895 +0000 UTC m=+20.709808052" watchObservedRunningTime="2026-04-17 10:18:10.625402001 +0000 UTC m=+20.710189158" Apr 17 10:18:10.638333 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.638297 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wv4jf" podStartSLOduration=3.615604985 podStartE2EDuration="20.638284572s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.027483242 +0000 UTC m=+3.112270380" lastFinishedPulling="2026-04-17 10:18:10.050162821 +0000 UTC m=+20.134949967" observedRunningTime="2026-04-17 10:18:10.637754914 +0000 UTC m=+20.722542067" watchObservedRunningTime="2026-04-17 10:18:10.638284572 +0000 UTC m=+20.723071760" Apr 17 10:18:10.653390 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:10.653353 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7pp2p" podStartSLOduration=3.58995584 podStartE2EDuration="20.653341745s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.0286054 +0000 UTC m=+3.113392541" lastFinishedPulling="2026-04-17 10:18:10.091991305 +0000 UTC m=+20.176778446" observedRunningTime="2026-04-17 10:18:10.653006383 +0000 UTC m=+20.737793539" watchObservedRunningTime="2026-04-17 10:18:10.653341745 +0000 UTC m=+20.738128900" Apr 17 10:18:11.461583 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.461447 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 17 10:18:11.473966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.473948 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:11.474051 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:11.474029 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:11.581241 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.581220 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="880ddb316f5f2ace6d2fd20da50af45be764721d3e54aab7932e8a8474346b8b" exitCode=0 Apr 17 10:18:11.581803 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.581289 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"880ddb316f5f2ace6d2fd20da50af45be764721d3e54aab7932e8a8474346b8b"} Apr 17 10:18:11.582663 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.582644 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlxms" event={"ID":"63c112ba-178e-4698-98b1-86e360e40e1f","Type":"ContainerStarted","Data":"e7140806a192c992a2bdef8b3cc8cfbeed13f0ec91f9423d5ee524f90e6bfb8a"} Apr 17 10:18:11.584260 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.584237 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" event={"ID":"ccb0777e-660e-4973-a4b3-53a5e504b9b3","Type":"ContainerStarted","Data":"bbf31b9b4990d9ba7a07ace3ef41a69dada0a8bbd7f399f1b7b3d7191cb3b8d3"} Apr 17 10:18:11.590180 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590102 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"d39de8c6b9c605fa4f473b952c8329ae8aab7502d66b3a4637626c590100d9db"} Apr 17 10:18:11.590180 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590158 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"9ad99f36fe7ba68fc9670cc6a63e0a50ebf2a64de53e8c9368d567299ab50146"} Apr 17 10:18:11.590180 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590172 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"f639f14766219bf3f60f4067ec9a6ad374bcc1a88ba701f8061ce4bbbf5e6ca3"} Apr 17 10:18:11.590342 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590185 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"04e69901632492ab0f744a17b6d90bba2e47ce524e5df13ccc6163b4be28a41e"} Apr 17 10:18:11.590342 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590208 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"638b0eba1b2e0dedd6bd35ff6780cafc43b981bdcb8e150fd3be1250cb1d4b51"} Apr 17 10:18:11.590342 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.590221 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"0c2baa467ea1ed2e4ecb681a260f12f064dfd80f909a0ccacada627a16d3a16d"} Apr 17 10:18:11.612554 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:11.612521 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlxms" podStartSLOduration=4.592979383 podStartE2EDuration="21.612511241s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.030718652 +0000 UTC m=+3.115505798" lastFinishedPulling="2026-04-17 10:18:10.05025051 +0000 UTC m=+20.135037656" observedRunningTime="2026-04-17 10:18:11.612379015 +0000 UTC m=+21.697166168" watchObservedRunningTime="2026-04-17 10:18:11.612511241 +0000 UTC m=+21.697298395" Apr 17 10:18:12.430048 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:12.429945 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-17T10:18:11.461579835Z","UUID":"15c72c47-da14-444d-85a0-d90d085943a4","Handler":null,"Name":"","Endpoint":""} Apr 17 10:18:12.433313 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:12.433290 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 17 10:18:12.433447 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:12.433321 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 17 10:18:12.473522 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:12.473494 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:12.473652 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:12.473624 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:13.474225 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.474196 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:13.474594 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:13.474300 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:13.596336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.596302 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" event={"ID":"ccb0777e-660e-4973-a4b3-53a5e504b9b3","Type":"ContainerStarted","Data":"95b1206f5f4dd3acfe0470d900e6eedf7f6b8b52613c42871fda1dc047150cec"} Apr 17 10:18:13.598937 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.598915 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"1f6f68e520237f4de2a924a586273810ec79159c97ea24fc650fdb5891e3ec96"} Apr 17 10:18:13.612509 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.612461 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44mf2" podStartSLOduration=4.077308625 podStartE2EDuration="23.612444213s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.024438032 +0000 UTC m=+3.109225164" lastFinishedPulling="2026-04-17 10:18:12.559573615 +0000 UTC m=+22.644360752" observedRunningTime="2026-04-17 10:18:13.611785745 +0000 UTC m=+23.696572896" watchObservedRunningTime="2026-04-17 10:18:13.612444213 +0000 UTC m=+23.697231370" Apr 17 10:18:13.840864 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.840780 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:18:13.841386 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:13.841361 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:18:14.474228 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:14.474032 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:14.474644 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:14.474314 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:14.601523 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:14.601493 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:18:14.601743 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:14.601715 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wv4jf" Apr 17 10:18:15.473650 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:15.473618 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:15.473843 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:15.473751 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:16.473989 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.473760 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:16.474597 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:16.474106 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:16.606395 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.606369 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="5990b24612a10ef0ddb3819387a271305866518968dcdcae2406baf7e8db9d07" exitCode=0 Apr 17 10:18:16.606508 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.606446 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"5990b24612a10ef0ddb3819387a271305866518968dcdcae2406baf7e8db9d07"} Apr 17 10:18:16.609616 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.609599 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" event={"ID":"dcddce02-c375-4299-ad44-c965e1124126","Type":"ContainerStarted","Data":"ac48b71a8beaccd6024dfa182fc14f8198e22f95868447a4e4f54513f97625fc"} Apr 17 10:18:16.609857 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.609839 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:16.609933 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.609867 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:16.609933 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.609880 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:16.623286 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.623269 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:16.623369 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:16.623327 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:17.474083 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:17.474052 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:17.474540 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:17.474141 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:18.474070 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:18.474041 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:18.474248 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:18.474158 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:18.614819 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:18.614790 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="aff4f7a14363dc513039028b406742498717b5d2380adb8aead484823336be83" exitCode=0 Apr 17 10:18:18.614948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:18.614883 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"aff4f7a14363dc513039028b406742498717b5d2380adb8aead484823336be83"} Apr 17 10:18:18.636964 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:18.636928 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" podStartSLOduration=11.101478108 podStartE2EDuration="28.636916656s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.03260156 +0000 UTC m=+3.117388699" lastFinishedPulling="2026-04-17 10:18:10.5680401 +0000 UTC m=+20.652827247" observedRunningTime="2026-04-17 10:18:16.651707457 +0000 UTC m=+26.736494608" watchObservedRunningTime="2026-04-17 10:18:18.636916656 +0000 UTC m=+28.721703807" Apr 17 10:18:19.473346 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:19.473319 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:19.473436 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:19.473422 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:19.618024 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:19.617968 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="0213123ba98c8bffb6feef0409d692bf0fb085a2a33c127de5896c401c3a7516" exitCode=0 Apr 17 10:18:19.618024 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:19.618020 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"0213123ba98c8bffb6feef0409d692bf0fb085a2a33c127de5896c401c3a7516"} Apr 17 10:18:20.475263 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:20.475236 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:20.475428 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:20.475330 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:21.473599 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:21.473560 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:21.474057 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:21.473675 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:22.474307 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:22.474276 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:22.474783 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:22.474416 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:23.473838 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:23.473777 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:23.473995 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:23.473907 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:23.928076 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:23.928001 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m98nc"] Apr 17 10:18:23.929128 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:23.928155 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:23.929128 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:23.928282 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:23.930627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:23.930558 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vtvnj"] Apr 17 10:18:23.930783 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:23.930635 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:23.930783 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:23.930764 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:24.097770 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.097676 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k8psk"] Apr 17 10:18:24.116710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.116680 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:24.116880 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.116749 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:24.116880 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116860 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:24.116880 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116863 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 10:18:24.117041 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116888 2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 10:18:24.117041 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116902 2573 projected.go:194] Error preparing data for projected volume kube-api-access-kcsxt for pod openshift-network-diagnostics/network-check-target-vtvnj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:24.117041 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116928 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs podName:30812199-596c-4ab1-b17b-ef92026124e6 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:56.116906958 +0000 UTC m=+66.201694111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs") pod "network-metrics-daemon-m98nc" (UID: "30812199-596c-4ab1-b17b-ef92026124e6") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 10:18:24.117041 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.116954 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt podName:405413ce-3046-4495-be37-74e908505d81 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:56.116939228 +0000 UTC m=+66.201726364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcsxt" (UniqueName: "kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt") pod "network-check-target-vtvnj" (UID: "405413ce-3046-4495-be37-74e908505d81") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 10:18:24.139085 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.139058 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8psk"] Apr 17 10:18:24.139204 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.139176 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.139275 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.139254 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8psk" podUID="dc016b5b-ead4-48ed-a13a-f0fdf34c3f88" Apr 17 10:18:24.218041 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.218006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-dbus\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.218249 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.218054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.218249 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.218081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-kubelet-config\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.318699 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.318666 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-dbus\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.318880 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.318718 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.318880 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.318845 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-kubelet-config\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.319000 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.318953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-dbus\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.319051 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.319003 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:24.319051 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.319021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-kubelet-config\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.319135 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.319073 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret podName:dc016b5b-ead4-48ed-a13a-f0fdf34c3f88 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:24.819052876 +0000 UTC m=+34.903840021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret") pod "global-pull-secret-syncer-k8psk" (UID: "dc016b5b-ead4-48ed-a13a-f0fdf34c3f88") : object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:24.823246 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:24.823165 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:24.823399 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.823276 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:24.823399 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:24.823340 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret podName:dc016b5b-ead4-48ed-a13a-f0fdf34c3f88 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:25.823323907 +0000 UTC m=+35.908111040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret") pod "global-pull-secret-syncer-k8psk" (UID: "dc016b5b-ead4-48ed-a13a-f0fdf34c3f88") : object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:25.474009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:25.473980 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:25.474437 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:25.473980 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:25.474437 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:25.474096 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:25.474437 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:25.474128 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8psk" podUID="dc016b5b-ead4-48ed-a13a-f0fdf34c3f88" Apr 17 10:18:25.474437 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:25.473994 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:25.474437 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:25.474182 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:25.831763 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:25.831714 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:25.831900 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:25.831855 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:25.831948 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:25.831912 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret podName:dc016b5b-ead4-48ed-a13a-f0fdf34c3f88 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:27.831898101 +0000 UTC m=+37.916685232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret") pod "global-pull-secret-syncer-k8psk" (UID: "dc016b5b-ead4-48ed-a13a-f0fdf34c3f88") : object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:26.632599 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:26.632566 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="bdf4e1183b2eb4c2014dfac222f8fa1c1188765b3a4b83ccd83499dee9ee2d2d" exitCode=0 Apr 17 10:18:26.632960 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:26.632629 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"bdf4e1183b2eb4c2014dfac222f8fa1c1188765b3a4b83ccd83499dee9ee2d2d"} Apr 17 10:18:27.473905 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.473876 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:27.474057 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.473876 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:27.474057 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:27.473968 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vtvnj" podUID="405413ce-3046-4495-be37-74e908505d81" Apr 17 10:18:27.474057 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.473876 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:27.474152 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:27.474066 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m98nc" podUID="30812199-596c-4ab1-b17b-ef92026124e6" Apr 17 10:18:27.474152 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:27.474112 2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k8psk" podUID="dc016b5b-ead4-48ed-a13a-f0fdf34c3f88" Apr 17 10:18:27.636784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.636757 2573 generic.go:358] "Generic (PLEG): container finished" podID="ac14beab-8114-493d-a919-16f44a7217f1" containerID="c359ccbd652c2388c5ca04dcb3316d85dad239ebc21e0a62a2740959bbcbbd59" exitCode=0 Apr 17 10:18:27.637248 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.636815 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerDied","Data":"c359ccbd652c2388c5ca04dcb3316d85dad239ebc21e0a62a2740959bbcbbd59"} Apr 17 10:18:27.847806 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:27.847781 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:27.847905 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:27.847893 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:27.847957 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:27.847941 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret podName:dc016b5b-ead4-48ed-a13a-f0fdf34c3f88 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:31.847927408 +0000 UTC m=+41.932714539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret") pod "global-pull-secret-syncer-k8psk" (UID: "dc016b5b-ead4-48ed-a13a-f0fdf34c3f88") : object "kube-system"/"original-pull-secret" not registered Apr 17 10:18:28.196362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.196336 2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-54.ec2.internal" event="NodeReady" Apr 17 10:18:28.196483 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.196428 2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 17 10:18:28.231013 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.230982 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86bcd8b69-xplz9"] Apr 17 10:18:28.257881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.257851 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rvtfs"] Apr 17 10:18:28.258027 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.258003 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.260707 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.260678 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Apr 17 10:18:28.260826 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.260689 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mw7t8\"" Apr 17 10:18:28.260865 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.260846 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Apr 17 10:18:28.261821 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.261802 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Apr 17 10:18:28.266261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.266244 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Apr 17 10:18:28.276382 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.276353 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mx8jx"] Apr 17 10:18:28.276512 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.276497 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.278814 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.278794 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 17 10:18:28.278893 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.278824 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kq7pt\"" Apr 17 10:18:28.278973 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.278887 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 17 10:18:28.289711 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.289693 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86bcd8b69-xplz9"] Apr 17 10:18:28.289711 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.289714 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvtfs"] Apr 17 10:18:28.289827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.289723 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx8jx"] Apr 17 10:18:28.289827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.289815 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.292112 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.292095 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 17 10:18:28.292204 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.292133 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 17 10:18:28.292310 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.292297 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xs5df\"" Apr 17 10:18:28.292402 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.292384 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 17 10:18:28.351660 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-trusted-ca\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.351792 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-image-registry-private-configuration\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.351792 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-bound-sa-token\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.351792 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-certificates\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.351792 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e605d4b0-66e0-41eb-a62f-002b707ab1d0-ca-trust-extracted\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.352001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-tls\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.352001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-installation-pull-secrets\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.352001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.351942 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khx9g\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-kube-api-access-khx9g\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452205 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452152 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-certificates\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452205 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452180 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e605d4b0-66e0-41eb-a62f-002b707ab1d0-ca-trust-extracted\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452205 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452205 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbkq9\" (UniqueName: \"kubernetes.io/projected/f5adea0c-3b73-476b-9e57-646bf76d5a70-kube-api-access-pbkq9\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.452386 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23bfe19-501b-4bed-8962-16e697010aa9-cert\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.452386 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452258 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-tls\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452386 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452326 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-installation-pull-secrets\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452533 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452409 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khx9g\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-kube-api-access-khx9g\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452533 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5adea0c-3b73-476b-9e57-646bf76d5a70-config-volume\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.452533 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452491 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-trusted-ca\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452536 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-image-registry-private-configuration\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452562 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-bound-sa-token\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e605d4b0-66e0-41eb-a62f-002b707ab1d0-ca-trust-extracted\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.452791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452696 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5adea0c-3b73-476b-9e57-646bf76d5a70-metrics-tls\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.452791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chlbt\" (UniqueName: \"kubernetes.io/projected/a23bfe19-501b-4bed-8962-16e697010aa9-kube-api-access-chlbt\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.452884 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.452795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5adea0c-3b73-476b-9e57-646bf76d5a70-tmp-dir\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.453194 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.453165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-certificates\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.453413 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.453378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e605d4b0-66e0-41eb-a62f-002b707ab1d0-trusted-ca\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.456101 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.456077 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-installation-pull-secrets\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.456101 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.456090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e605d4b0-66e0-41eb-a62f-002b707ab1d0-image-registry-private-configuration\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.456216 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.456136 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-registry-tls\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.460188 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.460170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khx9g\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-kube-api-access-khx9g\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.460303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.460282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e605d4b0-66e0-41eb-a62f-002b707ab1d0-bound-sa-token\") pod \"image-registry-86bcd8b69-xplz9\" (UID: \"e605d4b0-66e0-41eb-a62f-002b707ab1d0\") " pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.554068 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554035 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbkq9\" (UniqueName: \"kubernetes.io/projected/f5adea0c-3b73-476b-9e57-646bf76d5a70-kube-api-access-pbkq9\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.554242 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554076 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23bfe19-501b-4bed-8962-16e697010aa9-cert\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.554242 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554105 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5adea0c-3b73-476b-9e57-646bf76d5a70-config-volume\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.554242 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554157 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5adea0c-3b73-476b-9e57-646bf76d5a70-metrics-tls\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.554242 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554172 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chlbt\" (UniqueName: \"kubernetes.io/projected/a23bfe19-501b-4bed-8962-16e697010aa9-kube-api-access-chlbt\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.554242 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554193 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5adea0c-3b73-476b-9e57-646bf76d5a70-tmp-dir\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.554537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5adea0c-3b73-476b-9e57-646bf76d5a70-tmp-dir\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.554717 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.554695 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5adea0c-3b73-476b-9e57-646bf76d5a70-config-volume\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.556306 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.556285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a23bfe19-501b-4bed-8962-16e697010aa9-cert\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.556392 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.556357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5adea0c-3b73-476b-9e57-646bf76d5a70-metrics-tls\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.560981 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.560960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbkq9\" (UniqueName: \"kubernetes.io/projected/f5adea0c-3b73-476b-9e57-646bf76d5a70-kube-api-access-pbkq9\") pod \"dns-default-rvtfs\" (UID: \"f5adea0c-3b73-476b-9e57-646bf76d5a70\") " pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.561497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.561471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chlbt\" (UniqueName: \"kubernetes.io/projected/a23bfe19-501b-4bed-8962-16e697010aa9-kube-api-access-chlbt\") pod \"ingress-canary-mx8jx\" (UID: \"a23bfe19-501b-4bed-8962-16e697010aa9\") " pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.568167 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.568151 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:28.584523 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.584504 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:28.597180 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.597158 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mx8jx" Apr 17 10:18:28.644494 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.643978 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nt26" event={"ID":"ac14beab-8114-493d-a919-16f44a7217f1","Type":"ContainerStarted","Data":"d9af26c9245853e9a4f0398e91f964f0de124f822c60bd06783f2929e122e58c"} Apr 17 10:18:28.672368 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.671924 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9nt26" podStartSLOduration=6.058562415 podStartE2EDuration="38.671909385s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:17:53.032109771 +0000 UTC m=+3.116896917" lastFinishedPulling="2026-04-17 10:18:25.645456752 +0000 UTC m=+35.730243887" observedRunningTime="2026-04-17 10:18:28.671838361 +0000 UTC m=+38.756625515" watchObservedRunningTime="2026-04-17 10:18:28.671909385 +0000 UTC m=+38.756696647" Apr 17 10:18:28.731871 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.731776 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mx8jx"] Apr 17 10:18:28.735142 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.735117 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rvtfs"] Apr 17 10:18:28.735571 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:28.735544 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23bfe19_501b_4bed_8962_16e697010aa9.slice/crio-d4636ac64b606b37120b873a79b2b8cd1cd7f6f940c3182966263f75c2bc7eb8 WatchSource:0}: Error finding container d4636ac64b606b37120b873a79b2b8cd1cd7f6f940c3182966263f75c2bc7eb8: Status 404 returned error can't find the container with id d4636ac64b606b37120b873a79b2b8cd1cd7f6f940c3182966263f75c2bc7eb8 Apr 17 10:18:28.740971 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:28.740944 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86bcd8b69-xplz9"] Apr 17 10:18:28.747701 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:28.747681 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5adea0c_3b73_476b_9e57_646bf76d5a70.slice/crio-f28c68e328c68f103d69a255f4b64f78ace672407d395672cf62898ba904681b WatchSource:0}: Error finding container f28c68e328c68f103d69a255f4b64f78ace672407d395672cf62898ba904681b: Status 404 returned error can't find the container with id f28c68e328c68f103d69a255f4b64f78ace672407d395672cf62898ba904681b Apr 17 10:18:28.748290 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:28.748270 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode605d4b0_66e0_41eb_a62f_002b707ab1d0.slice/crio-bf5478c436a9d2d3b5f1155a36685293a8e93bc354eec76feab9dfcede23aa82 WatchSource:0}: Error finding container bf5478c436a9d2d3b5f1155a36685293a8e93bc354eec76feab9dfcede23aa82: Status 404 returned error can't find the container with id bf5478c436a9d2d3b5f1155a36685293a8e93bc354eec76feab9dfcede23aa82 Apr 17 10:18:29.069785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.069706 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk"] Apr 17 10:18:29.073138 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.073122 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:29.075498 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.075477 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 17 10:18:29.075617 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.075525 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mz4rk\"" Apr 17 10:18:29.082324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.082305 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk"] Apr 17 10:18:29.158622 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.158594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jv8kk\" (UID: \"ce6ed75b-f45c-4082-8ba0-567cae1d72e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:29.259937 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.259904 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jv8kk\" (UID: \"ce6ed75b-f45c-4082-8ba0-567cae1d72e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:29.260071 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:29.260047 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Apr 17 10:18:29.260131 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:29.260121 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates podName:ce6ed75b-f45c-4082-8ba0-567cae1d72e3 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:29.760102544 +0000 UTC m=+39.844889688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates") pod "prometheus-operator-admission-webhook-57cf98b594-jv8kk" (UID: "ce6ed75b-f45c-4082-8ba0-567cae1d72e3") : secret "prometheus-operator-admission-webhook-tls" not found Apr 17 10:18:29.474424 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.474391 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:29.474582 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.474424 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:29.474582 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.474547 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:29.477025 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.476997 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 17 10:18:29.477157 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.477106 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 10:18:29.477373 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.477270 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxdvh\"" Apr 17 10:18:29.477373 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.477270 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 10:18:29.477494 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.477425 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4g8r\"" Apr 17 10:18:29.477758 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.477718 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 10:18:29.648270 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.648232 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx8jx" event={"ID":"a23bfe19-501b-4bed-8962-16e697010aa9","Type":"ContainerStarted","Data":"d4636ac64b606b37120b873a79b2b8cd1cd7f6f940c3182966263f75c2bc7eb8"} Apr 17 10:18:29.649565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.649523 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvtfs" event={"ID":"f5adea0c-3b73-476b-9e57-646bf76d5a70","Type":"ContainerStarted","Data":"f28c68e328c68f103d69a255f4b64f78ace672407d395672cf62898ba904681b"} Apr 17 10:18:29.651298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.651273 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" event={"ID":"e605d4b0-66e0-41eb-a62f-002b707ab1d0","Type":"ContainerStarted","Data":"f2bcd6ed4acbf8040cfa1120d02baadd586780df62f0efe4c005472c4efd67e7"} Apr 17 10:18:29.651432 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.651306 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" event={"ID":"e605d4b0-66e0-41eb-a62f-002b707ab1d0","Type":"ContainerStarted","Data":"bf5478c436a9d2d3b5f1155a36685293a8e93bc354eec76feab9dfcede23aa82"} Apr 17 10:18:29.651710 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.651691 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:29.764172 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.764090 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jv8kk\" (UID: \"ce6ed75b-f45c-4082-8ba0-567cae1d72e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:29.768870 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.768817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ce6ed75b-f45c-4082-8ba0-567cae1d72e3-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jv8kk\" (UID: \"ce6ed75b-f45c-4082-8ba0-567cae1d72e3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:29.982050 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:29.982019 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:30.032828 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.032719 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" podStartSLOduration=7.032700838 podStartE2EDuration="7.032700838s" podCreationTimestamp="2026-04-17 10:18:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:18:29.668920688 +0000 UTC m=+39.753707852" watchObservedRunningTime="2026-04-17 10:18:30.032700838 +0000 UTC m=+40.117487992" Apr 17 10:18:30.033713 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.033690 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj"] Apr 17 10:18:30.059055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.059026 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj"] Apr 17 10:18:30.059168 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.059112 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" Apr 17 10:18:30.061406 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.061375 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Apr 17 10:18:30.061511 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.061408 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wmv9x\"" Apr 17 10:18:30.061511 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.061450 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Apr 17 10:18:30.134692 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.134664 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6bcc868b7-4q7xk"] Apr 17 10:18:30.150913 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.150858 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-4q7xk"] Apr 17 10:18:30.151078 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.151007 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:30.153232 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.153200 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 17 10:18:30.153705 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.153686 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 17 10:18:30.153879 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.153856 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n7k59\"" Apr 17 10:18:30.168325 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.168301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/42a36e39-ecf4-4e32-99df-eded6b77a3f0-kube-api-access-bgdd7\") pod \"migrator-74bb7799d9-5h6rj\" (UID: \"42a36e39-ecf4-4e32-99df-eded6b77a3f0\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" Apr 17 10:18:30.268785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.268744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc8bt\" (UniqueName: \"kubernetes.io/projected/4b3e0e8b-43cb-4854-86d9-00c38bfd631c-kube-api-access-dc8bt\") pod \"downloads-6bcc868b7-4q7xk\" (UID: \"4b3e0e8b-43cb-4854-86d9-00c38bfd631c\") " pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:30.268916 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.268841 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/42a36e39-ecf4-4e32-99df-eded6b77a3f0-kube-api-access-bgdd7\") pod \"migrator-74bb7799d9-5h6rj\" (UID: \"42a36e39-ecf4-4e32-99df-eded6b77a3f0\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" Apr 17 10:18:30.280234 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.280204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgdd7\" (UniqueName: \"kubernetes.io/projected/42a36e39-ecf4-4e32-99df-eded6b77a3f0-kube-api-access-bgdd7\") pod \"migrator-74bb7799d9-5h6rj\" (UID: \"42a36e39-ecf4-4e32-99df-eded6b77a3f0\") " pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" Apr 17 10:18:30.369567 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.369500 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" Apr 17 10:18:30.369701 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.369680 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc8bt\" (UniqueName: \"kubernetes.io/projected/4b3e0e8b-43cb-4854-86d9-00c38bfd631c-kube-api-access-dc8bt\") pod \"downloads-6bcc868b7-4q7xk\" (UID: \"4b3e0e8b-43cb-4854-86d9-00c38bfd631c\") " pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:30.378112 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.378087 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc8bt\" (UniqueName: \"kubernetes.io/projected/4b3e0e8b-43cb-4854-86d9-00c38bfd631c-kube-api-access-dc8bt\") pod \"downloads-6bcc868b7-4q7xk\" (UID: \"4b3e0e8b-43cb-4854-86d9-00c38bfd631c\") " pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:30.461238 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:30.461210 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:31.176198 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.176173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggkjk_4c1e743b-6e54-4775-8d57-1fa715225b0c/dns-node-resolver/0.log" Apr 17 10:18:31.596144 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.596117 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6bcc868b7-4q7xk"] Apr 17 10:18:31.601841 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:31.601812 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3e0e8b_43cb_4854_86d9_00c38bfd631c.slice/crio-24a23ce1ce957b80cf829c3658b5b4a47087cdd82a1ad92d9f2d8be650c767d7 WatchSource:0}: Error finding container 24a23ce1ce957b80cf829c3658b5b4a47087cdd82a1ad92d9f2d8be650c767d7: Status 404 returned error can't find the container with id 24a23ce1ce957b80cf829c3658b5b4a47087cdd82a1ad92d9f2d8be650c767d7 Apr 17 10:18:31.657151 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.657120 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-4q7xk" event={"ID":"4b3e0e8b-43cb-4854-86d9-00c38bfd631c","Type":"ContainerStarted","Data":"24a23ce1ce957b80cf829c3658b5b4a47087cdd82a1ad92d9f2d8be650c767d7"} Apr 17 10:18:31.658521 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.658492 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvtfs" event={"ID":"f5adea0c-3b73-476b-9e57-646bf76d5a70","Type":"ContainerStarted","Data":"7920ce88511477d29e43a74f6072832f1e43e3c8d8f0be6b599a410a8a1bc492"} Apr 17 10:18:31.659939 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.659908 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mx8jx" event={"ID":"a23bfe19-501b-4bed-8962-16e697010aa9","Type":"ContainerStarted","Data":"869233ef3caf69ad5db7fef8dc8af517943a5f83875e0caedcc165bef3ef5cea"} Apr 17 10:18:31.776385 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.776363 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86bcd8b69-xplz9_e605d4b0-66e0-41eb-a62f-002b707ab1d0/registry/0.log" Apr 17 10:18:31.808820 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.808792 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj"] Apr 17 10:18:31.811934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.811891 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk"] Apr 17 10:18:31.812555 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:31.812530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a36e39_ecf4_4e32_99df_eded6b77a3f0.slice/crio-690954b3ca7e57bca95c1733203c91fe57d8c464a5da81a28345c8e56667f645 WatchSource:0}: Error finding container 690954b3ca7e57bca95c1733203c91fe57d8c464a5da81a28345c8e56667f645: Status 404 returned error can't find the container with id 690954b3ca7e57bca95c1733203c91fe57d8c464a5da81a28345c8e56667f645 Apr 17 10:18:31.820391 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:31.820368 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6ed75b_f45c_4082_8ba0_567cae1d72e3.slice/crio-d2e8ee7692a215b93a5f1e17dedcc50e73f45daea1afe44e5e80a2a9d5eeb593 WatchSource:0}: Error finding container d2e8ee7692a215b93a5f1e17dedcc50e73f45daea1afe44e5e80a2a9d5eeb593: Status 404 returned error can't find the container with id d2e8ee7692a215b93a5f1e17dedcc50e73f45daea1afe44e5e80a2a9d5eeb593 Apr 17 10:18:31.880388 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.880363 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:31.882364 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.882346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dc016b5b-ead4-48ed-a13a-f0fdf34c3f88-original-pull-secret\") pod \"global-pull-secret-syncer-k8psk\" (UID: \"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88\") " pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:31.887336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.887312 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8psk" Apr 17 10:18:31.995380 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:31.995350 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8psk"] Apr 17 10:18:31.998566 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:31.998540 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc016b5b_ead4_48ed_a13a_f0fdf34c3f88.slice/crio-4489122a11615eb08765724587a6f19c1481fd97aa30a5db3736adc5999fb9d2 WatchSource:0}: Error finding container 4489122a11615eb08765724587a6f19c1481fd97aa30a5db3736adc5999fb9d2: Status 404 returned error can't find the container with id 4489122a11615eb08765724587a6f19c1481fd97aa30a5db3736adc5999fb9d2 Apr 17 10:18:32.376215 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.376146 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcqsp_42effdd5-51bf-43b7-8555-1a026f723453/node-ca/0.log" Apr 17 10:18:32.663771 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.663711 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" event={"ID":"ce6ed75b-f45c-4082-8ba0-567cae1d72e3","Type":"ContainerStarted","Data":"d2e8ee7692a215b93a5f1e17dedcc50e73f45daea1afe44e5e80a2a9d5eeb593"} Apr 17 10:18:32.664995 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.664962 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" event={"ID":"42a36e39-ecf4-4e32-99df-eded6b77a3f0","Type":"ContainerStarted","Data":"690954b3ca7e57bca95c1733203c91fe57d8c464a5da81a28345c8e56667f645"} Apr 17 10:18:32.666074 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.666047 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8psk" event={"ID":"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88","Type":"ContainerStarted","Data":"4489122a11615eb08765724587a6f19c1481fd97aa30a5db3736adc5999fb9d2"} Apr 17 10:18:32.668223 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.668195 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rvtfs" event={"ID":"f5adea0c-3b73-476b-9e57-646bf76d5a70","Type":"ContainerStarted","Data":"a12c3f8d237f5a9b989585f825c44c08f67be0c1427b342689d4ab64c3551f18"} Apr 17 10:18:32.696974 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.696919 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mx8jx" podStartSLOduration=1.9772977489999999 podStartE2EDuration="4.696902115s" podCreationTimestamp="2026-04-17 10:18:28 +0000 UTC" firstStartedPulling="2026-04-17 10:18:28.737460778 +0000 UTC m=+38.822247910" lastFinishedPulling="2026-04-17 10:18:31.457065127 +0000 UTC m=+41.541852276" observedRunningTime="2026-04-17 10:18:32.681492011 +0000 UTC m=+42.766279176" watchObservedRunningTime="2026-04-17 10:18:32.696902115 +0000 UTC m=+42.781689272" Apr 17 10:18:32.697154 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.697121 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-rvtfs" podStartSLOduration=1.995820391 podStartE2EDuration="4.697113531s" podCreationTimestamp="2026-04-17 10:18:28 +0000 UTC" firstStartedPulling="2026-04-17 10:18:28.749404066 +0000 UTC m=+38.834191213" lastFinishedPulling="2026-04-17 10:18:31.450697208 +0000 UTC m=+41.535484353" observedRunningTime="2026-04-17 10:18:32.696515894 +0000 UTC m=+42.781303048" watchObservedRunningTime="2026-04-17 10:18:32.697113531 +0000 UTC m=+42.781900689" Apr 17 10:18:32.976485 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:32.976197 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx8jx_a23bfe19-501b-4bed-8962-16e697010aa9/serve-healthcheck-canary/0.log" Apr 17 10:18:33.670988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:33.670955 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:34.675414 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.675372 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" event={"ID":"ce6ed75b-f45c-4082-8ba0-567cae1d72e3","Type":"ContainerStarted","Data":"39f06371d1e7b0efcfe887b51e5cff395e145b361c92ba4167806fda3da6fe01"} Apr 17 10:18:34.675926 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.675678 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:34.677266 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.677241 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" event={"ID":"42a36e39-ecf4-4e32-99df-eded6b77a3f0","Type":"ContainerStarted","Data":"1924d8d7257bc47273b76c5caaa6cf530a15633f2517059744491d9a5fcade5a"} Apr 17 10:18:34.677430 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.677273 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" event={"ID":"42a36e39-ecf4-4e32-99df-eded6b77a3f0","Type":"ContainerStarted","Data":"76c30ddeab07b6e4e23a896349909d5ae1c6941fa8e7ae460eb83af6ac645fff"} Apr 17 10:18:34.680969 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.680946 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" Apr 17 10:18:34.690694 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.690651 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jv8kk" podStartSLOduration=3.757585767 podStartE2EDuration="5.690641194s" podCreationTimestamp="2026-04-17 10:18:29 +0000 UTC" firstStartedPulling="2026-04-17 10:18:31.822123291 +0000 UTC m=+41.906910423" lastFinishedPulling="2026-04-17 10:18:33.755178719 +0000 UTC m=+43.839965850" observedRunningTime="2026-04-17 10:18:34.689245537 +0000 UTC m=+44.774032692" watchObservedRunningTime="2026-04-17 10:18:34.690641194 +0000 UTC m=+44.775428364" Apr 17 10:18:34.703236 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:34.703194 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-74bb7799d9-5h6rj" podStartSLOduration=2.764488009 podStartE2EDuration="4.703182275s" podCreationTimestamp="2026-04-17 10:18:30 +0000 UTC" firstStartedPulling="2026-04-17 10:18:31.814411051 +0000 UTC m=+41.899198183" lastFinishedPulling="2026-04-17 10:18:33.753105315 +0000 UTC m=+43.837892449" observedRunningTime="2026-04-17 10:18:34.702350388 +0000 UTC m=+44.787137544" watchObservedRunningTime="2026-04-17 10:18:34.703182275 +0000 UTC m=+44.787969431" Apr 17 10:18:35.146257 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.146222 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-jwnqv"] Apr 17 10:18:35.162640 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.162616 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-jwnqv"] Apr 17 10:18:35.162796 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.162724 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.165037 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165012 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Apr 17 10:18:35.165169 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165090 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 17 10:18:35.165169 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165110 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 17 10:18:35.165285 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165012 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Apr 17 10:18:35.166057 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165945 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 17 10:18:35.166057 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.165945 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xclpv\"" Apr 17 10:18:35.308034 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.307999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9lq\" (UniqueName: \"kubernetes.io/projected/bcd9d505-7487-4c6c-86db-4015eb6619aa-kube-api-access-pk9lq\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.308195 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.308113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd9d505-7487-4c6c-86db-4015eb6619aa-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.308195 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.308149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.308334 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.308192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.409614 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.409540 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd9d505-7487-4c6c-86db-4015eb6619aa-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.409614 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.409602 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.409914 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.409649 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.409914 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.409694 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9lq\" (UniqueName: \"kubernetes.io/projected/bcd9d505-7487-4c6c-86db-4015eb6619aa-kube-api-access-pk9lq\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.410957 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.410875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcd9d505-7487-4c6c-86db-4015eb6619aa-metrics-client-ca\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.413039 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.413010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.413537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.413511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bcd9d505-7487-4c6c-86db-4015eb6619aa-prometheus-operator-tls\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.418144 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.418103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9lq\" (UniqueName: \"kubernetes.io/projected/bcd9d505-7487-4c6c-86db-4015eb6619aa-kube-api-access-pk9lq\") pod \"prometheus-operator-5676c8c784-jwnqv\" (UID: \"bcd9d505-7487-4c6c-86db-4015eb6619aa\") " pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.474123 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.474091 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" Apr 17 10:18:35.621623 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.621575 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:18:35.656490 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.656445 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:18:35.656658 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.656602 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.659794 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.659599 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 17 10:18:35.659794 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.659611 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 17 10:18:35.659794 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.659618 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 17 10:18:35.660005 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.659990 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4b9bn\"" Apr 17 10:18:35.660486 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.660305 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 17 10:18:35.660580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.660512 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 17 10:18:35.813928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.813865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.813928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.813918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.814377 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.813956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.814377 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.813996 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.814377 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.814044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.814377 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.814081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb2w7\" (UniqueName: \"kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915506 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915417 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915506 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915467 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915506 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915498 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915533 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915560 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.915804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.915593 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vb2w7\" (UniqueName: \"kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.917169 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.917118 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.917510 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.917488 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.917768 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.917722 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.919299 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.919246 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.919400 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.919367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.924862 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.924816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb2w7\" (UniqueName: \"kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7\") pod \"console-8b48b48f9-ztf6x\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:35.970579 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:35.970490 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:37.003478 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.003428 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:18:37.029194 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.029167 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5676c8c784-jwnqv"] Apr 17 10:18:37.185441 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:37.185399 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b07f99_96fe_4e17_91fb_3f8b1c9d8733.slice/crio-03aba8a5eab4db55cf3ecc5642103168b5d12524db3f5d84e2457fdb0d5271c1 WatchSource:0}: Error finding container 03aba8a5eab4db55cf3ecc5642103168b5d12524db3f5d84e2457fdb0d5271c1: Status 404 returned error can't find the container with id 03aba8a5eab4db55cf3ecc5642103168b5d12524db3f5d84e2457fdb0d5271c1 Apr 17 10:18:37.185752 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:37.185653 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd9d505_7487_4c6c_86db_4015eb6619aa.slice/crio-f4be7b95e2045f8231e8b9e16dfffd0fbfbd6baf6b96077a49b6bf8774cd8c11 WatchSource:0}: Error finding container f4be7b95e2045f8231e8b9e16dfffd0fbfbd6baf6b96077a49b6bf8774cd8c11: Status 404 returned error can't find the container with id f4be7b95e2045f8231e8b9e16dfffd0fbfbd6baf6b96077a49b6bf8774cd8c11 Apr 17 10:18:37.688834 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.688781 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5cvbx"] Apr 17 10:18:37.703645 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.703618 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5cvbx"] Apr 17 10:18:37.703819 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.703648 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b48b48f9-ztf6x" event={"ID":"90b07f99-96fe-4e17-91fb-3f8b1c9d8733","Type":"ContainerStarted","Data":"03aba8a5eab4db55cf3ecc5642103168b5d12524db3f5d84e2457fdb0d5271c1"} Apr 17 10:18:37.703819 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.703669 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8psk" event={"ID":"dc016b5b-ead4-48ed-a13a-f0fdf34c3f88","Type":"ContainerStarted","Data":"c5c829413206487c760e74e1d59602b9cfac4f00dea8ea20b03e53c4cacd4386"} Apr 17 10:18:37.703819 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.703684 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" event={"ID":"bcd9d505-7487-4c6c-86db-4015eb6619aa","Type":"ContainerStarted","Data":"f4be7b95e2045f8231e8b9e16dfffd0fbfbd6baf6b96077a49b6bf8774cd8c11"} Apr 17 10:18:37.703819 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.703811 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.706267 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.706241 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 17 10:18:37.706401 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.706267 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l8hg\"" Apr 17 10:18:37.706401 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.706280 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 17 10:18:37.706531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.706479 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 17 10:18:37.706593 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.706582 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 17 10:18:37.737525 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.737485 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k8psk" podStartSLOduration=8.515993891 podStartE2EDuration="13.737472091s" podCreationTimestamp="2026-04-17 10:18:24 +0000 UTC" firstStartedPulling="2026-04-17 10:18:32.000491099 +0000 UTC m=+42.085278242" lastFinishedPulling="2026-04-17 10:18:37.221969295 +0000 UTC m=+47.306756442" observedRunningTime="2026-04-17 10:18:37.73683967 +0000 UTC m=+47.821626826" watchObservedRunningTime="2026-04-17 10:18:37.737472091 +0000 UTC m=+47.822259244" Apr 17 10:18:37.834988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.834608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.834988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.834677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.834988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.834748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-data-volume\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.834988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.834795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hz7\" (UniqueName: \"kubernetes.io/projected/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-api-access-g9hz7\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.834988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.834894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-crio-socket\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.935756 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.935709 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-data-volume\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.935948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.935776 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hz7\" (UniqueName: \"kubernetes.io/projected/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-api-access-g9hz7\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.935948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.935845 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-crio-socket\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.935948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.935889 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.935948 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.935935 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.936193 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.936071 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-data-volume\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.936193 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.936149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-crio-socket\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.936459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.936416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.941844 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.941714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:37.946345 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:37.946303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hz7\" (UniqueName: \"kubernetes.io/projected/5628730b-a86c-40d8-a1ed-fbc3c580f6b0-kube-api-access-g9hz7\") pod \"insights-runtime-extractor-5cvbx\" (UID: \"5628730b-a86c-40d8-a1ed-fbc3c580f6b0\") " pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:38.015191 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:38.015159 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5cvbx" Apr 17 10:18:38.175017 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:38.174356 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5cvbx"] Apr 17 10:18:38.186260 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:38.186034 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5628730b_a86c_40d8_a1ed_fbc3c580f6b0.slice/crio-307c4b8f4876da04ca79fa418b2e2eb213cc8af86d31d23b71901366dfdd0f8b WatchSource:0}: Error finding container 307c4b8f4876da04ca79fa418b2e2eb213cc8af86d31d23b71901366dfdd0f8b: Status 404 returned error can't find the container with id 307c4b8f4876da04ca79fa418b2e2eb213cc8af86d31d23b71901366dfdd0f8b Apr 17 10:18:38.699421 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:38.699266 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cvbx" event={"ID":"5628730b-a86c-40d8-a1ed-fbc3c580f6b0","Type":"ContainerStarted","Data":"d51b29d27d5829c0cf4f89c17edefafc6d0ba42d2dbef84989897a95b9fd544a"} Apr 17 10:18:38.699421 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:38.699306 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cvbx" event={"ID":"5628730b-a86c-40d8-a1ed-fbc3c580f6b0","Type":"ContainerStarted","Data":"307c4b8f4876da04ca79fa418b2e2eb213cc8af86d31d23b71901366dfdd0f8b"} Apr 17 10:18:39.703703 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:39.703665 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" event={"ID":"bcd9d505-7487-4c6c-86db-4015eb6619aa","Type":"ContainerStarted","Data":"1ff37fc3ef82398cbf0a079fdb85f714fdc601c1a8f4cf463a610cc75b5ee848"} Apr 17 10:18:41.711606 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:41.711502 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" event={"ID":"bcd9d505-7487-4c6c-86db-4015eb6619aa","Type":"ContainerStarted","Data":"6c61eb825738ed7f78be2dc1ad53c34d3add9c66fc23e8a2c5aba6d671bef333"} Apr 17 10:18:41.713418 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:41.713376 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cvbx" event={"ID":"5628730b-a86c-40d8-a1ed-fbc3c580f6b0","Type":"ContainerStarted","Data":"3f3c01a050de23933be7118e40e40c433b73079ecc744ad0f9402318a967729c"} Apr 17 10:18:41.714808 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:41.714787 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b48b48f9-ztf6x" event={"ID":"90b07f99-96fe-4e17-91fb-3f8b1c9d8733","Type":"ContainerStarted","Data":"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9"} Apr 17 10:18:41.732899 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:41.732860 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5676c8c784-jwnqv" podStartSLOduration=4.854008894 podStartE2EDuration="6.732847842s" podCreationTimestamp="2026-04-17 10:18:35 +0000 UTC" firstStartedPulling="2026-04-17 10:18:37.208092516 +0000 UTC m=+47.292879653" lastFinishedPulling="2026-04-17 10:18:39.086931467 +0000 UTC m=+49.171718601" observedRunningTime="2026-04-17 10:18:41.73089823 +0000 UTC m=+51.815685385" watchObservedRunningTime="2026-04-17 10:18:41.732847842 +0000 UTC m=+51.817634995" Apr 17 10:18:41.746949 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:41.746865 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8b48b48f9-ztf6x" podStartSLOduration=2.772226248 podStartE2EDuration="6.746760357s" podCreationTimestamp="2026-04-17 10:18:35 +0000 UTC" firstStartedPulling="2026-04-17 10:18:37.208041565 +0000 UTC m=+47.292828703" lastFinishedPulling="2026-04-17 10:18:41.182575663 +0000 UTC m=+51.267362812" observedRunningTime="2026-04-17 10:18:41.74565101 +0000 UTC m=+51.830438166" watchObservedRunningTime="2026-04-17 10:18:41.746760357 +0000 UTC m=+51.831547512" Apr 17 10:18:43.511745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.511689 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6"] Apr 17 10:18:43.514959 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.514939 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.517336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.517310 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 17 10:18:43.517448 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.517379 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wqlr8\"" Apr 17 10:18:43.517518 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.517310 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 17 10:18:43.527685 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.527660 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-jznpl"] Apr 17 10:18:43.531053 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.531032 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6"] Apr 17 10:18:43.531868 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.531180 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.533493 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.533411 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-95rjh\"" Apr 17 10:18:43.533610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.533511 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 17 10:18:43.534014 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.533991 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 17 10:18:43.534092 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.534033 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 17 10:18:43.543125 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.543102 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kxtzn"] Apr 17 10:18:43.547627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.547605 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.547822 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.547741 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-jznpl"] Apr 17 10:18:43.553147 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.553123 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 17 10:18:43.553147 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.553137 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 17 10:18:43.553427 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.553407 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qk24s\"" Apr 17 10:18:43.553854 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.553838 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 17 10:18:43.586156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586263 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59xx\" (UniqueName: \"kubernetes.io/projected/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-api-access-z59xx\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586263 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-root\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586263 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586291 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-tls\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586354 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkj28\" (UniqueName: \"kubernetes.io/projected/e05d976e-7041-4ff3-b72a-11618ad6c0df-kube-api-access-dkj28\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.586434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05d976e-7041-4ff3-b72a-11618ad6c0df-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.586434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-textfile\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-wtmp\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-sys\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586562 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586572 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wwnl\" (UniqueName: \"kubernetes.io/projected/52bfba92-cf85-4f50-b871-048a870b7a67-kube-api-access-5wwnl\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.586759 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.586758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-metrics-client-ca\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.679684 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.679652 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rvtfs" Apr 17 10:18:43.688014 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.687989 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05d976e-7041-4ff3-b72a-11618ad6c0df-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.688156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688028 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-textfile\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688156 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688053 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-wtmp\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688270 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688187 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688270 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688223 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-sys\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688270 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688252 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688413 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688282 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.688413 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-wtmp\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688413 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688323 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.688564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-textfile\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688474 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688506 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wwnl\" (UniqueName: \"kubernetes.io/projected/52bfba92-cf85-4f50-b871-048a870b7a67-kube-api-access-5wwnl\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688549 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688573 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688597 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-metrics-client-ca\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688641 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688669 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z59xx\" (UniqueName: \"kubernetes.io/projected/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-api-access-z59xx\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688708 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-root\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.688785 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688782 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e05d976e-7041-4ff3-b72a-11618ad6c0df-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688844 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-tls\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688881 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkj28\" (UniqueName: \"kubernetes.io/projected/e05d976e-7041-4ff3-b72a-11618ad6c0df-kube-api-access-dkj28\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:43.688889 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.688944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.689069 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:43.688950 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls podName:315159e1-4ca1-4d6a-ad50-aba9f5982ce0 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:44.188931361 +0000 UTC m=+54.273718494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls") pod "kube-state-metrics-69db897b98-jznpl" (UID: "315159e1-4ca1-4d6a-ad50-aba9f5982ce0") : secret "kube-state-metrics-tls" not found Apr 17 10:18:43.689354 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-root\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.689354 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689125 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.689354 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bfba92-cf85-4f50-b871-048a870b7a67-sys\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.689531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-metrics-client-ca\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.689654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.689791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.689766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-accelerators-collector-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.691567 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.691548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.691676 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.691569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.691755 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.691703 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.691942 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.691923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bfba92-cf85-4f50-b871-048a870b7a67-node-exporter-tls\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.692258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.692237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e05d976e-7041-4ff3-b72a-11618ad6c0df-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.699834 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.699691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wwnl\" (UniqueName: \"kubernetes.io/projected/52bfba92-cf85-4f50-b871-048a870b7a67-kube-api-access-5wwnl\") pod \"node-exporter-kxtzn\" (UID: \"52bfba92-cf85-4f50-b871-048a870b7a67\") " pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:43.703518 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.703498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkj28\" (UniqueName: \"kubernetes.io/projected/e05d976e-7041-4ff3-b72a-11618ad6c0df-kube-api-access-dkj28\") pod \"openshift-state-metrics-9d44df66c-nvng6\" (UID: \"e05d976e-7041-4ff3-b72a-11618ad6c0df\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.704131 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.704106 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59xx\" (UniqueName: \"kubernetes.io/projected/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-api-access-z59xx\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:43.825191 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.825109 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" Apr 17 10:18:43.859650 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:43.859621 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kxtzn" Apr 17 10:18:44.194813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.194778 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:44.197613 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.197583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/315159e1-4ca1-4d6a-ad50-aba9f5982ce0-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-jznpl\" (UID: \"315159e1-4ca1-4d6a-ad50-aba9f5982ce0\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:44.441215 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.441182 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" Apr 17 10:18:44.558297 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.558213 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:18:44.563567 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.563535 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.568170 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568122 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 10:18:44.568320 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568176 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 10:18:44.568320 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568274 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 10:18:44.568434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568387 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 10:18:44.568434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568415 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 10:18:44.568507 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568450 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 10:18:44.568575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568557 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 10:18:44.568711 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568694 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 10:18:44.568823 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568806 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 10:18:44.568885 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.568841 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lgppc\"" Apr 17 10:18:44.578863 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.578843 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:18:44.598446 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598560 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598458 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598560 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598489 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598671 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75cnp\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598671 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598648 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598782 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598824 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598788 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598872 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598909 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598884 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.598961 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598933 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.599006 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.598963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.599043 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.599031 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.599088 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.599064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.625976 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.625951 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:18:44.629399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.629368 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.636933 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.636883 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 17 10:18:44.639477 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.639436 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:18:44.700404 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700381 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700411 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700433 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.700531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700470 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700496 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700531 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.700791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.700791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700601 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700791 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:18:44.700616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle podName:23ee9e63-43fc-410a-94c7-89eac7cf0d09 nodeName:}" failed. No retries permitted until 2026-04-17 10:18:45.200595486 +0000 UTC m=+55.285382631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09") : configmap references non-existent config key: ca-bundle.crt Apr 17 10:18:44.700791 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dgwk\" (UniqueName: \"kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.700979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700852 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700882 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700914 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700943 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.700979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.700999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701037 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701142 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701168 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.701209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701203 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.701518 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701256 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75cnp\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.701941 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.701816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.703884 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.703838 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.704048 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.704028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.704665 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.704507 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.704990 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.704946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.705399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.705367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.705813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.705793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.705899 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.705878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.706116 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.706095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.706606 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.706588 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.713325 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.713302 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75cnp\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:44.802358 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.802322 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.802358 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.802376 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.803393 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.803363 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.803487 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.803460 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.803534 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.803509 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.803654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.803636 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dgwk\" (UniqueName: \"kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.803783 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.803750 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.804327 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.804280 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.806877 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.806821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.806982 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.806956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.809321 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.808238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.809321 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.808575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.809864 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.809837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.813831 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.813811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dgwk\" (UniqueName: \"kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk\") pod \"console-677f7cf68d-c7ph7\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:44.941582 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:44.941551 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:45.207237 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.207199 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:45.208064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.208031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:45.476762 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.476681 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:18:45.971118 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.971083 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:45.971573 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.971129 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:45.976342 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:45.976321 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:46.732575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:46.732545 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:18:48.289487 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.289451 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d"] Apr 17 10:18:48.321888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.321861 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d"] Apr 17 10:18:48.322051 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.322005 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:48.324278 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.324250 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-f8zw9\"" Apr 17 10:18:48.324395 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.324245 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Apr 17 10:18:48.438571 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.438533 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21bb72eb-c4a9-4412-8c28-046f4c4a619e-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-j2r2d\" (UID: \"21bb72eb-c4a9-4412-8c28-046f4c4a619e\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:48.539860 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.539776 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21bb72eb-c4a9-4412-8c28-046f4c4a619e-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-j2r2d\" (UID: \"21bb72eb-c4a9-4412-8c28-046f4c4a619e\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:48.542362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.542336 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/21bb72eb-c4a9-4412-8c28-046f4c4a619e-monitoring-plugin-cert\") pod \"monitoring-plugin-7dccd58f55-j2r2d\" (UID: \"21bb72eb-c4a9-4412-8c28-046f4c4a619e\") " pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:48.631355 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.631318 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcw2v" Apr 17 10:18:48.633031 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:48.633013 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:49.706900 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.706864 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:18:49.723850 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.723826 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.727823 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.727800 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 10:18:49.728148 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728134 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 10:18:49.728313 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728293 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 10:18:49.728419 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728334 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 10:18:49.728689 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728667 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 10:18:49.728689 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728667 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 10:18:49.728851 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728670 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n694v\"" Apr 17 10:18:49.728851 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.728802 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 10:18:49.734009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.733836 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 10:18:49.734009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.733838 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 10:18:49.734009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.733932 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 10:18:49.734009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.733958 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 10:18:49.734009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.733966 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ejs2k26m14hm\"" Apr 17 10:18:49.734422 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.734402 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 10:18:49.741912 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.741892 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 10:18:49.748639 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.748617 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:18:49.853060 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853131 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853261 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853350 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853411 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.853575 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl8tm\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.854071 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.853589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.881110 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:49.881055 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bfba92_cf85_4f50_b871_048a870b7a67.slice/crio-b51f8efbe9759571071073153cd21e9dad2bb1fc264773d0e3948d9bd30b289f WatchSource:0}: Error finding container b51f8efbe9759571071073153cd21e9dad2bb1fc264773d0e3948d9bd30b289f: Status 404 returned error can't find the container with id b51f8efbe9759571071073153cd21e9dad2bb1fc264773d0e3948d9bd30b289f Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954558 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954612 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954645 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954675 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954704 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954750 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl8tm\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.954807 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954786 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954842 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954868 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954897 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954921 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954950 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.954991 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.955013 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.955072 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.955101 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.955126 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.955289 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.955152 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.958706 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.958360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.959262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.958948 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.966563 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.959898 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.966563 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.963640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.966563 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.965373 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.970260 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.970004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.970372 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.970337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.971634 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.971587 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.976349 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.976288 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.979453 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.978944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.979453 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.979363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.982606 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.981487 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.983429 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.983370 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.983546 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.983481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.987940 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.985642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.987940 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.986029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.987940 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.986960 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:49.990666 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:49.990631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl8tm\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm\") pod \"prometheus-k8s-0\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:50.041988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.041592 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:18:50.100224 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.100135 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:18:50.104397 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:50.104282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d38d4d_200e_4ac5_a316_c90c917947f6.slice/crio-0de51dba5afc8511beaa6215acba627e4e10166e04a6f00481e8a204fce420a5 WatchSource:0}: Error finding container 0de51dba5afc8511beaa6215acba627e4e10166e04a6f00481e8a204fce420a5: Status 404 returned error can't find the container with id 0de51dba5afc8511beaa6215acba627e4e10166e04a6f00481e8a204fce420a5 Apr 17 10:18:50.122825 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.122455 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-jznpl"] Apr 17 10:18:50.125438 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:50.125372 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315159e1_4ca1_4d6a_ad50_aba9f5982ce0.slice/crio-7b3ec20205ff73c267b40e6b69669f2338093e25b718b56c20ff79d24e9d0b32 WatchSource:0}: Error finding container 7b3ec20205ff73c267b40e6b69669f2338093e25b718b56c20ff79d24e9d0b32: Status 404 returned error can't find the container with id 7b3ec20205ff73c267b40e6b69669f2338093e25b718b56c20ff79d24e9d0b32 Apr 17 10:18:50.187609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.187523 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:18:50.192020 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:50.191986 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ee9e63_43fc_410a_94c7_89eac7cf0d09.slice/crio-e15841e84ebe6194190b9b14f9bc19d73c9f3742684f7fbaa75d119d8e1f8b49 WatchSource:0}: Error finding container e15841e84ebe6194190b9b14f9bc19d73c9f3742684f7fbaa75d119d8e1f8b49: Status 404 returned error can't find the container with id e15841e84ebe6194190b9b14f9bc19d73c9f3742684f7fbaa75d119d8e1f8b49 Apr 17 10:18:50.230426 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.230355 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:18:50.340141 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.340107 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d"] Apr 17 10:18:50.342922 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.342862 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6"] Apr 17 10:18:50.344334 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:50.344304 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21bb72eb_c4a9_4412_8c28_046f4c4a619e.slice/crio-c8980d2d8eab20eed35cf8066ed23c526b3e692007aea00ccaff34abddaa3b0f WatchSource:0}: Error finding container c8980d2d8eab20eed35cf8066ed23c526b3e692007aea00ccaff34abddaa3b0f: Status 404 returned error can't find the container with id c8980d2d8eab20eed35cf8066ed23c526b3e692007aea00ccaff34abddaa3b0f Apr 17 10:18:50.346024 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:50.346002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05d976e_7041_4ff3_b72a_11618ad6c0df.slice/crio-874db8b5d7b4436ea0f9ec79ffd2cdd1b4e277b06d92f702da2dce1e1fe602c8 WatchSource:0}: Error finding container 874db8b5d7b4436ea0f9ec79ffd2cdd1b4e277b06d92f702da2dce1e1fe602c8: Status 404 returned error can't find the container with id 874db8b5d7b4436ea0f9ec79ffd2cdd1b4e277b06d92f702da2dce1e1fe602c8 Apr 17 10:18:50.743192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.743009 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6bcc868b7-4q7xk" event={"ID":"4b3e0e8b-43cb-4854-86d9-00c38bfd631c","Type":"ContainerStarted","Data":"0ce7c73b705469635a4ce3372380164da4a7fb065f7a1dc600984338c3b308c2"} Apr 17 10:18:50.743610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.743504 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:50.746322 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.746171 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"53cbe6e5163157528bed0696533f1a18bba833a83e2f2f516d95cb9a453d9cb6"} Apr 17 10:18:50.748333 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.748196 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxtzn" event={"ID":"52bfba92-cf85-4f50-b871-048a870b7a67","Type":"ContainerStarted","Data":"b51f8efbe9759571071073153cd21e9dad2bb1fc264773d0e3948d9bd30b289f"} Apr 17 10:18:50.750982 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.750933 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" event={"ID":"21bb72eb-c4a9-4412-8c28-046f4c4a619e","Type":"ContainerStarted","Data":"c8980d2d8eab20eed35cf8066ed23c526b3e692007aea00ccaff34abddaa3b0f"} Apr 17 10:18:50.753564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.753497 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"e15841e84ebe6194190b9b14f9bc19d73c9f3742684f7fbaa75d119d8e1f8b49"} Apr 17 10:18:50.756565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.756472 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cvbx" event={"ID":"5628730b-a86c-40d8-a1ed-fbc3c580f6b0","Type":"ContainerStarted","Data":"0d44b97f637f585f88b5974011f3eff4483e1efa51c00ce1c704efb55332afcb"} Apr 17 10:18:50.759115 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.759059 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" event={"ID":"315159e1-4ca1-4d6a-ad50-aba9f5982ce0","Type":"ContainerStarted","Data":"7b3ec20205ff73c267b40e6b69669f2338093e25b718b56c20ff79d24e9d0b32"} Apr 17 10:18:50.762419 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.762344 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" event={"ID":"e05d976e-7041-4ff3-b72a-11618ad6c0df","Type":"ContainerStarted","Data":"a1a530190c7614c28f8706af9e7ffe8145fe072938ae74d15b718252ea496e3b"} Apr 17 10:18:50.762419 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.762377 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" event={"ID":"e05d976e-7041-4ff3-b72a-11618ad6c0df","Type":"ContainerStarted","Data":"25809816e349a3cb0f04457f548fb406ef69faf8d8faf7cb6eea788dcf823ad4"} Apr 17 10:18:50.762419 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.762402 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" event={"ID":"e05d976e-7041-4ff3-b72a-11618ad6c0df","Type":"ContainerStarted","Data":"874db8b5d7b4436ea0f9ec79ffd2cdd1b4e277b06d92f702da2dce1e1fe602c8"} Apr 17 10:18:50.765394 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.765296 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f7cf68d-c7ph7" event={"ID":"87d38d4d-200e-4ac5-a316-c90c917947f6","Type":"ContainerStarted","Data":"bf9e13ccaa5eeabec4fdecf0783d3777a9872066372427a8e7f84020327bdda0"} Apr 17 10:18:50.765394 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.765327 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f7cf68d-c7ph7" event={"ID":"87d38d4d-200e-4ac5-a316-c90c917947f6","Type":"ContainerStarted","Data":"0de51dba5afc8511beaa6215acba627e4e10166e04a6f00481e8a204fce420a5"} Apr 17 10:18:50.770629 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.770607 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6bcc868b7-4q7xk" Apr 17 10:18:50.783305 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.783260 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-6bcc868b7-4q7xk" podStartSLOduration=2.507914564 podStartE2EDuration="20.783248741s" podCreationTimestamp="2026-04-17 10:18:30 +0000 UTC" firstStartedPulling="2026-04-17 10:18:31.604384961 +0000 UTC m=+41.689172093" lastFinishedPulling="2026-04-17 10:18:49.87971912 +0000 UTC m=+59.964506270" observedRunningTime="2026-04-17 10:18:50.781344703 +0000 UTC m=+60.866131857" watchObservedRunningTime="2026-04-17 10:18:50.783248741 +0000 UTC m=+60.868035895" Apr 17 10:18:50.819987 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.818456 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-677f7cf68d-c7ph7" podStartSLOduration=6.818438878 podStartE2EDuration="6.818438878s" podCreationTimestamp="2026-04-17 10:18:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:18:50.818160672 +0000 UTC m=+60.902947826" watchObservedRunningTime="2026-04-17 10:18:50.818438878 +0000 UTC m=+60.903226033" Apr 17 10:18:50.836440 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:50.836385 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5cvbx" podStartSLOduration=2.262745964 podStartE2EDuration="13.83636641s" podCreationTimestamp="2026-04-17 10:18:37 +0000 UTC" firstStartedPulling="2026-04-17 10:18:38.306552615 +0000 UTC m=+48.391339763" lastFinishedPulling="2026-04-17 10:18:49.880173073 +0000 UTC m=+59.964960209" observedRunningTime="2026-04-17 10:18:50.834834887 +0000 UTC m=+60.919622042" watchObservedRunningTime="2026-04-17 10:18:50.83636641 +0000 UTC m=+60.921153571" Apr 17 10:18:51.026483 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:51.026379 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:18:51.666772 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:51.665912 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86bcd8b69-xplz9" Apr 17 10:18:54.780050 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.780015 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" exitCode=0 Apr 17 10:18:54.780472 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.780107 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} Apr 17 10:18:54.781979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.781877 2573 generic.go:358] "Generic (PLEG): container finished" podID="52bfba92-cf85-4f50-b871-048a870b7a67" containerID="ac8512a495e38520aa2dc80319510b95d01459d4446e87e8a1ffb6319f5d40f3" exitCode=0 Apr 17 10:18:54.781979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.781948 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxtzn" event={"ID":"52bfba92-cf85-4f50-b871-048a870b7a67","Type":"ContainerDied","Data":"ac8512a495e38520aa2dc80319510b95d01459d4446e87e8a1ffb6319f5d40f3"} Apr 17 10:18:54.784106 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.784076 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" event={"ID":"21bb72eb-c4a9-4412-8c28-046f4c4a619e","Type":"ContainerStarted","Data":"4eee0896208c13d80c5e30222f38c27596952f3dbe3644a98e0b611fa472058a"} Apr 17 10:18:54.784622 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.784575 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:54.786036 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.786015 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="99fe34ec654e86e3943cdce58b03049bde3d08728228f8f651d7f430ba9b7ff3" exitCode=0 Apr 17 10:18:54.786134 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.786085 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"99fe34ec654e86e3943cdce58b03049bde3d08728228f8f651d7f430ba9b7ff3"} Apr 17 10:18:54.789096 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.789072 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" event={"ID":"315159e1-4ca1-4d6a-ad50-aba9f5982ce0","Type":"ContainerStarted","Data":"59deb4da979511f98e62f0a91f7f36b71b073ba930713e1f1afa50bedf7c965e"} Apr 17 10:18:54.789183 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.789107 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" event={"ID":"315159e1-4ca1-4d6a-ad50-aba9f5982ce0","Type":"ContainerStarted","Data":"0f1767f953ee5ca641356cce60ee9664d196144e19516cde9b61701517284820"} Apr 17 10:18:54.789183 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.789122 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" event={"ID":"315159e1-4ca1-4d6a-ad50-aba9f5982ce0","Type":"ContainerStarted","Data":"a464d4877b8e13a4d137c5703640e1096b297b64370bbeb71d089e3bb2c475b4"} Apr 17 10:18:54.791299 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.791199 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" Apr 17 10:18:54.791754 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.791711 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" event={"ID":"e05d976e-7041-4ff3-b72a-11618ad6c0df","Type":"ContainerStarted","Data":"30e424e9d5d1bf0f247507b9407fab7420d0257b8a768c457dde1f436f155b6a"} Apr 17 10:18:54.828104 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.828056 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-nvng6" podStartSLOduration=8.255201304 podStartE2EDuration="11.828039799s" podCreationTimestamp="2026-04-17 10:18:43 +0000 UTC" firstStartedPulling="2026-04-17 10:18:50.515505516 +0000 UTC m=+60.600292657" lastFinishedPulling="2026-04-17 10:18:54.088344009 +0000 UTC m=+64.173131152" observedRunningTime="2026-04-17 10:18:54.826228737 +0000 UTC m=+64.911015900" watchObservedRunningTime="2026-04-17 10:18:54.828039799 +0000 UTC m=+64.912826956" Apr 17 10:18:54.883609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.883558 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7dccd58f55-j2r2d" podStartSLOduration=3.143889481 podStartE2EDuration="6.883538158s" podCreationTimestamp="2026-04-17 10:18:48 +0000 UTC" firstStartedPulling="2026-04-17 10:18:50.346721577 +0000 UTC m=+60.431508712" lastFinishedPulling="2026-04-17 10:18:54.086370244 +0000 UTC m=+64.171157389" observedRunningTime="2026-04-17 10:18:54.839938557 +0000 UTC m=+64.924725713" watchObservedRunningTime="2026-04-17 10:18:54.883538158 +0000 UTC m=+64.968325313" Apr 17 10:18:54.911118 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.911068 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-jznpl" podStartSLOduration=8.227224277 podStartE2EDuration="11.91105325s" podCreationTimestamp="2026-04-17 10:18:43 +0000 UTC" firstStartedPulling="2026-04-17 10:18:50.144641088 +0000 UTC m=+60.229428226" lastFinishedPulling="2026-04-17 10:18:53.828470061 +0000 UTC m=+63.913257199" observedRunningTime="2026-04-17 10:18:54.909167391 +0000 UTC m=+64.993954548" watchObservedRunningTime="2026-04-17 10:18:54.91105325 +0000 UTC m=+64.995840404" Apr 17 10:18:54.942275 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:54.942243 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:18:55.801015 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:55.800970 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxtzn" event={"ID":"52bfba92-cf85-4f50-b871-048a870b7a67","Type":"ContainerStarted","Data":"0351a63b62d9dce27d6f457047fcbacf405c60fbe31e48efa9323de886e10a99"} Apr 17 10:18:55.801015 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:55.801016 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kxtzn" event={"ID":"52bfba92-cf85-4f50-b871-048a870b7a67","Type":"ContainerStarted","Data":"adb271c3297f34782afcb70f77f9c436c1374ff0277a84670b05ea418a7db244"} Apr 17 10:18:55.823844 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:55.823535 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kxtzn" podStartSLOduration=9.440357444 podStartE2EDuration="12.823517116s" podCreationTimestamp="2026-04-17 10:18:43 +0000 UTC" firstStartedPulling="2026-04-17 10:18:49.904279805 +0000 UTC m=+59.989066941" lastFinishedPulling="2026-04-17 10:18:53.287439467 +0000 UTC m=+63.372226613" observedRunningTime="2026-04-17 10:18:55.821361169 +0000 UTC m=+65.906148324" watchObservedRunningTime="2026-04-17 10:18:55.823517116 +0000 UTC m=+65.908304274" Apr 17 10:18:56.029280 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.028926 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:18:56.054022 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.053945 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:18:56.054233 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.054108 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140233 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140197 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:56.140463 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140463 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140463 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140463 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140666 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140666 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140592 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:56.140666 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.140831 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.140665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.142756 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.142694 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 10:18:56.142881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.142816 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 10:18:56.153346 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.153323 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 10:18:56.154081 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.154057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30812199-596c-4ab1-b17b-ef92026124e6-metrics-certs\") pod \"network-metrics-daemon-m98nc\" (UID: \"30812199-596c-4ab1-b17b-ef92026124e6\") " pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:56.165482 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.165428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcsxt\" (UniqueName: \"kubernetes.io/projected/405413ce-3046-4495-be37-74e908505d81-kube-api-access-kcsxt\") pod \"network-check-target-vtvnj\" (UID: \"405413ce-3046-4495-be37-74e908505d81\") " pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:56.198468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.198258 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxdvh\"" Apr 17 10:18:56.204309 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.204272 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k4g8r\"" Apr 17 10:18:56.207192 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.207169 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:18:56.212952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.212926 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m98nc" Apr 17 10:18:56.242069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.241929 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242007 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242051 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242341 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242371 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242405 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.242839 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242442 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.243163 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.242878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.243163 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.243011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.243900 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.243865 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.244259 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.244222 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.246563 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.246540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.247150 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.247130 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.250502 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.250459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk\") pod \"console-f86fc4fb7-xhcqx\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.368795 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.368591 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:18:56.979624 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.979577 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vtvnj"] Apr 17 10:18:56.992441 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:56.992270 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:18:57.006993 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.006966 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m98nc"] Apr 17 10:18:57.199577 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:57.199333 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8c97c3_47dd_432d_a182_8fa77ef96a66.slice/crio-30095a6e64a3a3b78ff412c08d9dd3bfa298217454697250940e703ad6d56747 WatchSource:0}: Error finding container 30095a6e64a3a3b78ff412c08d9dd3bfa298217454697250940e703ad6d56747: Status 404 returned error can't find the container with id 30095a6e64a3a3b78ff412c08d9dd3bfa298217454697250940e703ad6d56747 Apr 17 10:18:57.202868 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:18:57.202843 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30812199_596c_4ab1_b17b_ef92026124e6.slice/crio-8566427c5d1d5bcea254fe2f27c5ed94bbc28b1ca45df3875f58ae2b61bebabb WatchSource:0}: Error finding container 8566427c5d1d5bcea254fe2f27c5ed94bbc28b1ca45df3875f58ae2b61bebabb: Status 404 returned error can't find the container with id 8566427c5d1d5bcea254fe2f27c5ed94bbc28b1ca45df3875f58ae2b61bebabb Apr 17 10:18:57.818674 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.818612 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86fc4fb7-xhcqx" event={"ID":"5f8c97c3-47dd-432d-a182-8fa77ef96a66","Type":"ContainerStarted","Data":"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8"} Apr 17 10:18:57.818674 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.818679 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86fc4fb7-xhcqx" event={"ID":"5f8c97c3-47dd-432d-a182-8fa77ef96a66","Type":"ContainerStarted","Data":"30095a6e64a3a3b78ff412c08d9dd3bfa298217454697250940e703ad6d56747"} Apr 17 10:18:57.820692 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.820660 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vtvnj" event={"ID":"405413ce-3046-4495-be37-74e908505d81","Type":"ContainerStarted","Data":"68c53ed7c40e39699affc2f39a13ccc1b57180f2412a26b6c186eded30666d39"} Apr 17 10:18:57.822889 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.822842 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"ab01d52496e33255686ea12645f5bf43b8da9b5d6d82c36afabe488bf0a7cabd"} Apr 17 10:18:57.824138 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.824102 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m98nc" event={"ID":"30812199-596c-4ab1-b17b-ef92026124e6","Type":"ContainerStarted","Data":"8566427c5d1d5bcea254fe2f27c5ed94bbc28b1ca45df3875f58ae2b61bebabb"} Apr 17 10:18:57.836640 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:57.836586 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f86fc4fb7-xhcqx" podStartSLOduration=1.8365705 podStartE2EDuration="1.8365705s" podCreationTimestamp="2026-04-17 10:18:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:18:57.835119172 +0000 UTC m=+67.919906329" watchObservedRunningTime="2026-04-17 10:18:57.8365705 +0000 UTC m=+67.921357652" Apr 17 10:18:58.831596 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:58.831569 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"7eb010257b91841caf4750a43a4a8da4737fc3d7278dfabb2206c34bca2dac25"} Apr 17 10:18:58.831944 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:58.831607 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"98767e08bf62a6d1af5cbea37a24930230843ec2a456a882a07db55a688fb3b7"} Apr 17 10:18:59.839811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:59.839760 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} Apr 17 10:18:59.839811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:59.839805 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} Apr 17 10:18:59.845060 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:59.845031 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"ceeac911de744a2240d37a4c4370d4209ed32429683293b14fbaadd801b4a52d"} Apr 17 10:18:59.845161 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:18:59.845069 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"9139e2f9cd9db6f178ac27cbc3d540b21d684ef22f0e830d3bd0079653ad76f1"} Apr 17 10:19:03.858941 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.858885 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vtvnj" event={"ID":"405413ce-3046-4495-be37-74e908505d81","Type":"ContainerStarted","Data":"b3c2f2643aab9da74f82f970f4293e4fd2dc2fc37560bdad79d419042269f351"} Apr 17 10:19:03.859363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.858985 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:19:03.861766 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.861724 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerStarted","Data":"98174a3d0a9f9b5b4cf4858ef4cb9584460ca21ebb311f19ff041938f107b4e7"} Apr 17 10:19:03.863310 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.863285 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m98nc" event={"ID":"30812199-596c-4ab1-b17b-ef92026124e6","Type":"ContainerStarted","Data":"0ae249f1a3d592b324aabe28a45c141510d79b40511aa681a541040d820668b8"} Apr 17 10:19:03.863423 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.863315 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m98nc" event={"ID":"30812199-596c-4ab1-b17b-ef92026124e6","Type":"ContainerStarted","Data":"8fefd23a7f9b0f79614cb7e6fb662827b0c80136211be9d33923016034920670"} Apr 17 10:19:03.866018 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.866000 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} Apr 17 10:19:03.866103 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.866021 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} Apr 17 10:19:03.866103 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.866031 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} Apr 17 10:19:03.866103 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.866040 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerStarted","Data":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} Apr 17 10:19:03.875767 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.875709 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vtvnj" podStartSLOduration=68.047160106 podStartE2EDuration="1m13.875696985s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:18:57.201345525 +0000 UTC m=+67.286132674" lastFinishedPulling="2026-04-17 10:19:03.029882408 +0000 UTC m=+73.114669553" observedRunningTime="2026-04-17 10:19:03.874431495 +0000 UTC m=+73.959218648" watchObservedRunningTime="2026-04-17 10:19:03.875696985 +0000 UTC m=+73.960484139" Apr 17 10:19:03.899995 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.899703 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.099785419 podStartE2EDuration="19.899688209s" podCreationTimestamp="2026-04-17 10:18:44 +0000 UTC" firstStartedPulling="2026-04-17 10:18:50.199595412 +0000 UTC m=+60.284382558" lastFinishedPulling="2026-04-17 10:19:02.9994982 +0000 UTC m=+73.084285348" observedRunningTime="2026-04-17 10:19:03.897342144 +0000 UTC m=+73.982129297" watchObservedRunningTime="2026-04-17 10:19:03.899688209 +0000 UTC m=+73.984475365" Apr 17 10:19:03.920325 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.919009 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m98nc" podStartSLOduration=68.375884595 podStartE2EDuration="1m13.918952655s" podCreationTimestamp="2026-04-17 10:17:50 +0000 UTC" firstStartedPulling="2026-04-17 10:18:57.233015278 +0000 UTC m=+67.317802421" lastFinishedPulling="2026-04-17 10:19:02.776083342 +0000 UTC m=+72.860870481" observedRunningTime="2026-04-17 10:19:03.917032096 +0000 UTC m=+74.001819248" watchObservedRunningTime="2026-04-17 10:19:03.918952655 +0000 UTC m=+74.003739810" Apr 17 10:19:03.949014 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:03.948975 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.165079846 podStartE2EDuration="14.948959461s" podCreationTimestamp="2026-04-17 10:18:49 +0000 UTC" firstStartedPulling="2026-04-17 10:18:50.237622099 +0000 UTC m=+60.322409234" lastFinishedPulling="2026-04-17 10:19:03.021501712 +0000 UTC m=+73.106288849" observedRunningTime="2026-04-17 10:19:03.946618922 +0000 UTC m=+74.031406114" watchObservedRunningTime="2026-04-17 10:19:03.948959461 +0000 UTC m=+74.033746616" Apr 17 10:19:05.043086 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:05.043050 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:06.369783 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:06.369724 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:19:06.369783 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:06.369788 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:19:06.374161 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:06.374139 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:19:06.880804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:06.880778 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:19:06.927465 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:06.927429 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:19:17.794383 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:17.794211 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-677f7cf68d-c7ph7" podUID="87d38d4d-200e-4ac5-a316-c90c917947f6" containerName="console" containerID="cri-o://bf9e13ccaa5eeabec4fdecf0783d3777a9872066372427a8e7f84020327bdda0" gracePeriod=15 Apr 17 10:19:17.910943 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:17.910922 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677f7cf68d-c7ph7_87d38d4d-200e-4ac5-a316-c90c917947f6/console/0.log" Apr 17 10:19:17.911060 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:17.910960 2573 generic.go:358] "Generic (PLEG): container finished" podID="87d38d4d-200e-4ac5-a316-c90c917947f6" containerID="bf9e13ccaa5eeabec4fdecf0783d3777a9872066372427a8e7f84020327bdda0" exitCode=2 Apr 17 10:19:17.911060 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:17.911043 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f7cf68d-c7ph7" event={"ID":"87d38d4d-200e-4ac5-a316-c90c917947f6","Type":"ContainerDied","Data":"bf9e13ccaa5eeabec4fdecf0783d3777a9872066372427a8e7f84020327bdda0"} Apr 17 10:19:18.060383 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.060361 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677f7cf68d-c7ph7_87d38d4d-200e-4ac5-a316-c90c917947f6/console/0.log" Apr 17 10:19:18.060503 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.060441 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:19:18.148001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.147976 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dgwk\" (UniqueName: \"kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148134 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148014 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148134 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148062 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148134 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148090 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148134 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148128 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148334 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148308 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148391 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148358 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config\") pod \"87d38d4d-200e-4ac5-a316-c90c917947f6\" (UID: \"87d38d4d-200e-4ac5-a316-c90c917947f6\") " Apr 17 10:19:18.148713 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148664 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:18.148858 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148747 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:18.148931 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148901 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:18.148989 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.148923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config" (OuterVolumeSpecName: "console-config") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:18.150443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.150419 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:18.150553 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.150506 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk" (OuterVolumeSpecName: "kube-api-access-8dgwk") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "kube-api-access-8dgwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:18.150553 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.150511 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "87d38d4d-200e-4ac5-a316-c90c917947f6" (UID: "87d38d4d-200e-4ac5-a316-c90c917947f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:18.249635 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249611 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-oauth-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249635 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249633 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-console-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249643 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dgwk\" (UniqueName: \"kubernetes.io/projected/87d38d4d-200e-4ac5-a316-c90c917947f6-kube-api-access-8dgwk\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249651 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-oauth-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249659 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/87d38d4d-200e-4ac5-a316-c90c917947f6-console-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249667 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-trusted-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.249813 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.249676 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/87d38d4d-200e-4ac5-a316-c90c917947f6-service-ca\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:18.915523 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.915499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677f7cf68d-c7ph7_87d38d4d-200e-4ac5-a316-c90c917947f6/console/0.log" Apr 17 10:19:18.916006 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.915592 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f7cf68d-c7ph7" event={"ID":"87d38d4d-200e-4ac5-a316-c90c917947f6","Type":"ContainerDied","Data":"0de51dba5afc8511beaa6215acba627e4e10166e04a6f00481e8a204fce420a5"} Apr 17 10:19:18.916006 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.915624 2573 scope.go:117] "RemoveContainer" containerID="bf9e13ccaa5eeabec4fdecf0783d3777a9872066372427a8e7f84020327bdda0" Apr 17 10:19:18.916006 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.915626 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f7cf68d-c7ph7" Apr 17 10:19:18.932358 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.932330 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:19:18.935574 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:18.935553 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677f7cf68d-c7ph7"] Apr 17 10:19:20.477639 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:20.477610 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d38d4d-200e-4ac5-a316-c90c917947f6" path="/var/lib/kubelet/pods/87d38d4d-200e-4ac5-a316-c90c917947f6/volumes" Apr 17 10:19:31.951541 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:31.951480 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8b48b48f9-ztf6x" podUID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" containerName="console" containerID="cri-o://1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9" gracePeriod=15 Apr 17 10:19:32.222182 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.222161 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b48b48f9-ztf6x_90b07f99-96fe-4e17-91fb-3f8b1c9d8733/console/0.log" Apr 17 10:19:32.222292 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.222218 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:19:32.360697 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360667 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.360856 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360724 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb2w7\" (UniqueName: \"kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.360856 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360767 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.360856 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360805 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.360856 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360844 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.361029 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.360874 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert\") pod \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\" (UID: \"90b07f99-96fe-4e17-91fb-3f8b1c9d8733\") " Apr 17 10:19:32.361246 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.361202 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca" (OuterVolumeSpecName: "service-ca") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:32.361350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.361212 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config" (OuterVolumeSpecName: "console-config") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:32.361350 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.361270 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:32.362950 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.362923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:32.363447 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.363425 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7" (OuterVolumeSpecName: "kube-api-access-vb2w7") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "kube-api-access-vb2w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:32.363523 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.363441 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "90b07f99-96fe-4e17-91fb-3f8b1c9d8733" (UID: "90b07f99-96fe-4e17-91fb-3f8b1c9d8733"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461507 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461531 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-oauth-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461541 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461551 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb2w7\" (UniqueName: \"kubernetes.io/projected/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-kube-api-access-vb2w7\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461560 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-service-ca\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.461565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.461569 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/90b07f99-96fe-4e17-91fb-3f8b1c9d8733-console-oauth-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:32.963354 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963330 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8b48b48f9-ztf6x_90b07f99-96fe-4e17-91fb-3f8b1c9d8733/console/0.log" Apr 17 10:19:32.963745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963369 2573 generic.go:358] "Generic (PLEG): container finished" podID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" containerID="1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9" exitCode=2 Apr 17 10:19:32.963745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963432 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b48b48f9-ztf6x" Apr 17 10:19:32.963745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963439 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b48b48f9-ztf6x" event={"ID":"90b07f99-96fe-4e17-91fb-3f8b1c9d8733","Type":"ContainerDied","Data":"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9"} Apr 17 10:19:32.963745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963473 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b48b48f9-ztf6x" event={"ID":"90b07f99-96fe-4e17-91fb-3f8b1c9d8733","Type":"ContainerDied","Data":"03aba8a5eab4db55cf3ecc5642103168b5d12524db3f5d84e2457fdb0d5271c1"} Apr 17 10:19:32.963745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.963489 2573 scope.go:117] "RemoveContainer" containerID="1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9" Apr 17 10:19:32.979177 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.979148 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:19:32.981438 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.981415 2573 scope.go:117] "RemoveContainer" containerID="1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9" Apr 17 10:19:32.981788 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:32.981760 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9\": container with ID starting with 1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9 not found: ID does not exist" containerID="1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9" Apr 17 10:19:32.981881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.981798 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9"} err="failed to get container status \"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9\": rpc error: code = NotFound desc = could not find container \"1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9\": container with ID starting with 1b24af238004dc277cbd334543a66f4c72cb8388c1c35ad3b25a7ff8e3f203d9 not found: ID does not exist" Apr 17 10:19:32.982765 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:32.982722 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b48b48f9-ztf6x"] Apr 17 10:19:34.478131 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:34.478098 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" path="/var/lib/kubelet/pods/90b07f99-96fe-4e17-91fb-3f8b1c9d8733/volumes" Apr 17 10:19:34.871379 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:34.871305 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vtvnj" Apr 17 10:19:41.409831 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:41.409799 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:41.482275 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:41.482248 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:42.004207 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:42.004182 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:53.832170 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832132 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:19:53.832805 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832743 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="alertmanager" containerID="cri-o://ab01d52496e33255686ea12645f5bf43b8da9b5d6d82c36afabe488bf0a7cabd" gracePeriod=120 Apr 17 10:19:53.832966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832781 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-metric" containerID="cri-o://ceeac911de744a2240d37a4c4370d4209ed32429683293b14fbaadd801b4a52d" gracePeriod=120 Apr 17 10:19:53.832966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832830 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-web" containerID="cri-o://7eb010257b91841caf4750a43a4a8da4737fc3d7278dfabb2206c34bca2dac25" gracePeriod=120 Apr 17 10:19:53.832966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832877 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy" containerID="cri-o://9139e2f9cd9db6f178ac27cbc3d540b21d684ef22f0e830d3bd0079653ad76f1" gracePeriod=120 Apr 17 10:19:53.832966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832893 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="config-reloader" containerID="cri-o://98767e08bf62a6d1af5cbea37a24930230843ec2a456a882a07db55a688fb3b7" gracePeriod=120 Apr 17 10:19:53.832966 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:53.832830 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="prom-label-proxy" containerID="cri-o://98174a3d0a9f9b5b4cf4858ef4cb9584460ca21ebb311f19ff041938f107b4e7" gracePeriod=120 Apr 17 10:19:54.026538 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026511 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="98174a3d0a9f9b5b4cf4858ef4cb9584460ca21ebb311f19ff041938f107b4e7" exitCode=0 Apr 17 10:19:54.026538 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026536 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="ceeac911de744a2240d37a4c4370d4209ed32429683293b14fbaadd801b4a52d" exitCode=0 Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026544 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="9139e2f9cd9db6f178ac27cbc3d540b21d684ef22f0e830d3bd0079653ad76f1" exitCode=0 Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026550 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="98767e08bf62a6d1af5cbea37a24930230843ec2a456a882a07db55a688fb3b7" exitCode=0 Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026555 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="ab01d52496e33255686ea12645f5bf43b8da9b5d6d82c36afabe488bf0a7cabd" exitCode=0 Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026578 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"98174a3d0a9f9b5b4cf4858ef4cb9584460ca21ebb311f19ff041938f107b4e7"} Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026610 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"ceeac911de744a2240d37a4c4370d4209ed32429683293b14fbaadd801b4a52d"} Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026620 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"9139e2f9cd9db6f178ac27cbc3d540b21d684ef22f0e830d3bd0079653ad76f1"} Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026628 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"98767e08bf62a6d1af5cbea37a24930230843ec2a456a882a07db55a688fb3b7"} Apr 17 10:19:54.026682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:54.026636 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"ab01d52496e33255686ea12645f5bf43b8da9b5d6d82c36afabe488bf0a7cabd"} Apr 17 10:19:55.032588 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.032560 2573 generic.go:358] "Generic (PLEG): container finished" podID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerID="7eb010257b91841caf4750a43a4a8da4737fc3d7278dfabb2206c34bca2dac25" exitCode=0 Apr 17 10:19:55.032916 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.032632 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"7eb010257b91841caf4750a43a4a8da4737fc3d7278dfabb2206c34bca2dac25"} Apr 17 10:19:55.068485 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.068464 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:19:55.233019 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.232947 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233019 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.232979 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233019 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233000 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233019 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233018 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75cnp\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233043 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233161 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233225 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233260 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233301 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233335 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233361 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233404 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:55.233580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233424 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233580 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233455 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web\") pod \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\" (UID: \"23ee9e63-43fc-410a-94c7-89eac7cf0d09\") " Apr 17 10:19:55.233855 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233758 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-metrics-client-ca\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.233913 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.233866 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:55.234805 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.234777 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 10:19:55.236176 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236145 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:55.236277 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236232 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp" (OuterVolumeSpecName: "kube-api-access-75cnp") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "kube-api-access-75cnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:55.236340 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236318 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out" (OuterVolumeSpecName: "config-out") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 10:19:55.236578 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236540 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.236921 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236888 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.237025 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.236911 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.237434 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.237411 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume" (OuterVolumeSpecName: "config-volume") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.237527 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.237498 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.240554 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.240526 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.246865 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.246840 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config" (OuterVolumeSpecName: "web-config") pod "23ee9e63-43fc-410a-94c7-89eac7cf0d09" (UID: "23ee9e63-43fc-410a-94c7-89eac7cf0d09"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:55.334511 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334481 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-cluster-tls-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334511 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334513 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334523 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-main-tls\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334533 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-web-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334541 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-alertmanager-main-db\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334551 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334560 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-volume\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334568 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334576 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23ee9e63-43fc-410a-94c7-89eac7cf0d09-config-out\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334585 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23ee9e63-43fc-410a-94c7-89eac7cf0d09-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334593 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-tls-assets\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:55.334627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:55.334601 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75cnp\" (UniqueName: \"kubernetes.io/projected/23ee9e63-43fc-410a-94c7-89eac7cf0d09-kube-api-access-75cnp\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:56.038351 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.038315 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"23ee9e63-43fc-410a-94c7-89eac7cf0d09","Type":"ContainerDied","Data":"e15841e84ebe6194190b9b14f9bc19d73c9f3742684f7fbaa75d119d8e1f8b49"} Apr 17 10:19:56.038775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.038362 2573 scope.go:117] "RemoveContainer" containerID="98174a3d0a9f9b5b4cf4858ef4cb9584460ca21ebb311f19ff041938f107b4e7" Apr 17 10:19:56.038775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.038413 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 10:19:56.045903 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.045880 2573 scope.go:117] "RemoveContainer" containerID="ceeac911de744a2240d37a4c4370d4209ed32429683293b14fbaadd801b4a52d" Apr 17 10:19:56.052497 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.052481 2573 scope.go:117] "RemoveContainer" containerID="9139e2f9cd9db6f178ac27cbc3d540b21d684ef22f0e830d3bd0079653ad76f1" Apr 17 10:19:56.058502 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.058486 2573 scope.go:117] "RemoveContainer" containerID="7eb010257b91841caf4750a43a4a8da4737fc3d7278dfabb2206c34bca2dac25" Apr 17 10:19:56.062557 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.062537 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:19:56.068360 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.068264 2573 scope.go:117] "RemoveContainer" containerID="98767e08bf62a6d1af5cbea37a24930230843ec2a456a882a07db55a688fb3b7" Apr 17 10:19:56.068963 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.068943 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 10:19:56.075176 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.075160 2573 scope.go:117] "RemoveContainer" containerID="ab01d52496e33255686ea12645f5bf43b8da9b5d6d82c36afabe488bf0a7cabd" Apr 17 10:19:56.081345 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.081322 2573 scope.go:117] "RemoveContainer" containerID="99fe34ec654e86e3943cdce58b03049bde3d08728228f8f651d7f430ba9b7ff3" Apr 17 10:19:56.477906 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:56.477872 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" path="/var/lib/kubelet/pods/23ee9e63-43fc-410a-94c7-89eac7cf0d09/volumes" Apr 17 10:19:58.049946 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.049916 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:58.050466 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050408 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="prometheus" containerID="cri-o://5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" gracePeriod=600 Apr 17 10:19:58.050597 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050454 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="thanos-sidecar" containerID="cri-o://3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" gracePeriod=600 Apr 17 10:19:58.050597 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050485 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" gracePeriod=600 Apr 17 10:19:58.050597 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050540 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="config-reloader" containerID="cri-o://3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" gracePeriod=600 Apr 17 10:19:58.050597 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050502 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-web" containerID="cri-o://39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" gracePeriod=600 Apr 17 10:19:58.050859 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.050425 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy" containerID="cri-o://b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" gracePeriod=600 Apr 17 10:19:58.307371 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.306839 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:58.362174 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362140 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362194 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362239 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362265 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl8tm\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362336 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362291 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362546 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362474 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362546 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362527 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362560 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362587 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362648 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362612 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362656 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362688 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362712 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362771 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362768 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362803 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.362827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362828 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.363153 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362858 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.363153 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.362889 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config\") pod \"20958221-7cb0-4d05-8cd2-da81af7101cf\" (UID: \"20958221-7cb0-4d05-8cd2-da81af7101cf\") " Apr 17 10:19:58.363153 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.363054 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:58.363305 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.363187 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.363305 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.363207 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.367784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.364171 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:58.367784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.364236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:58.367784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.365128 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 10:19:58.367784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.365531 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm" (OuterVolumeSpecName: "kube-api-access-bl8tm") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "kube-api-access-bl8tm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:58.367784 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.366211 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.368117 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.367896 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:19:58.368964 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.368936 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.369073 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369003 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.369138 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369088 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.369443 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369416 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out" (OuterVolumeSpecName: "config-out") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 10:19:58.369889 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369707 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.369986 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369922 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.369986 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.369942 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.370214 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.370184 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config" (OuterVolumeSpecName: "config") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.370622 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.370604 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:19:58.378415 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.378393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config" (OuterVolumeSpecName: "web-config") pod "20958221-7cb0-4d05-8cd2-da81af7101cf" (UID: "20958221-7cb0-4d05-8cd2-da81af7101cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:19:58.463942 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463919 2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-metrics-client-certs\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.463942 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463942 2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-grpc-tls\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463951 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl8tm\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-kube-api-access-bl8tm\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463960 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463969 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-config-out\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463979 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463988 2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/20958221-7cb0-4d05-8cd2-da81af7101cf-prometheus-k8s-db\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.463997 2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464005 2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20958221-7cb0-4d05-8cd2-da81af7101cf-configmap-metrics-client-ca\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464014 2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464022 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464032 2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-kube-rbac-proxy\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464040 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/20958221-7cb0-4d05-8cd2-da81af7101cf-tls-assets\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464048 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464057 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-web-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:58.464064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:58.464065 2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/20958221-7cb0-4d05-8cd2-da81af7101cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:19:59.051796 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051762 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" exitCode=0 Apr 17 10:19:59.051796 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051790 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" exitCode=0 Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051812 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" exitCode=0 Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051824 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" exitCode=0 Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051834 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" exitCode=0 Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051845 2573 generic.go:358] "Generic (PLEG): container finished" podID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" exitCode=0 Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051856 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051858 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051903 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051916 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051925 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051935 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051944 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051956 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"20958221-7cb0-4d05-8cd2-da81af7101cf","Type":"ContainerDied","Data":"53cbe6e5163157528bed0696533f1a18bba833a83e2f2f516d95cb9a453d9cb6"} Apr 17 10:19:59.052258 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.051970 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.059303 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.059287 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.065739 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.065710 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.072956 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.072935 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:59.077660 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.077642 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:59.079861 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.079835 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.085909 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.085886 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.091870 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.091780 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.097986 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.097964 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.101008 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.100987 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101348 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-metric" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101365 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-metric" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101374 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="config-reloader" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101381 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="config-reloader" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101387 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" containerName="console" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101393 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" containerName="console" Apr 17 10:19:59.101363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101398 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="prom-label-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101405 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="prom-label-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101417 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101424 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101435 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d38d4d-200e-4ac5-a316-c90c917947f6" containerName="console" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101440 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d38d4d-200e-4ac5-a316-c90c917947f6" containerName="console" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101447 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="alertmanager" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101452 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="alertmanager" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101460 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101466 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101473 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="prometheus" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101478 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="prometheus" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101489 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101496 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101504 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-thanos" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101520 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-thanos" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101532 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="init-config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101540 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="init-config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101547 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="init-config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101552 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="init-config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101560 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="thanos-sidecar" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101568 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="thanos-sidecar" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101581 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101590 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101601 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101609 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101674 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="prom-label-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101686 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="87d38d4d-200e-4ac5-a316-c90c917947f6" containerName="console" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101694 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101700 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="thanos-sidecar" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101706 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101712 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy-metric" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101718 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-thanos" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101740 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="prometheus" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101751 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="90b07f99-96fe-4e17-91fb-3f8b1c9d8733" containerName="console" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101757 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="config-reloader" Apr 17 10:19:59.101775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101763 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="kube-rbac-proxy-web" Apr 17 10:19:59.103211 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101770 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="alertmanager" Apr 17 10:19:59.103211 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101775 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="23ee9e63-43fc-410a-94c7-89eac7cf0d09" containerName="kube-rbac-proxy" Apr 17 10:19:59.103211 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.101782 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" containerName="config-reloader" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.104645 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.104927 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.104955 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.104977 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.105176 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105199 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105217 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.105393 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105414 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105430 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.105630 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105651 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.105934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.105668 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.106071 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106098 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106118 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.106380 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106399 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.106459 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106413 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.106758 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:19:59.106640 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.106758 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106660 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.106758 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106671 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.106924 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106901 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.106964 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.106926 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.107117 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107101 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.107117 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107117 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.107319 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107301 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.107355 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107321 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.107537 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107520 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.107581 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107537 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.107749 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107713 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.107749 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107745 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.107959 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107939 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.108004 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.107959 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.108152 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108137 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.108190 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108152 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.108334 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108316 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.108385 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108333 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.108584 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108557 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.108682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108603 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.108828 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108809 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.108942 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108906 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.108942 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.108938 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.109307 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109216 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.109307 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109245 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.109676 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109655 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.109676 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109676 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.109926 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109903 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.109993 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.109928 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.110170 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110150 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.110216 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110172 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.110380 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110364 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.110441 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110384 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.110619 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110599 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.110661 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110620 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.110849 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110832 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.110921 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.110851 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.111070 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111052 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.111114 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111071 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.111273 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111258 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.111325 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111274 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.111496 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111478 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.111540 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111496 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.111740 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111704 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.111793 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111750 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 10:19:59.111838 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111751 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.111976 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.111958 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 10:19:59.112055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112030 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 10:19:59.112116 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112057 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.112116 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112079 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.112116 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112107 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 10:19:59.112252 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112126 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 10:19:59.112299 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112253 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 10:19:59.112299 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112253 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ejs2k26m14hm\"" Apr 17 10:19:59.112399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112320 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.112399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112345 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.112496 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112400 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 10:19:59.112496 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112407 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 10:19:59.112496 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112401 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n694v\"" Apr 17 10:19:59.112766 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112625 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 10:19:59.112766 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112647 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 10:19:59.112766 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112646 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.112766 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112668 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.113157 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112903 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 10:19:59.113157 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112929 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.113157 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.112954 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.113318 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113205 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.113318 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113224 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.113490 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113473 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.113555 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113492 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.113773 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113746 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.113861 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.113775 2573 scope.go:117] "RemoveContainer" containerID="5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa" Apr 17 10:19:59.114038 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.114019 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa"} err="failed to get container status \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": rpc error: code = NotFound desc = could not find container \"5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa\": container with ID starting with 5d4279d40213124a045e4a4000a20f82b45f7631fc84f1345daea833891933fa not found: ID does not exist" Apr 17 10:19:59.114129 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.114039 2573 scope.go:117] "RemoveContainer" containerID="b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be" Apr 17 10:19:59.114565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.114523 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be"} err="failed to get container status \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": rpc error: code = NotFound desc = could not find container \"b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be\": container with ID starting with b1041a7b1f394d0443818d1244dfb965a608a9ec2e27d67050468e0f7d55b4be not found: ID does not exist" Apr 17 10:19:59.114565 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.114549 2573 scope.go:117] "RemoveContainer" containerID="39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175" Apr 17 10:19:59.114974 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.114951 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 10:19:59.115627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.115395 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175"} err="failed to get container status \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": rpc error: code = NotFound desc = could not find container \"39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175\": container with ID starting with 39fa75d5489172e0bc7391156df3c71c0026f081dd7ba01545e5e3b6ed985175 not found: ID does not exist" Apr 17 10:19:59.115627 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.115420 2573 scope.go:117] "RemoveContainer" containerID="3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce" Apr 17 10:19:59.115908 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.115870 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce"} err="failed to get container status \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": rpc error: code = NotFound desc = could not find container \"3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce\": container with ID starting with 3344b5e344c0c503726e4feee5baf557ecaba7aa06814a02af7c0cb9010bd8ce not found: ID does not exist" Apr 17 10:19:59.115908 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.115897 2573 scope.go:117] "RemoveContainer" containerID="3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251" Apr 17 10:19:59.117817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.116438 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251"} err="failed to get container status \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": rpc error: code = NotFound desc = could not find container \"3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251\": container with ID starting with 3a99d3f6b6563afc700c5f2efe08839513d5a81e5316ee3ae67c804e85a99251 not found: ID does not exist" Apr 17 10:19:59.117817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.116464 2573 scope.go:117] "RemoveContainer" containerID="5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b" Apr 17 10:19:59.117817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.117605 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b"} err="failed to get container status \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": rpc error: code = NotFound desc = could not find container \"5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b\": container with ID starting with 5f2a46c8b86fcc488c117f25e493873d77dceb6be866da3f54ed0013a902252b not found: ID does not exist" Apr 17 10:19:59.117817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.117630 2573 scope.go:117] "RemoveContainer" containerID="7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd" Apr 17 10:19:59.117817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.117675 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:59.118263 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.118235 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd"} err="failed to get container status \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": rpc error: code = NotFound desc = could not find container \"7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd\": container with ID starting with 7b4d9503524b6a7b256db860f83384098cdac88a1980e7f2f8e010f129256edd not found: ID does not exist" Apr 17 10:19:59.118352 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.118343 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 10:19:59.169988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.169950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976gg\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-kube-api-access-976gg\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.169988 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.169990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170099 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170149 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170152 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170247 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170264 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170301 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170566 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170566 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.170566 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.170409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.270827 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.270802 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.270925 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.270832 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.270925 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.270852 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.270925 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.270880 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.271512 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271484 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-976gg\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-kube-api-access-976gg\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271546 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271588 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271777 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271821 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271860 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272596 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.271890 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272753 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.272817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272800 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272845 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272877 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272910 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273009 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.272949 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273188 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.273033 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.273878 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.273810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.274952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.274886 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-web-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.275478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/309f9b40-35b1-4408-a334-2700094721c4-config-out\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.275506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.276353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.277574 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.277825 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.278282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-config\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.278377 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.278639 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.279245 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280341 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.279572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.280928 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.280815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/309f9b40-35b1-4408-a334-2700094721c4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.281935 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.281478 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.282282 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.282260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/309f9b40-35b1-4408-a334-2700094721c4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.283550 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.283532 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-976gg\" (UniqueName: \"kubernetes.io/projected/309f9b40-35b1-4408-a334-2700094721c4-kube-api-access-976gg\") pod \"prometheus-k8s-0\" (UID: \"309f9b40-35b1-4408-a334-2700094721c4\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.421519 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.421487 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:19:59.547257 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:19:59.547226 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 10:19:59.550510 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:19:59.550483 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309f9b40_35b1_4408_a334_2700094721c4.slice/crio-3fd491e6c38e5795618e57289c4c654f9b4cb49ca7ddb33db2e44e1a61aa655a WatchSource:0}: Error finding container 3fd491e6c38e5795618e57289c4c654f9b4cb49ca7ddb33db2e44e1a61aa655a: Status 404 returned error can't find the container with id 3fd491e6c38e5795618e57289c4c654f9b4cb49ca7ddb33db2e44e1a61aa655a Apr 17 10:20:00.057004 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:00.056971 2573 generic.go:358] "Generic (PLEG): container finished" podID="309f9b40-35b1-4408-a334-2700094721c4" containerID="5c83bd210ea68b430b3b252bf12f52acdae265c935f5bc482187b2b62219908b" exitCode=0 Apr 17 10:20:00.057393 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:00.057055 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerDied","Data":"5c83bd210ea68b430b3b252bf12f52acdae265c935f5bc482187b2b62219908b"} Apr 17 10:20:00.057393 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:00.057093 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"3fd491e6c38e5795618e57289c4c654f9b4cb49ca7ddb33db2e44e1a61aa655a"} Apr 17 10:20:00.478529 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:00.478499 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20958221-7cb0-4d05-8cd2-da81af7101cf" path="/var/lib/kubelet/pods/20958221-7cb0-4d05-8cd2-da81af7101cf/volumes" Apr 17 10:20:01.063304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063264 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"e2340fcbe72c106b830e6e2b5ffd91b5636cfe258cf6c88e58112ed0ed766cc5"} Apr 17 10:20:01.063304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063301 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"3328a57c9297625d0c8da12494011236fc11c8127e07aa0826c04e22685d1a7c"} Apr 17 10:20:01.063304 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063310 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"c3fb1208c321bcf1ed7c34a7a3e8b783f58f927d69892d145199eb95744fbe3c"} Apr 17 10:20:01.063721 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063318 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"6d4d7957cf13d7e7781ce9aad3d6bf84d7992b31b2eb402db9d764466773f184"} Apr 17 10:20:01.063721 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063327 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"1ae416954cf1611375d14ef27d1ab5b19ed098b97f1dd534cbf265ab64f4c34c"} Apr 17 10:20:01.063721 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.063334 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"309f9b40-35b1-4408-a334-2700094721c4","Type":"ContainerStarted","Data":"daf5d5521892e6150153ce707a9a0d2740aa8cbf5af4c7b45f173555d9fba4a8"} Apr 17 10:20:01.089118 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:01.089073 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.0890555219999998 podStartE2EDuration="2.089055522s" podCreationTimestamp="2026-04-17 10:19:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:20:01.086309435 +0000 UTC m=+131.171096600" watchObservedRunningTime="2026-04-17 10:20:01.089055522 +0000 UTC m=+131.173842682" Apr 17 10:20:04.422233 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:04.422193 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:20:24.618428 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:24.618388 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:20:49.641178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.641073 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f86fc4fb7-xhcqx" podUID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" containerName="console" containerID="cri-o://9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8" gracePeriod=15 Apr 17 10:20:49.867609 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.867587 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f86fc4fb7-xhcqx_5f8c97c3-47dd-432d-a182-8fa77ef96a66/console/0.log" Apr 17 10:20:49.867745 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.867662 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:20:49.929835 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929776 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.929835 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929812 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.929835 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929833 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.930055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929852 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.930055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929895 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.930055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929914 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.930055 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.929980 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk\") pod \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\" (UID: \"5f8c97c3-47dd-432d-a182-8fa77ef96a66\") " Apr 17 10:20:49.930263 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.930208 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:20:49.930317 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.930281 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:20:49.930362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.930306 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config" (OuterVolumeSpecName: "console-config") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:20:49.930362 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.930310 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 10:20:49.931913 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.931883 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:20:49.932029 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.931984 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk" (OuterVolumeSpecName: "kube-api-access-7pvxk") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "kube-api-access-7pvxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:20:49.932029 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:49.931984 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f8c97c3-47dd-432d-a182-8fa77ef96a66" (UID: "5f8c97c3-47dd-432d-a182-8fa77ef96a66"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 10:20:50.030757 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030719 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-oauth-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030757 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030755 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-oauth-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030766 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-service-ca\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030774 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-config\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030783 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvxk\" (UniqueName: \"kubernetes.io/projected/5f8c97c3-47dd-432d-a182-8fa77ef96a66-kube-api-access-7pvxk\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030792 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f8c97c3-47dd-432d-a182-8fa77ef96a66-console-serving-cert\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.030888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.030800 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f8c97c3-47dd-432d-a182-8fa77ef96a66-trusted-ca-bundle\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:20:50.204711 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204655 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f86fc4fb7-xhcqx_5f8c97c3-47dd-432d-a182-8fa77ef96a66/console/0.log" Apr 17 10:20:50.204711 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204689 2573 generic.go:358] "Generic (PLEG): container finished" podID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" containerID="9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8" exitCode=2 Apr 17 10:20:50.204852 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204770 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f86fc4fb7-xhcqx" Apr 17 10:20:50.204852 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204778 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86fc4fb7-xhcqx" event={"ID":"5f8c97c3-47dd-432d-a182-8fa77ef96a66","Type":"ContainerDied","Data":"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8"} Apr 17 10:20:50.204852 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204820 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f86fc4fb7-xhcqx" event={"ID":"5f8c97c3-47dd-432d-a182-8fa77ef96a66","Type":"ContainerDied","Data":"30095a6e64a3a3b78ff412c08d9dd3bfa298217454697250940e703ad6d56747"} Apr 17 10:20:50.204852 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.204840 2573 scope.go:117] "RemoveContainer" containerID="9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8" Apr 17 10:20:50.212800 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.212777 2573 scope.go:117] "RemoveContainer" containerID="9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8" Apr 17 10:20:50.213056 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:20:50.213036 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8\": container with ID starting with 9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8 not found: ID does not exist" containerID="9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8" Apr 17 10:20:50.213120 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.213063 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8"} err="failed to get container status \"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8\": rpc error: code = NotFound desc = could not find container \"9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8\": container with ID starting with 9bb35ed4af2ef97f550a88f3c0adc1cdd94feba62b80d5854b1031586a78d8a8 not found: ID does not exist" Apr 17 10:20:50.225179 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.225156 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:20:50.227904 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.227887 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f86fc4fb7-xhcqx"] Apr 17 10:20:50.477533 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:50.477479 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" path="/var/lib/kubelet/pods/5f8c97c3-47dd-432d-a182-8fa77ef96a66/volumes" Apr 17 10:20:59.421899 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:59.421863 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:20:59.437299 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:20:59.437274 2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:21:00.246860 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:00.246833 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 10:21:31.047662 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.047627 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-bbt4d"] Apr 17 10:21:31.048131 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.047999 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" containerName="console" Apr 17 10:21:31.048131 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.048015 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" containerName="console" Apr 17 10:21:31.048131 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.048066 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f8c97c3-47dd-432d-a182-8fa77ef96a66" containerName="console" Apr 17 10:21:31.050809 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.050793 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.053302 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.053275 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Apr 17 10:21:31.053448 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.053323 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Apr 17 10:21:31.054035 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.054017 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nkv75\"" Apr 17 10:21:31.058243 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.058220 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-bbt4d"] Apr 17 10:21:31.227666 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.227627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbrs\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-kube-api-access-5jbrs\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.227831 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.227694 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.328775 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.328710 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.328879 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.328773 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbrs\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-kube-api-access-5jbrs\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.336811 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.336779 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.336926 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.336879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbrs\" (UniqueName: \"kubernetes.io/projected/80ac9a47-950c-4d6c-ae1e-1cb15cca4c99-kube-api-access-5jbrs\") pod \"cert-manager-cainjector-8966b78d4-bbt4d\" (UID: \"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.370682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.370657 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" Apr 17 10:21:31.487593 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:31.487560 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-bbt4d"] Apr 17 10:21:31.490540 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:21:31.490501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ac9a47_950c_4d6c_ae1e_1cb15cca4c99.slice/crio-4245106b07c8952fa927af11a61de0333cb2ca435357fd78a6dcef2f6e274d5d WatchSource:0}: Error finding container 4245106b07c8952fa927af11a61de0333cb2ca435357fd78a6dcef2f6e274d5d: Status 404 returned error can't find the container with id 4245106b07c8952fa927af11a61de0333cb2ca435357fd78a6dcef2f6e274d5d Apr 17 10:21:32.327845 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:32.327808 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" event={"ID":"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99","Type":"ContainerStarted","Data":"4245106b07c8952fa927af11a61de0333cb2ca435357fd78a6dcef2f6e274d5d"} Apr 17 10:21:36.342917 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:36.342882 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" event={"ID":"80ac9a47-950c-4d6c-ae1e-1cb15cca4c99","Type":"ContainerStarted","Data":"36b10c01e9487dc0c2aaf4cc595395fe7f09b9ae0197cfeddea609a311442622"} Apr 17 10:21:36.359533 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:21:36.359488 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-8966b78d4-bbt4d" podStartSLOduration=1.3899260230000001 podStartE2EDuration="5.359475336s" podCreationTimestamp="2026-04-17 10:21:31 +0000 UTC" firstStartedPulling="2026-04-17 10:21:31.492435242 +0000 UTC m=+221.577222375" lastFinishedPulling="2026-04-17 10:21:35.461984555 +0000 UTC m=+225.546771688" observedRunningTime="2026-04-17 10:21:36.358053659 +0000 UTC m=+226.442840815" watchObservedRunningTime="2026-04-17 10:21:36.359475336 +0000 UTC m=+226.444262489" Apr 17 10:22:29.135872 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.135792 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj"] Apr 17 10:22:29.139145 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.139125 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.142045 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.142024 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Apr 17 10:22:29.142148 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.142111 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Apr 17 10:22:29.142326 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.142311 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Apr 17 10:22:29.143064 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.143031 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-4gpgd\"" Apr 17 10:22:29.143215 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.143096 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Apr 17 10:22:29.151877 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.151853 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj"] Apr 17 10:22:29.239059 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.239029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpg5\" (UniqueName: \"kubernetes.io/projected/241c2bc5-9487-41d7-8a20-bf867a7ee906-kube-api-access-hvpg5\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.239207 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.239083 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/241c2bc5-9487-41d7-8a20-bf867a7ee906-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.239207 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.239103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/241c2bc5-9487-41d7-8a20-bf867a7ee906-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.339975 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.339941 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpg5\" (UniqueName: \"kubernetes.io/projected/241c2bc5-9487-41d7-8a20-bf867a7ee906-kube-api-access-hvpg5\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.340128 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.339992 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/241c2bc5-9487-41d7-8a20-bf867a7ee906-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.340128 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.340008 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/241c2bc5-9487-41d7-8a20-bf867a7ee906-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.340616 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.340594 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/241c2bc5-9487-41d7-8a20-bf867a7ee906-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.342328 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.342305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/241c2bc5-9487-41d7-8a20-bf867a7ee906-cert\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.348568 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.348546 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpg5\" (UniqueName: \"kubernetes.io/projected/241c2bc5-9487-41d7-8a20-bf867a7ee906-kube-api-access-hvpg5\") pod \"kubeflow-trainer-controller-manager-55f5694779-k6qjj\" (UID: \"241c2bc5-9487-41d7-8a20-bf867a7ee906\") " pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.447979 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.447953 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:29.563038 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:29.563010 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj"] Apr 17 10:22:29.566014 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:22:29.565988 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod241c2bc5_9487_41d7_8a20_bf867a7ee906.slice/crio-fb5261117d18a8616f88f869afb7bd2bc40b3043589825369785a2c8ba9adff5 WatchSource:0}: Error finding container fb5261117d18a8616f88f869afb7bd2bc40b3043589825369785a2c8ba9adff5: Status 404 returned error can't find the container with id fb5261117d18a8616f88f869afb7bd2bc40b3043589825369785a2c8ba9adff5 Apr 17 10:22:30.488822 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:30.488793 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" event={"ID":"241c2bc5-9487-41d7-8a20-bf867a7ee906","Type":"ContainerStarted","Data":"fb5261117d18a8616f88f869afb7bd2bc40b3043589825369785a2c8ba9adff5"} Apr 17 10:22:32.495817 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:32.495782 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" event={"ID":"241c2bc5-9487-41d7-8a20-bf867a7ee906","Type":"ContainerStarted","Data":"5ad22eaf47eef243a2454da2938763a35d24575d3b8b984702e8bbfed454185c"} Apr 17 10:22:32.496271 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:32.495881 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:32.513135 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:32.513092 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" podStartSLOduration=1.365205475 podStartE2EDuration="3.513080219s" podCreationTimestamp="2026-04-17 10:22:29 +0000 UTC" firstStartedPulling="2026-04-17 10:22:29.567799719 +0000 UTC m=+279.652586851" lastFinishedPulling="2026-04-17 10:22:31.715674461 +0000 UTC m=+281.800461595" observedRunningTime="2026-04-17 10:22:32.511610203 +0000 UTC m=+282.596397358" watchObservedRunningTime="2026-04-17 10:22:32.513080219 +0000 UTC m=+282.597867374" Apr 17 10:22:48.504174 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:48.504138 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-55f5694779-k6qjj" Apr 17 10:22:50.377964 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:22:50.377929 2573 kubelet.go:1628] "Image garbage collection succeeded" Apr 17 10:34:01.064926 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.064891 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl"] Apr 17 10:34:01.067692 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.067676 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:34:01.070006 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.069985 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4zv69\"/\"kube-root-ca.crt\"" Apr 17 10:34:01.070138 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.070010 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-4zv69\"/\"openshift-service-ca.crt\"" Apr 17 10:34:01.070897 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.070882 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-4zv69\"/\"default-dockercfg-nm99d\"" Apr 17 10:34:01.077765 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.077717 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl"] Apr 17 10:34:01.187881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.187856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw2dl\" (UniqueName: \"kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl\") pod \"test-trainjob-6jc8l-node-0-0-bkkpl\" (UID: \"4eddb9e3-6a63-40ab-b678-1d351f04d4ff\") " pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:34:01.288952 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.288917 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw2dl\" (UniqueName: \"kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl\") pod \"test-trainjob-6jc8l-node-0-0-bkkpl\" (UID: \"4eddb9e3-6a63-40ab-b678-1d351f04d4ff\") " pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:34:01.296363 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.296338 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw2dl\" (UniqueName: \"kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl\") pod \"test-trainjob-6jc8l-node-0-0-bkkpl\" (UID: \"4eddb9e3-6a63-40ab-b678-1d351f04d4ff\") " pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:34:01.376973 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.376905 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:34:01.494955 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.494904 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl"] Apr 17 10:34:01.497062 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:34:01.497034 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eddb9e3_6a63_40ab_b678_1d351f04d4ff.slice/crio-099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045 WatchSource:0}: Error finding container 099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045: Status 404 returned error can't find the container with id 099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045 Apr 17 10:34:01.498983 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:01.498965 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 10:34:02.409489 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:34:02.409430 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" event={"ID":"4eddb9e3-6a63-40ab-b678-1d351f04d4ff","Type":"ContainerStarted","Data":"099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045"} Apr 17 10:38:14.183157 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:14.183125 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" event={"ID":"4eddb9e3-6a63-40ab-b678-1d351f04d4ff","Type":"ContainerStarted","Data":"90c7c457e8632220aeb75a34f2b9a8695403b115c8cedbe87f5bfd630cbc1873"} Apr 17 10:38:14.206225 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:14.206179 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" podStartSLOduration=1.035535092 podStartE2EDuration="4m13.206165742s" podCreationTimestamp="2026-04-17 10:34:01 +0000 UTC" firstStartedPulling="2026-04-17 10:34:01.499119376 +0000 UTC m=+971.583906512" lastFinishedPulling="2026-04-17 10:38:13.669750026 +0000 UTC m=+1223.754537162" observedRunningTime="2026-04-17 10:38:14.204510992 +0000 UTC m=+1224.289298165" watchObservedRunningTime="2026-04-17 10:38:14.206165742 +0000 UTC m=+1224.290952896" Apr 17 10:38:21.204601 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:21.204569 2573 generic.go:358] "Generic (PLEG): container finished" podID="4eddb9e3-6a63-40ab-b678-1d351f04d4ff" containerID="90c7c457e8632220aeb75a34f2b9a8695403b115c8cedbe87f5bfd630cbc1873" exitCode=0 Apr 17 10:38:21.205002 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:21.204633 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" event={"ID":"4eddb9e3-6a63-40ab-b678-1d351f04d4ff","Type":"ContainerDied","Data":"90c7c457e8632220aeb75a34f2b9a8695403b115c8cedbe87f5bfd630cbc1873"} Apr 17 10:38:22.538399 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:22.538375 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:38:22.658646 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:22.658621 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw2dl\" (UniqueName: \"kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl\") pod \"4eddb9e3-6a63-40ab-b678-1d351f04d4ff\" (UID: \"4eddb9e3-6a63-40ab-b678-1d351f04d4ff\") " Apr 17 10:38:22.660668 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:22.660636 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl" (OuterVolumeSpecName: "kube-api-access-qw2dl") pod "4eddb9e3-6a63-40ab-b678-1d351f04d4ff" (UID: "4eddb9e3-6a63-40ab-b678-1d351f04d4ff"). InnerVolumeSpecName "kube-api-access-qw2dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:38:22.759349 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:22.759295 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw2dl\" (UniqueName: \"kubernetes.io/projected/4eddb9e3-6a63-40ab-b678-1d351f04d4ff-kube-api-access-qw2dl\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:38:23.211764 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:23.211715 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" event={"ID":"4eddb9e3-6a63-40ab-b678-1d351f04d4ff","Type":"ContainerDied","Data":"099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045"} Apr 17 10:38:23.211764 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:23.211763 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="099ffb50583ac3252100f777de7e66ece9037b5915505b149bef91684396b045" Apr 17 10:38:23.211944 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:23.211769 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl" Apr 17 10:38:24.328312 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.328278 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677"] Apr 17 10:38:24.328682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.328564 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eddb9e3-6a63-40ab-b678-1d351f04d4ff" containerName="node" Apr 17 10:38:24.328682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.328576 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eddb9e3-6a63-40ab-b678-1d351f04d4ff" containerName="node" Apr 17 10:38:24.328682 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.328629 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="4eddb9e3-6a63-40ab-b678-1d351f04d4ff" containerName="node" Apr 17 10:38:24.451388 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.451362 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677"] Apr 17 10:38:24.451522 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.451460 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:38:24.453909 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.453883 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-l6xgt\"/\"openshift-service-ca.crt\"" Apr 17 10:38:24.454056 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.453923 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-l6xgt\"/\"kube-root-ca.crt\"" Apr 17 10:38:24.454738 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.454708 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-l6xgt\"/\"default-dockercfg-l4sbf\"" Apr 17 10:38:24.575344 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.575317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dj8f\" (UniqueName: \"kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f\") pod \"test-trainjob-c6jcg-node-0-0-fj677\" (UID: \"36b4b5c6-5fae-4842-9c18-f8dd28143e3e\") " pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:38:24.676099 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.676075 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dj8f\" (UniqueName: \"kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f\") pod \"test-trainjob-c6jcg-node-0-0-fj677\" (UID: \"36b4b5c6-5fae-4842-9c18-f8dd28143e3e\") " pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:38:24.682881 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.682860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dj8f\" (UniqueName: \"kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f\") pod \"test-trainjob-c6jcg-node-0-0-fj677\" (UID: \"36b4b5c6-5fae-4842-9c18-f8dd28143e3e\") " pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:38:24.761178 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.761153 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:38:24.875262 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:24.875230 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677"] Apr 17 10:38:24.878859 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:38:24.878833 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36b4b5c6_5fae_4842_9c18_f8dd28143e3e.slice/crio-d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7 WatchSource:0}: Error finding container d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7: Status 404 returned error can't find the container with id d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7 Apr 17 10:38:25.217949 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:38:25.217921 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" event={"ID":"36b4b5c6-5fae-4842-9c18-f8dd28143e3e","Type":"ContainerStarted","Data":"d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7"} Apr 17 10:39:39.463810 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:39.463774 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" event={"ID":"36b4b5c6-5fae-4842-9c18-f8dd28143e3e","Type":"ContainerStarted","Data":"8fb4f89e5c26fa46b9ff17e80f5342b1a15d8c5cce74c82e2100940134532a01"} Apr 17 10:39:39.478148 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:39.478089 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" podStartSLOduration=1.8112849720000002 podStartE2EDuration="1m15.478075647s" podCreationTimestamp="2026-04-17 10:38:24 +0000 UTC" firstStartedPulling="2026-04-17 10:38:24.880685298 +0000 UTC m=+1234.965472434" lastFinishedPulling="2026-04-17 10:39:38.547475974 +0000 UTC m=+1308.632263109" observedRunningTime="2026-04-17 10:39:39.477047995 +0000 UTC m=+1309.561835149" watchObservedRunningTime="2026-04-17 10:39:39.478075647 +0000 UTC m=+1309.562862801" Apr 17 10:39:41.471144 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:41.471110 2573 generic.go:358] "Generic (PLEG): container finished" podID="36b4b5c6-5fae-4842-9c18-f8dd28143e3e" containerID="8fb4f89e5c26fa46b9ff17e80f5342b1a15d8c5cce74c82e2100940134532a01" exitCode=0 Apr 17 10:39:41.471481 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:41.471169 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" event={"ID":"36b4b5c6-5fae-4842-9c18-f8dd28143e3e","Type":"ContainerDied","Data":"8fb4f89e5c26fa46b9ff17e80f5342b1a15d8c5cce74c82e2100940134532a01"} Apr 17 10:39:42.631408 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:42.631388 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:39:42.741015 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:42.740954 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dj8f\" (UniqueName: \"kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f\") pod \"36b4b5c6-5fae-4842-9c18-f8dd28143e3e\" (UID: \"36b4b5c6-5fae-4842-9c18-f8dd28143e3e\") " Apr 17 10:39:42.742999 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:42.742971 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f" (OuterVolumeSpecName: "kube-api-access-8dj8f") pod "36b4b5c6-5fae-4842-9c18-f8dd28143e3e" (UID: "36b4b5c6-5fae-4842-9c18-f8dd28143e3e"). InnerVolumeSpecName "kube-api-access-8dj8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:39:42.841801 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:42.841775 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dj8f\" (UniqueName: \"kubernetes.io/projected/36b4b5c6-5fae-4842-9c18-f8dd28143e3e-kube-api-access-8dj8f\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:39:43.479147 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:43.479107 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" event={"ID":"36b4b5c6-5fae-4842-9c18-f8dd28143e3e","Type":"ContainerDied","Data":"d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7"} Apr 17 10:39:43.479147 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:43.479146 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5fde909f845bbac93b4d6e61df9456e86a93ed22d773f6c462af704b064e6e7" Apr 17 10:39:43.479147 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:39:43.479125 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677" Apr 17 10:46:33.782032 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.781956 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws"] Apr 17 10:46:33.784324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.782300 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b4b5c6-5fae-4842-9c18-f8dd28143e3e" containerName="node" Apr 17 10:46:33.784324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.782314 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b4b5c6-5fae-4842-9c18-f8dd28143e3e" containerName="node" Apr 17 10:46:33.784324 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.782363 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="36b4b5c6-5fae-4842-9c18-f8dd28143e3e" containerName="node" Apr 17 10:46:33.785226 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.785210 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:46:33.787349 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.787321 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-njm8z\"/\"default-dockercfg-9k884\"" Apr 17 10:46:33.787469 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.787356 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-njm8z\"/\"kube-root-ca.crt\"" Apr 17 10:46:33.787469 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.787361 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-njm8z\"/\"openshift-service-ca.crt\"" Apr 17 10:46:33.793046 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.793022 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws"] Apr 17 10:46:33.942670 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:33.942630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrjl\" (UniqueName: \"kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl\") pod \"test-trainjob-lpm72-node-0-0-dwqws\" (UID: \"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b\") " pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:46:34.043078 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.042995 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrjl\" (UniqueName: \"kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl\") pod \"test-trainjob-lpm72-node-0-0-dwqws\" (UID: \"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b\") " pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:46:34.050863 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.050839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrjl\" (UniqueName: \"kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl\") pod \"test-trainjob-lpm72-node-0-0-dwqws\" (UID: \"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b\") " pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:46:34.094501 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.094480 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:46:34.210722 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.210571 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws"] Apr 17 10:46:34.213527 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:46:34.213494 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0eb6329f_fef3_45fb_adb8_8d38a4f6c17b.slice/crio-f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5 WatchSource:0}: Error finding container f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5: Status 404 returned error can't find the container with id f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5 Apr 17 10:46:34.215764 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.215750 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 10:46:34.646743 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:46:34.646704 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" event={"ID":"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b","Type":"ContainerStarted","Data":"f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5"} Apr 17 10:53:39.469361 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:53:39.469271 2573 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" filter="nil" Apr 17 10:53:39.469361 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:53:39.469324 2573 kuberuntime_image.go:104] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 17 10:53:39.469361 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:53:39.469339 2573 image_gc_manager.go:230] "Failed to update image list" err="rpc error: code = DeadlineExceeded desc = context deadline exceeded" Apr 17 10:55:13.034213 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:55:13.034104 2573 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="nil" Apr 17 10:55:13.034213 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:55:13.034159 2573 kuberuntime_image.go:104] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:55:13.034213 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:55:13.034175 2573 image_gc_manager.go:222] "Failed to monitor images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:55:13.038741 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:55:13.038702 2573 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="nil" Apr 17 10:55:13.038848 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:55:13.038746 2573 kuberuntime_image.go:104] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:55:13.038848 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:55:13.038757 2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:56:09.470329 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:56:09.470289 2573 log.go:32] "ListImages with filter from image service failed" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" filter="nil" Apr 17 10:56:09.470329 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:56:09.470334 2573 kuberuntime_image.go:104] "Failed to list images" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:56:09.470867 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:09.470345 2573 image_gc_manager.go:230] "Failed to update image list" err="rpc error: code = DeadlineExceeded desc = stream terminated by RST_STREAM with error code: CANCEL" Apr 17 10:56:14.571349 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:14.571258 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" event={"ID":"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b","Type":"ContainerStarted","Data":"1f257997c68349b02158b50bb9cfb7e3300369c81530d129727e1cc3d8c9efa2"} Apr 17 10:56:14.573566 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:14.573548 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-njm8z\"/\"default-dockercfg-9k884\"" Apr 17 10:56:14.596397 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:14.596002 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" podStartSLOduration=1.532265147 podStartE2EDuration="9m41.595974216s" podCreationTimestamp="2026-04-17 10:46:33 +0000 UTC" firstStartedPulling="2026-04-17 10:46:34.215881128 +0000 UTC m=+1724.300668260" lastFinishedPulling="2026-04-17 10:56:14.279590197 +0000 UTC m=+2304.364377329" observedRunningTime="2026-04-17 10:56:14.594023003 +0000 UTC m=+2304.678810158" watchObservedRunningTime="2026-04-17 10:56:14.595974216 +0000 UTC m=+2304.680761371" Apr 17 10:56:14.720141 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:14.720104 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-njm8z\"/\"kube-root-ca.crt\"" Apr 17 10:56:14.730718 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:14.730683 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-njm8z\"/\"openshift-service-ca.crt\"" Apr 17 10:56:32.634934 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:32.634896 2573 generic.go:358] "Generic (PLEG): container finished" podID="0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" containerID="1f257997c68349b02158b50bb9cfb7e3300369c81530d129727e1cc3d8c9efa2" exitCode=0 Apr 17 10:56:32.635367 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:32.634976 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" event={"ID":"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b","Type":"ContainerDied","Data":"1f257997c68349b02158b50bb9cfb7e3300369c81530d129727e1cc3d8c9efa2"} Apr 17 10:56:33.765836 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:33.765809 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:56:33.856120 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:33.856089 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qrjl\" (UniqueName: \"kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl\") pod \"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b\" (UID: \"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b\") " Apr 17 10:56:33.858286 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:33.858257 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl" (OuterVolumeSpecName: "kube-api-access-4qrjl") pod "0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" (UID: "0eb6329f-fef3-45fb-adb8-8d38a4f6c17b"). InnerVolumeSpecName "kube-api-access-4qrjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:56:33.957487 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:33.957443 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qrjl\" (UniqueName: \"kubernetes.io/projected/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b-kube-api-access-4qrjl\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:56:34.642502 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:34.642468 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" event={"ID":"0eb6329f-fef3-45fb-adb8-8d38a4f6c17b","Type":"ContainerDied","Data":"f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5"} Apr 17 10:56:34.642502 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:34.642506 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0af9440294ead520622408098284dd73058035f1ff5cf3ccfd6587c906975c5" Apr 17 10:56:34.642707 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:34.642477 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws" Apr 17 10:56:35.599794 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:35.599764 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-njm8z_test-trainjob-lpm72-node-0-0-dwqws_0eb6329f-fef3-45fb-adb8-8d38a4f6c17b/node/0.log" Apr 17 10:56:35.790933 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:35.790905 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-l6xgt_test-trainjob-c6jcg-node-0-0-fj677_36b4b5c6-5fae-4842-9c18-f8dd28143e3e/node/0.log" Apr 17 10:56:35.890986 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:35.890965 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-4zv69_test-trainjob-6jc8l-node-0-0-bkkpl_4eddb9e3-6a63-40ab-b678-1d351f04d4ff/node/0.log" Apr 17 10:56:40.628563 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:40.628476 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws"] Apr 17 10:56:40.632069 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:40.632025 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-njm8z/test-trainjob-lpm72-node-0-0-dwqws"] Apr 17 10:56:40.828321 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:40.828282 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677"] Apr 17 10:56:40.831548 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:40.831517 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-l6xgt/test-trainjob-c6jcg-node-0-0-fj677"] Apr 17 10:56:41.099038 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:41.099000 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl"] Apr 17 10:56:41.100884 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:41.100859 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-4zv69/test-trainjob-6jc8l-node-0-0-bkkpl"] Apr 17 10:56:42.482283 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:42.482239 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" path="/var/lib/kubelet/pods/0eb6329f-fef3-45fb-adb8-8d38a4f6c17b/volumes" Apr 17 10:56:42.482802 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:42.482709 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b4b5c6-5fae-4842-9c18-f8dd28143e3e" path="/var/lib/kubelet/pods/36b4b5c6-5fae-4842-9c18-f8dd28143e3e/volumes" Apr 17 10:56:42.483095 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:42.483076 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eddb9e3-6a63-40ab-b678-1d351f04d4ff" path="/var/lib/kubelet/pods/4eddb9e3-6a63-40ab-b678-1d351f04d4ff/volumes" Apr 17 10:56:50.540415 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:50.540380 2573 scope.go:117] "RemoveContainer" containerID="8fb4f89e5c26fa46b9ff17e80f5342b1a15d8c5cce74c82e2100940134532a01" Apr 17 10:56:50.562347 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:56:50.562324 2573 scope.go:117] "RemoveContainer" containerID="90c7c457e8632220aeb75a34f2b9a8695403b115c8cedbe87f5bfd630cbc1873" Apr 17 10:58:24.568107 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.568023 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9"] Apr 17 10:58:24.568571 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.568374 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" containerName="node" Apr 17 10:58:24.568571 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.568388 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" containerName="node" Apr 17 10:58:24.568571 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.568442 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="0eb6329f-fef3-45fb-adb8-8d38a4f6c17b" containerName="node" Apr 17 10:58:24.571382 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.571366 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:24.573320 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.573299 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wshsg\"/\"openshift-service-ca.crt\"" Apr 17 10:58:24.574173 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.574153 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-wshsg\"/\"default-dockercfg-hm8vm\"" Apr 17 10:58:24.574275 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.574154 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-wshsg\"/\"kube-root-ca.crt\"" Apr 17 10:58:24.580469 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.580441 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9"] Apr 17 10:58:24.674743 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.674699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzm2f\" (UniqueName: \"kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:24.775991 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.775951 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzm2f\" (UniqueName: \"kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:24.784435 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:24.784399 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzm2f\" (UniqueName: \"kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:38.977027 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:38.976982 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:38.981259 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:38.981236 2573 operation_generator.go:1469] "Controller attach succeeded for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") device path: \"\"" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.077657 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.077619 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.077873 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.077778 2573 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") DevicePath \"\"" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.080595 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.080576 2573 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") DevicePath \"csi-40341b8d0e324f97fcc498b901c6bbc5ba4a855bc0db1ae87d2474032c2b1957\"" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.213876 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.213840 2573 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/784aa42007583401c6a26cbc39ac2e4f9cb93752e1936e677ecf942d0b754944/globalmount\"" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.235337 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.235252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"test-trainjob-jnd7b-node-0-0-ssss9\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.282578 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.282533 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:39.409532 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.409496 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9"] Apr 17 10:58:39.412708 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:58:39.412675 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9742d2_c601_405d_8734_362cc44ef916.slice/crio-1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a WatchSource:0}: Error finding container 1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a: Status 404 returned error can't find the container with id 1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a Apr 17 10:58:39.414650 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:39.414632 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 10:58:40.010581 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:40.010547 2573 generic.go:358] "Generic (PLEG): container finished" podID="4b9742d2-c601-405d-8734-362cc44ef916" containerID="96e73c441af1cebe28e80cc8e789c5b127d772f47b493f9d30fbc2c5fe49bda7" exitCode=0 Apr 17 10:58:40.011011 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:40.010634 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" event={"ID":"4b9742d2-c601-405d-8734-362cc44ef916","Type":"ContainerDied","Data":"96e73c441af1cebe28e80cc8e789c5b127d772f47b493f9d30fbc2c5fe49bda7"} Apr 17 10:58:40.011011 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:40.010670 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" event={"ID":"4b9742d2-c601-405d-8734-362cc44ef916","Type":"ContainerStarted","Data":"1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a"} Apr 17 10:58:41.129583 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.129563 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:41.194129 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.194094 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzm2f\" (UniqueName: \"kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f\") pod \"4b9742d2-c601-405d-8734-362cc44ef916\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " Apr 17 10:58:41.194316 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.194220 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workspace\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") pod \"4b9742d2-c601-405d-8734-362cc44ef916\" (UID: \"4b9742d2-c601-405d-8734-362cc44ef916\") " Apr 17 10:58:41.196368 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.196338 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f" (OuterVolumeSpecName: "kube-api-access-xzm2f") pod "4b9742d2-c601-405d-8734-362cc44ef916" (UID: "4b9742d2-c601-405d-8734-362cc44ef916"). InnerVolumeSpecName "kube-api-access-xzm2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:58:41.196885 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.196868 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78" (OuterVolumeSpecName: "workspace") pod "4b9742d2-c601-405d-8734-362cc44ef916" (UID: "4b9742d2-c601-405d-8734-362cc44ef916"). InnerVolumeSpecName "pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6". PluginName "kubernetes.io/csi", VolumeGIDValue "" Apr 17 10:58:41.295169 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.295092 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzm2f\" (UniqueName: \"kubernetes.io/projected/4b9742d2-c601-405d-8734-362cc44ef916-kube-api-access-xzm2f\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:58:41.295169 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.295146 2573 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") on node \"ip-10-0-137-54.ec2.internal\" " Apr 17 10:58:41.306385 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.306365 2573 operation_generator.go:895] UnmountDevice succeeded for volume "pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78") on node "ip-10-0-137-54.ec2.internal" Apr 17 10:58:41.396277 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:41.396239 2573 reconciler_common.go:299] "Volume detached for volume \"pvc-7e04d169-e7bc-4194-bb9b-85d31a86a8b6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0ed997194a4d9bb78\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"csi-40341b8d0e324f97fcc498b901c6bbc5ba4a855bc0db1ae87d2474032c2b1957\"" Apr 17 10:58:42.016983 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:42.016957 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" Apr 17 10:58:42.017151 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:42.016956 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9" event={"ID":"4b9742d2-c601-405d-8734-362cc44ef916","Type":"ContainerDied","Data":"1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a"} Apr 17 10:58:42.017151 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:42.017063 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1114fee96f2852ae4a2f422b5efc1366be37fbfd979e858a2037b1aa088a1b2a" Apr 17 10:58:42.563947 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:42.563920 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-wshsg_test-trainjob-jnd7b-node-0-0-ssss9_4b9742d2-c601-405d-8734-362cc44ef916/node/0.log" Apr 17 10:58:47.616358 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:47.616317 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9"] Apr 17 10:58:47.619148 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:47.619121 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-wshsg/test-trainjob-jnd7b-node-0-0-ssss9"] Apr 17 10:58:48.478250 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:48.478216 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9742d2-c601-405d-8734-362cc44ef916" path="/var/lib/kubelet/pods/4b9742d2-c601-405d-8734-362cc44ef916/volumes" Apr 17 10:58:54.758705 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.758660 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4hpc2/must-gather-qzv2m"] Apr 17 10:58:54.759126 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.758975 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9742d2-c601-405d-8734-362cc44ef916" containerName="node" Apr 17 10:58:54.759126 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.758987 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9742d2-c601-405d-8734-362cc44ef916" containerName="node" Apr 17 10:58:54.759126 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.759034 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b9742d2-c601-405d-8734-362cc44ef916" containerName="node" Apr 17 10:58:54.763365 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.763347 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.765654 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.765629 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4hpc2\"/\"kube-root-ca.crt\"" Apr 17 10:58:54.766812 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.766474 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4hpc2\"/\"default-dockercfg-5nd2x\"" Apr 17 10:58:54.766812 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.766546 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4hpc2\"/\"openshift-service-ca.crt\"" Apr 17 10:58:54.768323 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.768297 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4hpc2/must-gather-qzv2m"] Apr 17 10:58:54.804429 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.804395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.804589 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.804474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw8fl\" (UniqueName: \"kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.905041 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.904994 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.905217 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.905106 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lw8fl\" (UniqueName: \"kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.905400 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.905379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:54.912667 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:54.912644 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw8fl\" (UniqueName: \"kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl\") pod \"must-gather-qzv2m\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:55.073832 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:55.073719 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:58:55.193063 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:55.193033 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4hpc2/must-gather-qzv2m"] Apr 17 10:58:55.196106 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:58:55.196075 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93d3bc95_f1c0_4102_8210_5f0e21cb2447.slice/crio-d8eae7467e32faa13fd1d451e1f0cf75b4eba7652256e105d463d7e1486f85cf WatchSource:0}: Error finding container d8eae7467e32faa13fd1d451e1f0cf75b4eba7652256e105d463d7e1486f85cf: Status 404 returned error can't find the container with id d8eae7467e32faa13fd1d451e1f0cf75b4eba7652256e105d463d7e1486f85cf Apr 17 10:58:56.057783 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:58:56.057719 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" event={"ID":"93d3bc95-f1c0-4102-8210-5f0e21cb2447","Type":"ContainerStarted","Data":"d8eae7467e32faa13fd1d451e1f0cf75b4eba7652256e105d463d7e1486f85cf"} Apr 17 10:59:00.071295 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:00.071252 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" event={"ID":"93d3bc95-f1c0-4102-8210-5f0e21cb2447","Type":"ContainerStarted","Data":"dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5"} Apr 17 10:59:00.071295 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:00.071293 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" event={"ID":"93d3bc95-f1c0-4102-8210-5f0e21cb2447","Type":"ContainerStarted","Data":"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7"} Apr 17 10:59:00.085646 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:00.085592 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" podStartSLOduration=1.6815596400000001 podStartE2EDuration="6.085577649s" podCreationTimestamp="2026-04-17 10:58:54 +0000 UTC" firstStartedPulling="2026-04-17 10:58:55.197762988 +0000 UTC m=+2465.282550119" lastFinishedPulling="2026-04-17 10:58:59.601780994 +0000 UTC m=+2469.686568128" observedRunningTime="2026-04-17 10:59:00.084001044 +0000 UTC m=+2470.168788198" watchObservedRunningTime="2026-04-17 10:59:00.085577649 +0000 UTC m=+2470.170364802" Apr 17 10:59:09.360798 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:09.360763 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-k6qjj_241c2bc5-9487-41d7-8a20-bf867a7ee906/manager/0.log" Apr 17 10:59:09.797980 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:09.797947 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-k6qjj_241c2bc5-9487-41d7-8a20-bf867a7ee906/manager/0.log" Apr 17 10:59:10.231379 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:10.231347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-55f5694779-k6qjj_241c2bc5-9487-41d7-8a20-bf867a7ee906/manager/0.log" Apr 17 10:59:45.222189 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:45.222154 2573 generic.go:358] "Generic (PLEG): container finished" podID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerID="0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7" exitCode=0 Apr 17 10:59:45.222598 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:45.222217 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" event={"ID":"93d3bc95-f1c0-4102-8210-5f0e21cb2447","Type":"ContainerDied","Data":"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7"} Apr 17 10:59:45.222598 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:45.222551 2573 scope.go:117] "RemoveContainer" containerID="0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7" Apr 17 10:59:45.481209 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:45.481131 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4hpc2_must-gather-qzv2m_93d3bc95-f1c0-4102-8210-5f0e21cb2447/gather/0.log" Apr 17 10:59:48.614556 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:48.614524 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k8psk_dc016b5b-ead4-48ed-a13a-f0fdf34c3f88/global-pull-secret-syncer/0.log" Apr 17 10:59:48.724642 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:48.724609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wv4jf_0a56c223-6f9a-4c5a-8392-334fd6dc816a/konnectivity-agent/0.log" Apr 17 10:59:48.820564 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:48.820534 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-54.ec2.internal_1864926e2034b566e595c9007c5b736f/haproxy/0.log" Apr 17 10:59:50.831792 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:50.831723 2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-4hpc2/must-gather-qzv2m"] Apr 17 10:59:50.832438 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:50.832051 2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="copy" containerID="cri-o://dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5" gracePeriod=2 Apr 17 10:59:50.833868 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:50.833839 2573 status_manager.go:895] "Failed to get status for pod" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" err="pods \"must-gather-qzv2m\" is forbidden: User \"system:node:ip-10-0-137-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4hpc2\": no relationship found between node 'ip-10-0-137-54.ec2.internal' and this object" Apr 17 10:59:50.834154 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:50.834131 2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-4hpc2/must-gather-qzv2m"] Apr 17 10:59:51.064033 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.064007 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4hpc2_must-gather-qzv2m_93d3bc95-f1c0-4102-8210-5f0e21cb2447/copy/0.log" Apr 17 10:59:51.064419 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.064402 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:59:51.066215 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.066192 2573 status_manager.go:895] "Failed to get status for pod" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" err="pods \"must-gather-qzv2m\" is forbidden: User \"system:node:ip-10-0-137-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4hpc2\": no relationship found between node 'ip-10-0-137-54.ec2.internal' and this object" Apr 17 10:59:51.103554 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.103459 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw8fl\" (UniqueName: \"kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl\") pod \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " Apr 17 10:59:51.103554 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.103526 2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output\") pod \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\" (UID: \"93d3bc95-f1c0-4102-8210-5f0e21cb2447\") " Apr 17 10:59:51.105635 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.105612 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "93d3bc95-f1c0-4102-8210-5f0e21cb2447" (UID: "93d3bc95-f1c0-4102-8210-5f0e21cb2447"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 10:59:51.105716 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.105697 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl" (OuterVolumeSpecName: "kube-api-access-lw8fl") pod "93d3bc95-f1c0-4102-8210-5f0e21cb2447" (UID: "93d3bc95-f1c0-4102-8210-5f0e21cb2447"). InnerVolumeSpecName "kube-api-access-lw8fl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 10:59:51.204046 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.204019 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw8fl\" (UniqueName: \"kubernetes.io/projected/93d3bc95-f1c0-4102-8210-5f0e21cb2447-kube-api-access-lw8fl\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:59:51.204046 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.204044 2573 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/93d3bc95-f1c0-4102-8210-5f0e21cb2447-must-gather-output\") on node \"ip-10-0-137-54.ec2.internal\" DevicePath \"\"" Apr 17 10:59:51.240164 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.240139 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-4hpc2_must-gather-qzv2m_93d3bc95-f1c0-4102-8210-5f0e21cb2447/copy/0.log" Apr 17 10:59:51.240440 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.240420 2573 generic.go:358] "Generic (PLEG): container finished" podID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerID="dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5" exitCode=143 Apr 17 10:59:51.240499 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.240490 2573 scope.go:117] "RemoveContainer" containerID="dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5" Apr 17 10:59:51.240536 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.240522 2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" Apr 17 10:59:51.242622 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.242589 2573 status_manager.go:895] "Failed to get status for pod" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" err="pods \"must-gather-qzv2m\" is forbidden: User \"system:node:ip-10-0-137-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4hpc2\": no relationship found between node 'ip-10-0-137-54.ec2.internal' and this object" Apr 17 10:59:51.248548 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.248529 2573 scope.go:117] "RemoveContainer" containerID="0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7" Apr 17 10:59:51.250672 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.250650 2573 status_manager.go:895] "Failed to get status for pod" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" pod="openshift-must-gather-4hpc2/must-gather-qzv2m" err="pods \"must-gather-qzv2m\" is forbidden: User \"system:node:ip-10-0-137-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-4hpc2\": no relationship found between node 'ip-10-0-137-54.ec2.internal' and this object" Apr 17 10:59:51.259864 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.259845 2573 scope.go:117] "RemoveContainer" containerID="dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5" Apr 17 10:59:51.260120 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:59:51.260102 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5\": container with ID starting with dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5 not found: ID does not exist" containerID="dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5" Apr 17 10:59:51.260182 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.260136 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5"} err="failed to get container status \"dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5\": rpc error: code = NotFound desc = could not find container \"dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5\": container with ID starting with dc4c950d35c4d2e5b78fbf7bc5ef0fa6eb47d3033d07fcb9dda20ba6e2c28da5 not found: ID does not exist" Apr 17 10:59:51.260182 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.260162 2573 scope.go:117] "RemoveContainer" containerID="0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7" Apr 17 10:59:51.260393 ip-10-0-137-54 kubenswrapper[2573]: E0417 10:59:51.260377 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7\": container with ID starting with 0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7 not found: ID does not exist" containerID="0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7" Apr 17 10:59:51.260436 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.260400 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7"} err="failed to get container status \"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7\": rpc error: code = NotFound desc = could not find container \"0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7\": container with ID starting with 0533a0084e86135f8562c9a928fc0bc8bf316a3c48eae8b9790a1345b8c724e7 not found: ID does not exist" Apr 17 10:59:51.952651 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.952571 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-jznpl_315159e1-4ca1-4d6a-ad50-aba9f5982ce0/kube-state-metrics/0.log" Apr 17 10:59:51.974384 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.974362 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-jznpl_315159e1-4ca1-4d6a-ad50-aba9f5982ce0/kube-rbac-proxy-main/0.log" Apr 17 10:59:51.995692 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:51.995667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-jznpl_315159e1-4ca1-4d6a-ad50-aba9f5982ce0/kube-rbac-proxy-self/0.log" Apr 17 10:59:52.044671 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.044647 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7dccd58f55-j2r2d_21bb72eb-c4a9-4412-8c28-046f4c4a619e/monitoring-plugin/0.log" Apr 17 10:59:52.143382 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.143091 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxtzn_52bfba92-cf85-4f50-b871-048a870b7a67/node-exporter/0.log" Apr 17 10:59:52.162687 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.162660 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxtzn_52bfba92-cf85-4f50-b871-048a870b7a67/kube-rbac-proxy/0.log" Apr 17 10:59:52.180842 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.180818 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kxtzn_52bfba92-cf85-4f50-b871-048a870b7a67/init-textfile/0.log" Apr 17 10:59:52.287468 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.287394 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-nvng6_e05d976e-7041-4ff3-b72a-11618ad6c0df/kube-rbac-proxy-main/0.log" Apr 17 10:59:52.309300 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.309272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-nvng6_e05d976e-7041-4ff3-b72a-11618ad6c0df/kube-rbac-proxy-self/0.log" Apr 17 10:59:52.328930 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.328909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-nvng6_e05d976e-7041-4ff3-b72a-11618ad6c0df/openshift-state-metrics/0.log" Apr 17 10:59:52.361461 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.361426 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/prometheus/0.log" Apr 17 10:59:52.382077 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.382060 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/config-reloader/0.log" Apr 17 10:59:52.402656 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.402632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/thanos-sidecar/0.log" Apr 17 10:59:52.422706 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.422686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/kube-rbac-proxy-web/0.log" Apr 17 10:59:52.442794 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.442773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/kube-rbac-proxy/0.log" Apr 17 10:59:52.462401 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.462383 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/kube-rbac-proxy-thanos/0.log" Apr 17 10:59:52.477706 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.477676 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" path="/var/lib/kubelet/pods/93d3bc95-f1c0-4102-8210-5f0e21cb2447/volumes" Apr 17 10:59:52.481028 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.481011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_309f9b40-35b1-4408-a334-2700094721c4/init-config-reloader/0.log" Apr 17 10:59:52.505804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.505786 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-jwnqv_bcd9d505-7487-4c6c-86db-4015eb6619aa/prometheus-operator/0.log" Apr 17 10:59:52.524480 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.524463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5676c8c784-jwnqv_bcd9d505-7487-4c6c-86db-4015eb6619aa/kube-rbac-proxy/0.log" Apr 17 10:59:52.548142 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:52.548082 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-jv8kk_ce6ed75b-f45c-4082-8ba0-567cae1d72e3/prometheus-operator-admission-webhook/0.log" Apr 17 10:59:54.584498 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:54.584468 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6bcc868b7-4q7xk_4b3e0e8b-43cb-4854-86d9-00c38bfd631c/download-server/0.log" Apr 17 10:59:55.424320 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424287 2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6"] Apr 17 10:59:55.424610 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424596 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="copy" Apr 17 10:59:55.424660 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424612 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="copy" Apr 17 10:59:55.424660 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424633 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="gather" Apr 17 10:59:55.424660 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424639 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="gather" Apr 17 10:59:55.424758 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424682 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="copy" Apr 17 10:59:55.424758 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.424694 2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="93d3bc95-f1c0-4102-8210-5f0e21cb2447" containerName="gather" Apr 17 10:59:55.429804 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.429781 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.432108 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.432082 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-62hp5\"/\"kube-root-ca.crt\"" Apr 17 10:59:55.432882 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.432862 2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-62hp5\"/\"openshift-service-ca.crt\"" Apr 17 10:59:55.432882 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.432880 2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-62hp5\"/\"default-dockercfg-tk6ql\"" Apr 17 10:59:55.437166 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.437141 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6"] Apr 17 10:59:55.540478 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.540424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-podres\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.540690 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.540512 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-lib-modules\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.540690 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.540548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-proc\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.540857 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.540710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-sys\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.540913 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.540874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4tj\" (UniqueName: \"kubernetes.io/projected/70ca78d4-48b8-4632-8a83-b41f580e866d-kube-api-access-9w4tj\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.626805 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.626779 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvtfs_f5adea0c-3b73-476b-9e57-646bf76d5a70/dns/0.log" Apr 17 10:59:55.642113 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642078 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-sys\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642113 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642112 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4tj\" (UniqueName: \"kubernetes.io/projected/70ca78d4-48b8-4632-8a83-b41f580e866d-kube-api-access-9w4tj\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642141 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-podres\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642164 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-lib-modules\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642183 2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-proc\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-sys\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642298 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642250 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-proc\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642458 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-podres\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.642458 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.642327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/70ca78d4-48b8-4632-8a83-b41f580e866d-lib-modules\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.645925 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.645885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rvtfs_f5adea0c-3b73-476b-9e57-646bf76d5a70/kube-rbac-proxy/0.log" Apr 17 10:59:55.649598 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.649578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4tj\" (UniqueName: \"kubernetes.io/projected/70ca78d4-48b8-4632-8a83-b41f580e866d-kube-api-access-9w4tj\") pod \"perf-node-gather-daemonset-xskn6\" (UID: \"70ca78d4-48b8-4632-8a83-b41f580e866d\") " pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.687521 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.687440 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggkjk_4c1e743b-6e54-4775-8d57-1fa715225b0c/dns-node-resolver/0.log" Apr 17 10:59:55.741888 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.741857 2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:55.889864 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:55.889830 2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6"] Apr 17 10:59:55.892999 ip-10-0-137-54 kubenswrapper[2573]: W0417 10:59:55.892975 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod70ca78d4_48b8_4632_8a83_b41f580e866d.slice/crio-f80a1f44993d7ed17a8b901bee9b8bbc648b32063cf2dc4f0d316b719d9a28a1 WatchSource:0}: Error finding container f80a1f44993d7ed17a8b901bee9b8bbc648b32063cf2dc4f0d316b719d9a28a1: Status 404 returned error can't find the container with id f80a1f44993d7ed17a8b901bee9b8bbc648b32063cf2dc4f0d316b719d9a28a1 Apr 17 10:59:56.086449 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.086420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86bcd8b69-xplz9_e605d4b0-66e0-41eb-a62f-002b707ab1d0/registry/0.log" Apr 17 10:59:56.143103 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.143069 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcqsp_42effdd5-51bf-43b7-8555-1a026f723453/node-ca/0.log" Apr 17 10:59:56.265001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.264908 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" event={"ID":"70ca78d4-48b8-4632-8a83-b41f580e866d","Type":"ContainerStarted","Data":"9c062c614daa189eca2d6af18f778d05abdbcb8c9f84b0b184ca8462a878d44e"} Apr 17 10:59:56.265001 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.264948 2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" event={"ID":"70ca78d4-48b8-4632-8a83-b41f580e866d","Type":"ContainerStarted","Data":"f80a1f44993d7ed17a8b901bee9b8bbc648b32063cf2dc4f0d316b719d9a28a1"} Apr 17 10:59:56.265186 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.265051 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 10:59:56.279102 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:56.279054 2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" podStartSLOduration=1.27903945 podStartE2EDuration="1.27903945s" podCreationTimestamp="2026-04-17 10:59:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 10:59:56.2774256 +0000 UTC m=+2526.362212753" watchObservedRunningTime="2026-04-17 10:59:56.27903945 +0000 UTC m=+2526.363826604" Apr 17 10:59:57.081394 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:57.081366 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mx8jx_a23bfe19-501b-4bed-8962-16e697010aa9/serve-healthcheck-canary/0.log" Apr 17 10:59:57.453116 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:57.453091 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cvbx_5628730b-a86c-40d8-a1ed-fbc3c580f6b0/kube-rbac-proxy/0.log" Apr 17 10:59:57.472747 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:57.472710 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cvbx_5628730b-a86c-40d8-a1ed-fbc3c580f6b0/exporter/0.log" Apr 17 10:59:57.493800 ip-10-0-137-54 kubenswrapper[2573]: I0417 10:59:57.493758 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cvbx_5628730b-a86c-40d8-a1ed-fbc3c580f6b0/extractor/0.log" Apr 17 11:00:01.845037 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:01.845007 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-5h6rj_42a36e39-ecf4-4e32-99df-eded6b77a3f0/migrator/0.log" Apr 17 11:00:01.864380 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:01.864345 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-74bb7799d9-5h6rj_42a36e39-ecf4-4e32-99df-eded6b77a3f0/graceful-termination/0.log" Apr 17 11:00:02.278644 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:02.278617 2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-62hp5/perf-node-gather-daemonset-xskn6" Apr 17 11:00:02.851842 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:02.851811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7pp2p_cc3d69b7-3456-4bb2-9cd0-7aa46415f224/kube-multus/0.log" Apr 17 11:00:03.014696 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.014668 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/kube-multus-additional-cni-plugins/0.log" Apr 17 11:00:03.037541 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.037517 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/egress-router-binary-copy/0.log" Apr 17 11:00:03.055393 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.055370 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/cni-plugins/0.log" Apr 17 11:00:03.073172 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.073147 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/bond-cni-plugin/0.log" Apr 17 11:00:03.091167 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.091143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/routeoverride-cni/0.log" Apr 17 11:00:03.110873 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.110811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/whereabouts-cni-bincopy/0.log" Apr 17 11:00:03.132488 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.132459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9nt26_ac14beab-8114-493d-a919-16f44a7217f1/whereabouts-cni/0.log" Apr 17 11:00:03.387909 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.387837 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m98nc_30812199-596c-4ab1-b17b-ef92026124e6/network-metrics-daemon/0.log" Apr 17 11:00:03.405071 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:03.405042 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m98nc_30812199-596c-4ab1-b17b-ef92026124e6/kube-rbac-proxy/0.log" Apr 17 11:00:04.461849 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.461817 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/ovn-controller/0.log" Apr 17 11:00:04.490877 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.490842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/ovn-acl-logging/0.log" Apr 17 11:00:04.506289 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.506260 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/kube-rbac-proxy-node/0.log" Apr 17 11:00:04.524940 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.524915 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/kube-rbac-proxy-ovn-metrics/0.log" Apr 17 11:00:04.544269 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.544246 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/northd/0.log" Apr 17 11:00:04.563985 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.563963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/nbdb/0.log" Apr 17 11:00:04.584912 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.584891 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/sbdb/0.log" Apr 17 11:00:04.677833 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:04.677765 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcw2v_dcddce02-c375-4299-ad44-c965e1124126/ovnkube-controller/0.log" Apr 17 11:00:05.892711 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:05.892683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vtvnj_405413ce-3046-4495-be37-74e908505d81/network-check-target-container/0.log" Apr 17 11:00:06.774767 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:06.774717 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qlxms_63c112ba-178e-4698-98b1-86e360e40e1f/iptables-alerter/0.log" Apr 17 11:00:07.352692 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:07.352661 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-t7m6g_aacb1d0c-ad9c-456a-854d-00b4fc54085b/tuned/0.log" Apr 17 11:00:10.306569 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:10.306544 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-44mf2_ccb0777e-660e-4973-a4b3-53a5e504b9b3/csi-driver/0.log" Apr 17 11:00:10.324247 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:10.324225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-44mf2_ccb0777e-660e-4973-a4b3-53a5e504b9b3/csi-node-driver-registrar/0.log" Apr 17 11:00:10.342827 ip-10-0-137-54 kubenswrapper[2573]: I0417 11:00:10.342805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-44mf2_ccb0777e-660e-4973-a4b3-53a5e504b9b3/csi-liveness-probe/0.log"