May 21 12:37:31.196141 ip-10-0-142-58 systemd[1]: Starting Kubernetes Kubelet... May 21 12:37:31.658996 ip-10-0-142-58 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 12:37:31.658996 ip-10-0-142-58 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 12:37:31.658996 ip-10-0-142-58 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 12:37:31.658996 ip-10-0-142-58 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 12:37:31.658996 ip-10-0-142-58 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 12:37:31.662235 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.662141 2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 12:37:31.667247 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667226 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 12:37:31.667247 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667244 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 12:37:31.667247 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667248 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 12:37:31.667247 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667251 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 12:37:31.667247 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667254 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667258 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667261 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667263 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667266 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667269 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667272 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667274 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667277 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667280 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667284 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667288 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667292 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667294 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667297 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667300 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667303 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667306 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667309 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667312 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 12:37:31.667418 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667315 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667318 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667326 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667328 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667331 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667334 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667336 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667339 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667341 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667344 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667346 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667349 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667352 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667355 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667359 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667362 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667364 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667367 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667370 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667372 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 12:37:31.667917 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667375 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667378 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667381 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667383 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667386 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667389 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667391 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667394 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667397 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667399 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667402 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667405 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667407 2560 feature_gate.go:328] unrecognized feature gate: Example May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667410 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667412 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667416 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667420 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667423 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667426 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 12:37:31.668394 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667429 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667432 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667434 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667437 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667440 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667442 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667445 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667447 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667451 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667454 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667457 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667459 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667462 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667464 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667467 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667469 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667475 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667478 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667480 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667482 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 12:37:31.668870 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667485 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667488 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667490 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667917 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667923 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667926 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667929 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667932 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667935 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667937 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667940 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667945 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667968 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667971 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667975 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667978 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667981 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667984 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667987 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 12:37:31.669384 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667991 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667993 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667996 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.667999 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668001 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668004 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668006 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668010 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668013 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668015 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668018 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668020 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668023 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668025 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668028 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668030 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668033 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668035 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668038 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668040 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 12:37:31.669832 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668043 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668045 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668048 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668051 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668054 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668057 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668059 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668062 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668065 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668067 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668070 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668073 2560 feature_gate.go:328] unrecognized feature gate: Example May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668076 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668079 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668082 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668084 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668087 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668090 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668092 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668095 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 12:37:31.670348 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668098 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668103 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668106 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668109 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668112 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668114 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668117 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668119 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668122 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668125 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668127 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668130 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668132 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668135 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668137 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668141 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668143 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668147 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668150 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668152 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 12:37:31.670827 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668155 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668157 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668160 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668163 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668165 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668168 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668171 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668173 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668176 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.668178 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669517 2560 flags.go:64] FLAG: --address="0.0.0.0" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669527 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669534 2560 flags.go:64] FLAG: --anonymous-auth="true" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669538 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669543 2560 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669547 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669551 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669556 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669559 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669562 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669566 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669569 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 12:37:31.671329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669573 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669576 2560 flags.go:64] FLAG: --cgroup-root="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669578 2560 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669582 2560 flags.go:64] FLAG: --client-ca-file="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669585 2560 flags.go:64] FLAG: --cloud-config="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669588 2560 flags.go:64] FLAG: --cloud-provider="external" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669591 2560 flags.go:64] FLAG: --cluster-dns="[]" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669596 2560 flags.go:64] FLAG: --cluster-domain="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669599 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669602 2560 flags.go:64] FLAG: --config-dir="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669605 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669608 2560 flags.go:64] FLAG: --container-log-max-files="5" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669612 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669615 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669619 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669622 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669625 2560 flags.go:64] FLAG: --contention-profiling="false" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669628 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669631 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669634 2560 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669638 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669642 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669645 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669648 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669651 2560 flags.go:64] FLAG: --enable-load-reader="false" May 21 12:37:31.671877 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669655 2560 flags.go:64] FLAG: --enable-server="true" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669658 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669663 2560 flags.go:64] FLAG: --event-burst="100" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669666 2560 flags.go:64] FLAG: --event-qps="50" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669669 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669672 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669675 2560 flags.go:64] FLAG: --eviction-hard="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669680 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669683 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669686 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669689 2560 flags.go:64] FLAG: --eviction-soft="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669692 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669695 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669699 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669702 2560 flags.go:64] FLAG: --experimental-mounter-path="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669705 2560 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669708 2560 flags.go:64] FLAG: --fail-swap-on="true" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669711 2560 flags.go:64] FLAG: --feature-gates="" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669715 2560 flags.go:64] FLAG: --file-check-frequency="20s" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669718 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669721 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669724 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669727 2560 flags.go:64] FLAG: --healthz-port="10248" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669730 2560 flags.go:64] FLAG: --help="false" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669733 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-142-58.ec2.internal" May 21 12:37:31.672481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669736 2560 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669739 2560 flags.go:64] FLAG: --http-check-frequency="20s" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669743 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669746 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669749 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669752 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669755 2560 flags.go:64] FLAG: --image-service-endpoint="" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669758 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669761 2560 flags.go:64] FLAG: --kube-api-burst="100" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669765 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669768 2560 flags.go:64] FLAG: --kube-api-qps="50" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669771 2560 flags.go:64] FLAG: --kube-reserved="" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669773 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669776 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669780 2560 flags.go:64] FLAG: --kubelet-cgroups="" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669782 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669785 2560 flags.go:64] FLAG: --lock-file="" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669788 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669791 2560 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669795 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669800 2560 flags.go:64] FLAG: --log-json-split-stream="false" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669803 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669806 2560 flags.go:64] FLAG: --log-text-split-stream="false" May 21 12:37:31.673093 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669809 2560 flags.go:64] FLAG: --logging-format="text" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669812 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669815 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669818 2560 flags.go:64] FLAG: --manifest-url="" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669821 2560 flags.go:64] FLAG: --manifest-url-header="" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669826 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669830 2560 flags.go:64] FLAG: --max-open-files="1000000" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669834 2560 flags.go:64] FLAG: --max-pods="110" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669837 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669840 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669843 2560 flags.go:64] FLAG: --memory-manager-policy="None" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669846 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669849 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669866 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669869 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669877 2560 flags.go:64] FLAG: --node-status-max-images="50" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669880 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669883 2560 flags.go:64] FLAG: --oom-score-adj="-999" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669887 2560 flags.go:64] FLAG: --pod-cidr="" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669890 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669895 2560 flags.go:64] FLAG: --pod-manifest-path="" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669898 2560 flags.go:64] FLAG: --pod-max-pids="-1" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669902 2560 flags.go:64] FLAG: --pods-per-core="0" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669904 2560 flags.go:64] FLAG: --port="10250" May 21 12:37:31.673642 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669908 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669911 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f46240ddedcf771f" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669914 2560 flags.go:64] FLAG: --qos-reserved="" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669917 2560 flags.go:64] FLAG: --read-only-port="10255" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669921 2560 flags.go:64] FLAG: --register-node="true" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669924 2560 flags.go:64] FLAG: --register-schedulable="true" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669927 2560 flags.go:64] FLAG: --register-with-taints="" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669930 2560 flags.go:64] FLAG: --registry-burst="10" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669933 2560 flags.go:64] FLAG: --registry-qps="5" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669936 2560 flags.go:64] FLAG: --reserved-cpus="" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669939 2560 flags.go:64] FLAG: --reserved-memory="" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669943 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669946 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669948 2560 flags.go:64] FLAG: --rotate-certificates="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669951 2560 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669954 2560 flags.go:64] FLAG: --runonce="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669957 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669960 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669963 2560 flags.go:64] FLAG: --seccomp-default="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669966 2560 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669968 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669972 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669975 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669978 2560 flags.go:64] FLAG: --storage-driver-password="root" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669981 2560 flags.go:64] FLAG: --storage-driver-secure="false" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669984 2560 flags.go:64] FLAG: --storage-driver-table="stats" May 21 12:37:31.674259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669987 2560 flags.go:64] FLAG: --storage-driver-user="root" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669990 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669993 2560 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669996 2560 flags.go:64] FLAG: --system-cgroups="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.669999 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670005 2560 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670008 2560 flags.go:64] FLAG: --tls-cert-file="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670011 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670015 2560 flags.go:64] FLAG: --tls-min-version="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670018 2560 flags.go:64] FLAG: --tls-private-key-file="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670023 2560 flags.go:64] FLAG: --topology-manager-policy="none" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670026 2560 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670029 2560 flags.go:64] FLAG: --topology-manager-scope="container" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670032 2560 flags.go:64] FLAG: --v="2" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670036 2560 flags.go:64] FLAG: --version="false" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670040 2560 flags.go:64] FLAG: --vmodule="" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670044 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.670048 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670138 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670142 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670145 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670148 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670151 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670153 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 12:37:31.674899 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670156 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670158 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670161 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670164 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670166 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670169 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670171 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670174 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670177 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670179 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670186 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670189 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670191 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670194 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670197 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670200 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670202 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670205 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670212 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670215 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 12:37:31.675469 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670218 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670222 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670225 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670227 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670230 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670233 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670235 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670238 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670240 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670243 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670245 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670248 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670250 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670253 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670255 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670258 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670261 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670263 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670266 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670268 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 12:37:31.675985 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670271 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670273 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670276 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670279 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670282 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670285 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670288 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670290 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670293 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670296 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670300 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670302 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670305 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670307 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670310 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670313 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670315 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670318 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670320 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 12:37:31.676472 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670323 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670325 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670328 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670330 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670333 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670335 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670338 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670340 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670343 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670346 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670348 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670351 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670354 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670357 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670359 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670362 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670367 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670373 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670376 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670379 2560 feature_gate.go:328] unrecognized feature gate: Example May 21 12:37:31.676978 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.670382 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 12:37:31.677569 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.671202 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 12:37:31.677888 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.677763 2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 12:37:31.677927 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.677890 2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 12:37:31.677954 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677940 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 12:37:31.677954 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677946 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 12:37:31.677954 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677949 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 12:37:31.677954 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677952 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 12:37:31.677954 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677955 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677958 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677961 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677963 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677966 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677969 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677972 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677974 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677977 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677980 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677983 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677985 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677988 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677990 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677993 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677996 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.677999 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678002 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678004 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678007 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 12:37:31.678076 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678010 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678013 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678015 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678018 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678020 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678022 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678025 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678028 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678031 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678034 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678037 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678040 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678043 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678045 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678048 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678051 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678054 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678057 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678059 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678062 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 12:37:31.678557 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678065 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678069 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678073 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678075 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678078 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678081 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678084 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678087 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678089 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678092 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678095 2560 feature_gate.go:328] unrecognized feature gate: Example May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678098 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678100 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678104 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678106 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678109 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678112 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678115 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678118 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 12:37:31.679057 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678120 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678124 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678126 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678129 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678132 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678134 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678137 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678140 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678142 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678145 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678148 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678151 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678153 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678156 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678158 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678161 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678164 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678166 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678169 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678172 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 12:37:31.679521 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678174 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678178 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678182 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.678188 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678284 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678288 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678291 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678295 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678297 2560 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678300 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678303 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678307 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678310 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678313 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678316 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 12:37:31.680033 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678319 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678322 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678325 2560 feature_gate.go:328] unrecognized feature gate: Example2 May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678328 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678330 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678333 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678336 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678346 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678349 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678351 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678354 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678357 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678359 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678362 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678365 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678367 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678370 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678373 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678376 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678379 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 12:37:31.680407 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678381 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678384 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678387 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678390 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678392 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678395 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678398 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678400 2560 feature_gate.go:328] unrecognized feature gate: Example May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678403 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678405 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678408 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678411 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678414 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678417 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678419 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678422 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678425 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678428 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678431 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678433 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 12:37:31.680904 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678436 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678438 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678441 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678444 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678447 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678449 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678452 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678455 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678458 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678460 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678463 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678466 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678468 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678471 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678473 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678476 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678478 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678481 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678484 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678486 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 12:37:31.681406 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678488 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678491 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678493 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678496 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678500 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678504 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678507 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678510 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678512 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678515 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678517 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678520 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678522 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678525 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:31.678527 2560 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 12:37:31.681902 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.678532 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 12:37:31.682269 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.679235 2560 server.go:962] "Client rotation is on, will bootstrap in background" May 21 12:37:31.682664 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.682651 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 12:37:31.683567 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.683556 2560 server.go:1019] "Starting client certificate rotation" May 21 12:37:31.683679 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.683664 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 12:37:31.683739 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.683713 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 12:37:31.708786 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.708767 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 12:37:31.710939 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.710918 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 12:37:31.724914 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.724891 2560 log.go:25] "Validated CRI v1 runtime API" May 21 12:37:31.729601 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.729585 2560 log.go:25] "Validated CRI v1 image API" May 21 12:37:31.730916 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.730896 2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 12:37:31.735074 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.735056 2560 fs.go:135] Filesystem UUIDs: map[1f9b9615-1025-4092-a41a-3a993f8f21bc:/dev/nvme0n1p4 569990ed-c429-43f0-82e8-b5513bf36577:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 21 12:37:31.735135 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.735075 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 12:37:31.739959 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.739796 2560 manager.go:217] Machine: {Timestamp:2026-05-21 12:37:31.739329979 +0000 UTC m=+0.424431539 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108453 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b184aebef0b0323d72fc1a7c67798 SystemUUID:ec2b184a-ebef-0b03-23d7-2fc1a7c67798 BootID:d1eb0091-a4ae-49b8-8759-0bd201e68135 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6b:1d:44:75:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6b:1d:44:75:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:5c:7d:7a:5b:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 12:37:31.741579 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.741567 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 12:37:31.741670 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.741657 2560 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 12:37:31.743436 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.743409 2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 12:37:31.743578 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.743440 2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-58.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 12:37:31.743627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.743587 2560 topology_manager.go:138] "Creating topology manager with none policy" May 21 12:37:31.743627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.743595 2560 container_manager_linux.go:306] "Creating device plugin manager" May 21 12:37:31.743627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.743603 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 12:37:31.744439 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.744428 2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 12:37:31.746500 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.746490 2560 state_mem.go:36] "Initialized new in-memory state store" May 21 12:37:31.746614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.746605 2560 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 12:37:31.747708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.747691 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 12:37:31.748910 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.748898 2560 kubelet.go:491] "Attempting to sync node with API server" May 21 12:37:31.748943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.748915 2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 12:37:31.748943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.748927 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 12:37:31.748943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.748936 2560 kubelet.go:397] "Adding apiserver pod source" May 21 12:37:31.748943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.748944 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 12:37:31.750037 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.750025 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 12:37:31.750094 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.750043 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 12:37:31.753027 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.753011 2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 12:37:31.754944 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.754931 2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 12:37:31.755899 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755880 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 12:37:31.755938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755910 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 12:37:31.755938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755918 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 12:37:31.755938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755924 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 12:37:31.755938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755932 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 12:37:31.755938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755939 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 12:37:31.756151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755945 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 12:37:31.756151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755951 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 12:37:31.756151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755958 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 12:37:31.756151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755963 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 12:37:31.756151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.755979 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 12:37:31.756366 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.756190 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 12:37:31.757022 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.757013 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 12:37:31.757022 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.757023 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 12:37:31.760136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.760121 2560 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 12:37:31.760216 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.760166 2560 server.go:1295] "Started kubelet" May 21 12:37:31.760269 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.760230 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 12:37:31.760352 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.760300 2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 12:37:31.760387 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.760376 2560 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 12:37:31.761148 ip-10-0-142-58 systemd[1]: Started Kubernetes Kubelet. May 21 12:37:31.761743 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.761393 2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-58.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 12:37:31.761743 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.761407 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 12:37:31.763272 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.763243 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 12:37:31.764805 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.764785 2560 server.go:317] "Adding debug handlers to kubelet server" May 21 12:37:31.765086 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.765061 2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 12:37:31.769013 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.768991 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgkv2" May 21 12:37:31.769090 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.768355 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-58.ec2.internal.18b194e7f5326c18 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-58.ec2.internal,UID:ip-10-0-142-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-58.ec2.internal,},FirstTimestamp:2026-05-21 12:37:31.760135192 +0000 UTC m=+0.445236754,LastTimestamp:2026-05-21 12:37:31.760135192 +0000 UTC m=+0.445236754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-58.ec2.internal,}" May 21 12:37:31.770665 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.770649 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 12:37:31.771142 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771127 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 12:37:31.771357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771337 2560 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 12:37:31.771357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771357 2560 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 12:37:31.771483 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.771430 2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 12:37:31.771483 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771480 2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 12:37:31.771579 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771545 2560 reconstruct.go:97] "Volume reconstruction finished" May 21 12:37:31.771579 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.771553 2560 reconciler.go:26] "Reconciler: start to sync state" May 21 12:37:31.771847 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.771826 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:31.772201 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772111 2560 factory.go:55] Registering systemd factory May 21 12:37:31.772201 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772127 2560 factory.go:223] Registration of the systemd container factory successfully May 21 12:37:31.772494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772308 2560 factory.go:153] Registering CRI-O factory May 21 12:37:31.772494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772319 2560 factory.go:223] Registration of the crio container factory successfully May 21 12:37:31.772494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772372 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 12:37:31.772494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772392 2560 factory.go:103] Registering Raw factory May 21 12:37:31.772494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772406 2560 manager.go:1196] Started watching for new ooms in manager May 21 12:37:31.772802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.772786 2560 manager.go:319] Starting recovery of all containers May 21 12:37:31.776433 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.776403 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-58.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 12:37:31.776433 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.776419 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 12:37:31.778294 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.778273 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgkv2" May 21 12:37:31.781100 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.781081 2560 manager.go:324] Recovery completed May 21 12:37:31.782535 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.782508 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 12:37:31.785306 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.785293 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.787043 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.786975 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.787043 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.787012 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.787043 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.787025 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:31.787561 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.787548 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 12:37:31.787561 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.787559 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 12:37:31.787649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.787574 2560 state_mem.go:36] "Initialized new in-memory state store" May 21 12:37:31.789347 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.789286 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-58.ec2.internal.18b194e7f6cc3bc7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-58.ec2.internal,UID:ip-10-0-142-58.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-58.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-58.ec2.internal,},FirstTimestamp:2026-05-21 12:37:31.786992583 +0000 UTC m=+0.472094147,LastTimestamp:2026-05-21 12:37:31.786992583 +0000 UTC m=+0.472094147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-58.ec2.internal,}" May 21 12:37:31.789977 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.789964 2560 policy_none.go:49] "None policy: Start" May 21 12:37:31.790034 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.789981 2560 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 12:37:31.790034 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.789991 2560 state_mem.go:35] "Initializing new in-memory state store" May 21 12:37:31.827453 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827424 2560 manager.go:341] "Starting Device Plugin manager" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.827491 2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827506 2560 server.go:85] "Starting device plugin registration server" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827746 2560 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827757 2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827880 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827953 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.827962 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.828816 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 12:37:31.835493 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.828874 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:31.891708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.891669 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 12:37:31.892884 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.892870 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 12:37:31.892950 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.892895 2560 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 12:37:31.892950 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.892914 2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 12:37:31.892950 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.892921 2560 kubelet.go:2451] "Starting kubelet main sync loop" May 21 12:37:31.893059 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.892961 2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 12:37:31.896417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.896397 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 12:37:31.928474 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.928415 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.929460 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.929445 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.929531 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.929475 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.929531 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.929485 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:31.929531 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.929507 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-58.ec2.internal" May 21 12:37:31.936555 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.936538 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-58.ec2.internal" May 21 12:37:31.936627 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.936561 2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-58.ec2.internal\": node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:31.961118 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:31.961093 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:31.993073 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.993051 2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal"] May 21 12:37:31.993141 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.993116 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.994025 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.994008 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.994107 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.994042 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.994107 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.994053 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:31.995179 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995167 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.995364 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995351 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:31.995408 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995379 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.995836 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995821 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.995908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995825 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.995908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995842 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.995908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995874 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:31.995908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995886 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.995908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.995902 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:31.996973 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.996959 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:31.997015 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.996985 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 12:37:31.997601 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.997587 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientMemory" May 21 12:37:31.997657 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.997613 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasNoDiskPressure" May 21 12:37:31.997657 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:31.997623 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeHasSufficientPID" May 21 12:37:32.021469 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.021450 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-58.ec2.internal\" not found" node="ip-10-0-142-58.ec2.internal" May 21 12:37:32.025829 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.025816 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-58.ec2.internal\" not found" node="ip-10-0-142-58.ec2.internal" May 21 12:37:32.061161 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.061139 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.072968 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.072948 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.073025 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.072977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.073025 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.072995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/391d98783aa1857a5924aebc07bb2d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"391d98783aa1857a5924aebc07bb2d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:32.162212 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.162182 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.173463 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173446 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.173515 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173470 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.173515 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173489 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/391d98783aa1857a5924aebc07bb2d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"391d98783aa1857a5924aebc07bb2d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:32.173580 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173531 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/391d98783aa1857a5924aebc07bb2d6b-config\") pod \"kube-apiserver-proxy-ip-10-0-142-58.ec2.internal\" (UID: \"391d98783aa1857a5924aebc07bb2d6b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:32.173580 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173555 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.173580 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.173560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2143240f4a0faef3c78ea5ab21fb95de-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal\" (UID: \"2143240f4a0faef3c78ea5ab21fb95de\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.262945 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.262871 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.324343 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.324314 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:32.330193 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.330163 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:32.363835 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.363805 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.464377 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.464323 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.564948 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.564875 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.665399 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.665353 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.683808 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.683780 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 12:37:32.683958 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.683940 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 12:37:32.766111 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.766084 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.771009 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.770980 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 12:37:32.780365 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.780305 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 12:32:31 +0000 UTC" deadline="2028-02-10 16:19:37.053271102 +0000 UTC" May 21 12:37:32.780365 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.780341 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15123h42m4.272934261s" May 21 12:37:32.784986 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.784966 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 12:37:32.808005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.807970 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vwchw" May 21 12:37:32.815920 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.815871 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vwchw" May 21 12:37:32.818990 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:32.818964 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391d98783aa1857a5924aebc07bb2d6b.slice/crio-4a606ee98bae72e0365857cbd23d26ce095c7293a6123a563014788efed4dfff WatchSource:0}: Error finding container 4a606ee98bae72e0365857cbd23d26ce095c7293a6123a563014788efed4dfff: Status 404 returned error can't find the container with id 4a606ee98bae72e0365857cbd23d26ce095c7293a6123a563014788efed4dfff May 21 12:37:32.819269 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:32.819237 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2143240f4a0faef3c78ea5ab21fb95de.slice/crio-6fd00b01398c2eccbfe810572587564d3d41bb7cf1c7691377f843f4934bab72 WatchSource:0}: Error finding container 6fd00b01398c2eccbfe810572587564d3d41bb7cf1c7691377f843f4934bab72: Status 404 returned error can't find the container with id 6fd00b01398c2eccbfe810572587564d3d41bb7cf1c7691377f843f4934bab72 May 21 12:37:32.823041 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.823024 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 12:37:32.835518 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.835499 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 12:37:32.867075 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.867040 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:32.896283 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.896237 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" event={"ID":"391d98783aa1857a5924aebc07bb2d6b","Type":"ContainerStarted","Data":"4a606ee98bae72e0365857cbd23d26ce095c7293a6123a563014788efed4dfff"} May 21 12:37:32.897049 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:32.897029 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"2143240f4a0faef3c78ea5ab21fb95de","Type":"ContainerStarted","Data":"6fd00b01398c2eccbfe810572587564d3d41bb7cf1c7691377f843f4934bab72"} May 21 12:37:32.967292 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:32.967267 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:33.007730 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.007708 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 12:37:33.067800 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.067718 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:33.168130 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.168093 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:33.268957 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.268920 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-58.ec2.internal\" not found" May 21 12:37:33.278241 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.278190 2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 12:37:33.375024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.374946 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" May 21 12:37:33.388387 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.388355 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 12:37:33.389332 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.389312 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" May 21 12:37:33.408007 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.407985 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 12:37:33.751412 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.751182 2560 apiserver.go:52] "Watching apiserver" May 21 12:37:33.757421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.757394 2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 12:37:33.758397 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.758368 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-hmdc7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal","openshift-network-diagnostics/network-check-target-jk77d","openshift-network-operator/iptables-alerter-8nbl8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm","openshift-dns/node-resolver-27qp6","openshift-multus/multus-additional-cni-plugins-kfs2w","openshift-multus/multus-dtwgv","openshift-multus/network-metrics-daemon-dlzfk","openshift-ovn-kubernetes/ovnkube-node-27mmh","kube-system/konnectivity-agent-z4sw5","kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s75kb"] May 21 12:37:33.759916 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.759894 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.762145 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.762109 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 12:37:33.762257 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.762143 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 12:37:33.762257 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.762218 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n7jfb\"" May 21 12:37:33.762501 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.762476 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.764221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.764070 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.764313 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.764254 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 12:37:33.764556 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.764541 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 12:37:33.764631 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.764611 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2pjnq\"" May 21 12:37:33.765151 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.765132 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.765251 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.765220 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.766312 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.766252 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tnvjz\"" May 21 12:37:33.766399 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.766258 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 12:37:33.766599 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.766576 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 12:37:33.768120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.767944 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 12:37:33.768207 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768150 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 12:37:33.768340 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768325 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 12:37:33.768554 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768533 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qv44q\"" May 21 12:37:33.768629 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768585 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 12:37:33.768696 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768536 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 12:37:33.768776 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768720 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 12:37:33.768776 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768763 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.768921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.768873 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-92jr5\"" May 21 12:37:33.769960 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.769941 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.770050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.770022 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dtwgv" May 21 12:37:33.771094 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.771066 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-scnj4\"" May 21 12:37:33.771187 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.771147 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 12:37:33.771277 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.771256 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 12:37:33.771364 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.771319 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 12:37:33.771548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.771535 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.771625 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.771600 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:33.772999 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.772981 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.774933 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.774760 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:33.774933 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.774839 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:33.775303 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775284 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 12:37:33.775391 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775334 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q9k4l\"" May 21 12:37:33.776104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775555 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 12:37:33.776104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775614 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 12:37:33.776104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775629 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 12:37:33.776104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775676 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 12:37:33.776104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.775614 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 12:37:33.776918 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.776833 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5q27d\"" May 21 12:37:33.776918 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.776917 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m8t68\"" May 21 12:37:33.777103 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.776984 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 12:37:33.777103 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.777020 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 12:37:33.777103 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.777030 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 12:37:33.777103 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.776918 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 12:37:33.777364 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.777216 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 12:37:33.777426 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.777395 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 12:37:33.780655 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tk4\" (UniqueName: \"kubernetes.io/projected/22d992f2-6055-4f49-b781-a524d13abd8d-kube-api-access-q2tk4\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.780730 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780671 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-socket-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.780730 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-ovn\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.780730 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-netd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.780845 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69sx8\" (UniqueName: \"kubernetes.io/projected/bdd29810-f9c0-4202-9431-39e430e64f4c-kube-api-access-69sx8\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.780845 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-conf\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.780845 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-os-release\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.780845 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780830 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-kubelet\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zpv2\" (UniqueName: \"kubernetes.io/projected/7d052e34-81d4-4691-b122-cd5db1995b69-kube-api-access-8zpv2\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-multus\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dzbv\" (UniqueName: \"kubernetes.io/projected/8bdbfdc2-3062-4714-8eb4-ec23b0451233-kube-api-access-8dzbv\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-slash\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.780982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-sys\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-etc-selinux\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781109 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-daemon-config\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781135 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-netns\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cb0f40a-752f-498e-be8a-b9336e0b0a75-konnectivity-ca\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22d992f2-6055-4f49-b781-a524d13abd8d-hosts-file\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-var-lib-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdd29810-f9c0-4202-9431-39e430e64f4c-ovn-node-metrics-cert\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-kubernetes\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-netns\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-host\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-k8s-cni-cncf-io\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-hostroot\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf42d\" (UniqueName: \"kubernetes.io/projected/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-kube-api-access-xf42d\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-bin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-systemd-units\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781513 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.781614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-tuned\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781630 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-modprobe-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781680 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d052e34-81d4-4691-b122-cd5db1995b69-host-slash\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-tmp\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fec52138-af6f-48eb-b5e5-def92ba0826c-host\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-system-cni-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781777 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d052e34-81d4-4691-b122-cd5db1995b69-iptables-alerter-script\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781812 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-kubelet\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-config\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qv9t\" (UniqueName: \"kubernetes.io/projected/441ba5a0-e921-4599-9cb9-a44c067b74d6-kube-api-access-6qv9t\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwg7\" (UniqueName: \"kubernetes.io/projected/fec52138-af6f-48eb-b5e5-def92ba0826c-kube-api-access-gpwg7\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781940 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-os-release\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-run\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.781981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-var-lib-kubelet\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fec52138-af6f-48eb-b5e5-def92ba0826c-serviceca\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.782089 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8djt\" (UniqueName: \"kubernetes.io/projected/904f88a9-0132-4a79-8151-c494db2fe658-kube-api-access-s8djt\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qf4g\" (UniqueName: \"kubernetes.io/projected/5943d329-fdc2-4ccd-b163-12a02cda5446-kube-api-access-6qf4g\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cnibin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782119 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-socket-dir-parent\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782141 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-etc-kubernetes\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-systemd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-conf-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-multus-certs\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d992f2-6055-4f49-b781-a524d13abd8d-tmp-dir\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysconfig\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-bin\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-script-lib\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-cnibin\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-registration-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-system-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782454 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-etc-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.782921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-log-socket\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-env-overrides\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-systemd\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782600 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-lib-modules\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-device-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782685 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-sys-fs\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-node-log\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cb0f40a-752f-498e-be8a-b9336e0b0a75-agent-certs\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.783627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.782826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cni-binary-copy\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.788503 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.788471 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 12:37:33.816467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.816444 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:32:32 +0000 UTC" deadline="2027-11-28 16:50:57.119946251 +0000 UTC" May 21 12:37:33.816467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.816465 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13348h13m23.303482934s" May 21 12:37:33.872603 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.872576 2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 12:37:33.883055 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883022 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-bin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.883055 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883054 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883071 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-systemd-units\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883087 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883109 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-tuned\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883133 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-modprobe-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883156 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d052e34-81d4-4691-b122-cd5db1995b69-host-slash\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-systemd-units\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883177 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-tmp\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883198 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fec52138-af6f-48eb-b5e5-def92ba0826c-host\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.883213 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883223 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-system-cni-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.883253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883248 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d052e34-81d4-4691-b122-cd5db1995b69-iptables-alerter-script\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.883305 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:37:34.383264883 +0000 UTC m=+3.068366469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883331 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-kubelet\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883366 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-config\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883389 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qv9t\" (UniqueName: \"kubernetes.io/projected/441ba5a0-e921-4599-9cb9-a44c067b74d6-kube-api-access-6qv9t\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883411 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwg7\" (UniqueName: \"kubernetes.io/projected/fec52138-af6f-48eb-b5e5-def92ba0826c-kube-api-access-gpwg7\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883429 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883458 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-os-release\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883483 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-run\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883501 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-var-lib-kubelet\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883517 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fec52138-af6f-48eb-b5e5-def92ba0826c-serviceca\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883533 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8djt\" (UniqueName: \"kubernetes.io/projected/904f88a9-0132-4a79-8151-c494db2fe658-kube-api-access-s8djt\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883548 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-bin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883551 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qf4g\" (UniqueName: \"kubernetes.io/projected/5943d329-fdc2-4ccd-b163-12a02cda5446-kube-api-access-6qf4g\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883596 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cnibin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883625 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-socket-dir-parent\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.883654 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883657 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-etc-kubernetes\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883689 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-systemd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883714 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-conf-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883740 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-multus-certs\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883764 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d992f2-6055-4f49-b781-a524d13abd8d-tmp-dir\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883789 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysconfig\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d052e34-81d4-4691-b122-cd5db1995b69-iptables-alerter-script\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883816 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-kubelet\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883813 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-bin\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883877 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-script-lib\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883906 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-cnibin\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883930 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-registration-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883938 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-conf-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-multus-certs\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884012 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-system-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884062 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cnibin\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884106 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-socket-dir-parent\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.884198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884144 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-etc-kubernetes\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-systemd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.883955 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-system-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884193 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884221 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-etc-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884248 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-log-socket\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884253 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22d992f2-6055-4f49-b781-a524d13abd8d-tmp-dir\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884274 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884302 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-env-overrides\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884331 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-systemd\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884356 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-lib-modules\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-bin\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884387 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-config\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884410 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-device-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884432 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-etc-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884436 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-sys-fs\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884439 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-log-socket\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884479 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-sys-fs\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.886725 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysconfig\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884498 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-node-log\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884539 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-kubelet-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884408 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884478 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-node-log\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884727 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-lib-modules\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-system-cni-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884744 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-env-overrides\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884766 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fec52138-af6f-48eb-b5e5-def92ba0826c-host\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884785 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d052e34-81d4-4691-b122-cd5db1995b69-host-slash\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884807 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-modprobe-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-systemd\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884900 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-var-lib-kubelet\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884931 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-registration-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884957 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-device-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.884980 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-os-release\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885007 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cb0f40a-752f-498e-be8a-b9336e0b0a75-agent-certs\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885031 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.887420 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885034 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-run\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885051 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cni-binary-copy\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885074 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tk4\" (UniqueName: \"kubernetes.io/projected/22d992f2-6055-4f49-b781-a524d13abd8d-kube-api-access-q2tk4\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885101 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885125 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-socket-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885147 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-ovn\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885169 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-netd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885192 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69sx8\" (UniqueName: \"kubernetes.io/projected/bdd29810-f9c0-4202-9431-39e430e64f4c-kube-api-access-69sx8\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885217 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-conf\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885239 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-os-release\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885264 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-kubelet\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bdd29810-f9c0-4202-9431-39e430e64f4c-ovnkube-script-lib\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885290 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zpv2\" (UniqueName: \"kubernetes.io/projected/7d052e34-81d4-4691-b122-cd5db1995b69-kube-api-access-8zpv2\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885314 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885320 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-socket-dir\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885338 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-multus\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885365 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dzbv\" (UniqueName: \"kubernetes.io/projected/8bdbfdc2-3062-4714-8eb4-ec23b0451233-kube-api-access-8dzbv\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.888222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885388 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-slash\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885410 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885431 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-sys\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885448 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fec52138-af6f-48eb-b5e5-def92ba0826c-serviceca\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885469 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885491 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-cnibin\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885512 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885516 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-run-ovn\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885535 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-etc-selinux\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885556 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-daemon-config\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885580 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-netns\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885602 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cb0f40a-752f-498e-be8a-b9336e0b0a75-konnectivity-ca\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-conf\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-os-release\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-kubelet\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889005 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-cni-binary-copy\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-cni-dir\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-sys\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-var-lib-cni-multus\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885983 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-slash\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.885556 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-cni-netd\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886048 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5943d329-fdc2-4ccd-b163-12a02cda5446-etc-selinux\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886074 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-sysctl-d\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886092 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22d992f2-6055-4f49-b781-a524d13abd8d-hosts-file\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886114 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4cb0f40a-752f-498e-be8a-b9336e0b0a75-konnectivity-ca\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886139 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-var-lib-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886168 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdd29810-f9c0-4202-9431-39e430e64f4c-ovn-node-metrics-cert\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886197 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-kubernetes\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886205 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-var-lib-openvswitch\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886222 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-netns\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886248 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.889691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886256 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22d992f2-6055-4f49-b781-a524d13abd8d-hosts-file\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-run-netns\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdd29810-f9c0-4202-9431-39e430e64f4c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-netns\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886391 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/904f88a9-0132-4a79-8151-c494db2fe658-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-kubernetes\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bdbfdc2-3062-4714-8eb4-ec23b0451233-multus-daemon-config\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886510 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-host\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886543 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-k8s-cni-cncf-io\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886566 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/904f88a9-0132-4a79-8151-c494db2fe658-cni-binary-copy\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886586 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-host-run-k8s-cni-cncf-io\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441ba5a0-e921-4599-9cb9-a44c067b74d6-host\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886635 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-hostroot\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886667 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xf42d\" (UniqueName: \"kubernetes.io/projected/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-kube-api-access-xf42d\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.886698 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bdbfdc2-3062-4714-8eb4-ec23b0451233-hostroot\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.887779 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-etc-tuned\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.887841 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/441ba5a0-e921-4599-9cb9-a44c067b74d6-tmp\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.889051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bdd29810-f9c0-4202-9431-39e430e64f4c-ovn-node-metrics-cert\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.890167 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.889193 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4cb0f40a-752f-498e-be8a-b9336e0b0a75-agent-certs\") pod \"konnectivity-agent-z4sw5\" (UID: \"4cb0f40a-752f-498e-be8a-b9336e0b0a75\") " pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:33.900636 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.900606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf42d\" (UniqueName: \"kubernetes.io/projected/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-kube-api-access-xf42d\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:33.901666 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.901622 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69sx8\" (UniqueName: \"kubernetes.io/projected/bdd29810-f9c0-4202-9431-39e430e64f4c-kube-api-access-69sx8\") pod \"ovnkube-node-27mmh\" (UID: \"bdd29810-f9c0-4202-9431-39e430e64f4c\") " pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:33.902071 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.902051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qf4g\" (UniqueName: \"kubernetes.io/projected/5943d329-fdc2-4ccd-b163-12a02cda5446-kube-api-access-6qf4g\") pod \"aws-ebs-csi-driver-node-88zqm\" (UID: \"5943d329-fdc2-4ccd-b163-12a02cda5446\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:33.902260 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.902237 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qv9t\" (UniqueName: \"kubernetes.io/projected/441ba5a0-e921-4599-9cb9-a44c067b74d6-kube-api-access-6qv9t\") pod \"tuned-s75kb\" (UID: \"441ba5a0-e921-4599-9cb9-a44c067b74d6\") " pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:33.903127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.903098 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tk4\" (UniqueName: \"kubernetes.io/projected/22d992f2-6055-4f49-b781-a524d13abd8d-kube-api-access-q2tk4\") pod \"node-resolver-27qp6\" (UID: \"22d992f2-6055-4f49-b781-a524d13abd8d\") " pod="openshift-dns/node-resolver-27qp6" May 21 12:37:33.903232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.903126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zpv2\" (UniqueName: \"kubernetes.io/projected/7d052e34-81d4-4691-b122-cd5db1995b69-kube-api-access-8zpv2\") pod \"iptables-alerter-8nbl8\" (UID: \"7d052e34-81d4-4691-b122-cd5db1995b69\") " pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:33.903232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.903175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwg7\" (UniqueName: \"kubernetes.io/projected/fec52138-af6f-48eb-b5e5-def92ba0826c-kube-api-access-gpwg7\") pod \"node-ca-hmdc7\" (UID: \"fec52138-af6f-48eb-b5e5-def92ba0826c\") " pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:33.904280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.904228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dzbv\" (UniqueName: \"kubernetes.io/projected/8bdbfdc2-3062-4714-8eb4-ec23b0451233-kube-api-access-8dzbv\") pod \"multus-dtwgv\" (UID: \"8bdbfdc2-3062-4714-8eb4-ec23b0451233\") " pod="openshift-multus/multus-dtwgv" May 21 12:37:33.904598 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.904550 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8djt\" (UniqueName: \"kubernetes.io/projected/904f88a9-0132-4a79-8151-c494db2fe658-kube-api-access-s8djt\") pod \"multus-additional-cni-plugins-kfs2w\" (UID: \"904f88a9-0132-4a79-8151-c494db2fe658\") " pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:33.986956 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:33.986924 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:33.993183 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.993158 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:33.993183 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.993187 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:33.993351 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.993201 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:33.993351 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:33.993269 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:34.493251898 +0000 UTC m=+3.178353462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:34.071488 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.071356 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-27qp6" May 21 12:37:34.079295 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.079266 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s75kb" May 21 12:37:34.086304 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.086285 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:34.092907 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.092888 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nbl8" May 21 12:37:34.099429 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.099404 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmdc7" May 21 12:37:34.106968 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.106951 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" May 21 12:37:34.113592 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.113572 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" May 21 12:37:34.120172 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.120155 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dtwgv" May 21 12:37:34.124762 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.124744 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:34.331513 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.331487 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd29810_f9c0_4202_9431_39e430e64f4c.slice/crio-d81b66fde96ed8a7201a330a25e1b99c832ac5035f4f7e941d02c589b56047d9 WatchSource:0}: Error finding container d81b66fde96ed8a7201a330a25e1b99c832ac5035f4f7e941d02c589b56047d9: Status 404 returned error can't find the container with id d81b66fde96ed8a7201a330a25e1b99c832ac5035f4f7e941d02c589b56047d9 May 21 12:37:34.332829 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.332803 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec52138_af6f_48eb_b5e5_def92ba0826c.slice/crio-91dab8a55b59384db28dc34ba0515b452334bb90e4d7947d0f1813cdbac7e71f WatchSource:0}: Error finding container 91dab8a55b59384db28dc34ba0515b452334bb90e4d7947d0f1813cdbac7e71f: Status 404 returned error can't find the container with id 91dab8a55b59384db28dc34ba0515b452334bb90e4d7947d0f1813cdbac7e71f May 21 12:37:34.336507 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.336478 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb0f40a_752f_498e_be8a_b9336e0b0a75.slice/crio-47cf3ef47d78ee4ae7dd0fb80ee1d6844714309cb754fdaf6fd3768a86371f9e WatchSource:0}: Error finding container 47cf3ef47d78ee4ae7dd0fb80ee1d6844714309cb754fdaf6fd3768a86371f9e: Status 404 returned error can't find the container with id 47cf3ef47d78ee4ae7dd0fb80ee1d6844714309cb754fdaf6fd3768a86371f9e May 21 12:37:34.337064 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.337040 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d052e34_81d4_4691_b122_cd5db1995b69.slice/crio-57b6f855f4103c2ab1ba0b222deb2db061a144a5009395f1d238de1089f44f00 WatchSource:0}: Error finding container 57b6f855f4103c2ab1ba0b222deb2db061a144a5009395f1d238de1089f44f00: Status 404 returned error can't find the container with id 57b6f855f4103c2ab1ba0b222deb2db061a144a5009395f1d238de1089f44f00 May 21 12:37:34.337823 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.337802 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441ba5a0_e921_4599_9cb9_a44c067b74d6.slice/crio-70e6d042165525267d709fdd443d48f13e9383a396e6b8a2cbe5934e3c39785e WatchSource:0}: Error finding container 70e6d042165525267d709fdd443d48f13e9383a396e6b8a2cbe5934e3c39785e: Status 404 returned error can't find the container with id 70e6d042165525267d709fdd443d48f13e9383a396e6b8a2cbe5934e3c39785e May 21 12:37:34.339098 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.339074 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5943d329_fdc2_4ccd_b163_12a02cda5446.slice/crio-a5a5c0e08153c79f7ab58d6cba996284c5f340d0cecba64794b76aa73b3efb6f WatchSource:0}: Error finding container a5a5c0e08153c79f7ab58d6cba996284c5f340d0cecba64794b76aa73b3efb6f: Status 404 returned error can't find the container with id a5a5c0e08153c79f7ab58d6cba996284c5f340d0cecba64794b76aa73b3efb6f May 21 12:37:34.340512 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.340490 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdbfdc2_3062_4714_8eb4_ec23b0451233.slice/crio-c9f88c67238fed55d3ad3f02d858b8d03ff154e0804ab81a5f3fd771de5078e0 WatchSource:0}: Error finding container c9f88c67238fed55d3ad3f02d858b8d03ff154e0804ab81a5f3fd771de5078e0: Status 404 returned error can't find the container with id c9f88c67238fed55d3ad3f02d858b8d03ff154e0804ab81a5f3fd771de5078e0 May 21 12:37:34.341070 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.341047 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904f88a9_0132_4a79_8151_c494db2fe658.slice/crio-c697d6139c858e670c00e5e3766ecc6a630f62bd7829ebb52c55efe890907324 WatchSource:0}: Error finding container c697d6139c858e670c00e5e3766ecc6a630f62bd7829ebb52c55efe890907324: Status 404 returned error can't find the container with id c697d6139c858e670c00e5e3766ecc6a630f62bd7829ebb52c55efe890907324 May 21 12:37:34.342916 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:37:34.342893 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d992f2_6055_4f49_b781_a524d13abd8d.slice/crio-9c33a3fa909679593a0494a754c885443677e4a1cc6f4ebc2adf4dd08d9e0b10 WatchSource:0}: Error finding container 9c33a3fa909679593a0494a754c885443677e4a1cc6f4ebc2adf4dd08d9e0b10: Status 404 returned error can't find the container with id 9c33a3fa909679593a0494a754c885443677e4a1cc6f4ebc2adf4dd08d9e0b10 May 21 12:37:34.389584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.389559 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:34.389693 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.389670 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:34.389726 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.389716 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:37:35.389703199 +0000 UTC m=+4.074804746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:34.590891 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.590811 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:34.591005 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.590971 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:34.591005 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.590990 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:34.591005 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.591000 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:34.591109 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.591058 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:35.591037497 +0000 UTC m=+4.276139055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:34.817337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.817296 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:32:32 +0000 UTC" deadline="2027-10-18 11:59:41.075284121 +0000 UTC" May 21 12:37:34.817337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.817332 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12359h22m6.257955556s" May 21 12:37:34.893402 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.893328 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:34.893730 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:34.893704 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:34.919000 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.918835 2560 generic.go:358] "Generic (PLEG): container finished" podID="2143240f4a0faef3c78ea5ab21fb95de" containerID="be5f927e1134e3867fdd528026c1ee235f8374a63f1b14c6687766907f110f66" exitCode=0 May 21 12:37:34.919000 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.918950 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"2143240f4a0faef3c78ea5ab21fb95de","Type":"ContainerDied","Data":"be5f927e1134e3867fdd528026c1ee235f8374a63f1b14c6687766907f110f66"} May 21 12:37:34.935700 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.935666 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27qp6" event={"ID":"22d992f2-6055-4f49-b781-a524d13abd8d","Type":"ContainerStarted","Data":"9c33a3fa909679593a0494a754c885443677e4a1cc6f4ebc2adf4dd08d9e0b10"} May 21 12:37:34.952548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.952471 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dtwgv" event={"ID":"8bdbfdc2-3062-4714-8eb4-ec23b0451233","Type":"ContainerStarted","Data":"c9f88c67238fed55d3ad3f02d858b8d03ff154e0804ab81a5f3fd771de5078e0"} May 21 12:37:34.960491 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.960437 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s75kb" event={"ID":"441ba5a0-e921-4599-9cb9-a44c067b74d6","Type":"ContainerStarted","Data":"70e6d042165525267d709fdd443d48f13e9383a396e6b8a2cbe5934e3c39785e"} May 21 12:37:34.972557 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.972418 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nbl8" event={"ID":"7d052e34-81d4-4691-b122-cd5db1995b69","Type":"ContainerStarted","Data":"57b6f855f4103c2ab1ba0b222deb2db061a144a5009395f1d238de1089f44f00"} May 21 12:37:34.980838 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.980808 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z4sw5" event={"ID":"4cb0f40a-752f-498e-be8a-b9336e0b0a75","Type":"ContainerStarted","Data":"47cf3ef47d78ee4ae7dd0fb80ee1d6844714309cb754fdaf6fd3768a86371f9e"} May 21 12:37:34.996305 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:34.996214 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmdc7" event={"ID":"fec52138-af6f-48eb-b5e5-def92ba0826c","Type":"ContainerStarted","Data":"91dab8a55b59384db28dc34ba0515b452334bb90e4d7947d0f1813cdbac7e71f"} May 21 12:37:35.012070 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.012041 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"d81b66fde96ed8a7201a330a25e1b99c832ac5035f4f7e941d02c589b56047d9"} May 21 12:37:35.026269 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.026217 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" event={"ID":"391d98783aa1857a5924aebc07bb2d6b","Type":"ContainerStarted","Data":"b3b1e80605ea3a08089be4e63f603539751e6b0aaa916f54e77bad3a798929e0"} May 21 12:37:35.044515 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.044484 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerStarted","Data":"c697d6139c858e670c00e5e3766ecc6a630f62bd7829ebb52c55efe890907324"} May 21 12:37:35.052356 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.052326 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" event={"ID":"5943d329-fdc2-4ccd-b163-12a02cda5446","Type":"ContainerStarted","Data":"a5a5c0e08153c79f7ab58d6cba996284c5f340d0cecba64794b76aa73b3efb6f"} May 21 12:37:35.399409 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.399369 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:35.399594 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.399511 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:35.399594 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.399573 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:37:37.399554104 +0000 UTC m=+6.084655658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:35.601467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.600783 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:35.601467 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.600975 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:35.601467 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.600995 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:35.601467 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.601008 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:35.601467 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.601069 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:37.601048871 +0000 UTC m=+6.286150433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:35.897246 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:35.896451 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:35.897246 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:35.896608 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:36.061741 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:36.061309 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" event={"ID":"2143240f4a0faef3c78ea5ab21fb95de","Type":"ContainerStarted","Data":"934a8051b704c1fbda8647891a151aa0032b25e4283c0a40940ddebfcea7c9d9"} May 21 12:37:36.075676 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:36.074868 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-58.ec2.internal" podStartSLOduration=3.074830779 podStartE2EDuration="3.074830779s" podCreationTimestamp="2026-05-21 12:37:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:37:35.038949881 +0000 UTC m=+3.724051455" watchObservedRunningTime="2026-05-21 12:37:36.074830779 +0000 UTC m=+4.759932349" May 21 12:37:36.893259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:36.893223 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:36.893462 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:36.893352 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:37.417265 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:37.417219 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:37.417724 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.417413 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:37.417724 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.417485 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:37:41.417464716 +0000 UTC m=+10.102566267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:37.619120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:37.619067 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:37.619287 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.619265 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:37.619287 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.619283 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:37.619390 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.619296 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:37.619390 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.619355 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:41.619337092 +0000 UTC m=+10.304438645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:37.893605 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:37.893566 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:37.893786 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:37.893707 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:38.894125 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:38.893589 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:38.894125 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:38.893726 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:39.894957 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:39.894463 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:39.894957 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:39.894614 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:40.893655 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:40.893499 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:40.893655 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:40.893621 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:41.453479 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:41.453441 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:41.453957 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.453605 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:41.453957 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.453670 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:37:49.453649696 +0000 UTC m=+18.138751266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:41.655741 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:41.655703 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:41.655952 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.655918 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:41.655952 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.655939 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:41.655952 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.655953 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:41.656115 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.656006 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:37:49.655991745 +0000 UTC m=+18.341093292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:41.895216 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:41.894971 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:41.895406 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:41.895318 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:42.893310 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:42.893276 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:42.893766 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:42.893409 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:43.894120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:43.894087 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:43.894539 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:43.894206 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:44.893721 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:44.893639 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:44.893876 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:44.893767 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:45.893166 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:45.893135 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:45.893616 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:45.893263 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:46.893376 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:46.893339 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:46.893743 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:46.893451 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:47.893608 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:47.893572 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:47.893951 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:47.893716 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:48.893779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:48.893740 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:48.894291 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:48.893879 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:49.508302 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:49.508258 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:49.508503 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.508395 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:49.508503 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.508454 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:38:05.508436023 +0000 UTC m=+34.193537586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:37:49.709751 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:49.709712 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:49.709967 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.709842 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:37:49.709967 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.709877 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:37:49.709967 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.709887 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:49.709967 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.709942 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:05.709926629 +0000 UTC m=+34.395028175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:37:49.893962 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:49.893881 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:49.894425 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:49.894023 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:50.893337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:50.893294 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:50.893530 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:50.893432 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:51.894783 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:51.894753 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:51.895254 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:51.894895 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:52.893702 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:52.893530 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:52.893794 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:52.893781 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:53.093467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.093148 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-27qp6" event={"ID":"22d992f2-6055-4f49-b781-a524d13abd8d","Type":"ContainerStarted","Data":"31b5c34dc158eb90affaf7808d53da5ef2a998daad73898b0552ab6cdd7d5462"} May 21 12:37:53.094564 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.094536 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dtwgv" event={"ID":"8bdbfdc2-3062-4714-8eb4-ec23b0451233","Type":"ContainerStarted","Data":"7dc974239677212aad2f036fd6c1bfbf50bec6230d5b8c9393ea178eae87dd35"} May 21 12:37:53.095951 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.095927 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s75kb" event={"ID":"441ba5a0-e921-4599-9cb9-a44c067b74d6","Type":"ContainerStarted","Data":"0b55c256c903490a17d4fd2845e19d64fadbf017d51409a79e6b174aad5e4f48"} May 21 12:37:53.097329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.097306 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z4sw5" event={"ID":"4cb0f40a-752f-498e-be8a-b9336e0b0a75","Type":"ContainerStarted","Data":"f0e3e3c649d09ee22b38ded84425f11bf3980be9200b75bca349e839dd7844a7"} May 21 12:37:53.098620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.098590 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmdc7" event={"ID":"fec52138-af6f-48eb-b5e5-def92ba0826c","Type":"ContainerStarted","Data":"79f00b532680dd84765e980ac6676eaecf82ac83ecfc1fc6e75d636a27098b71"} May 21 12:37:53.101198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.101174 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"a931aa0aedf7a05f0aca8332199338c8b6f8b71150e8d8506ae312ec07b64c10"} May 21 12:37:53.101281 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.101206 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"8303eb4e50f97bfb94229da127dd4276e5b49bd919c6786ee1f2efe9c30fd295"} May 21 12:37:53.101281 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.101220 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"16a3fe941b0e1b4ef59b5f2ba427041f67b359a3eec91d50e88c4157105aaca9"} May 21 12:37:53.101281 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.101232 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"fbedab45dbfbc77c1d79676a5810b6a6dac10e65ea9636f46fceaaf368a15dfa"} May 21 12:37:53.101281 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.101245 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"94438b545169541b9e7d0f1832849ec8ba938fc27b0960e71ec1791211f9c4a9"} May 21 12:37:53.102668 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.102629 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="f02996f956c2e542761bcd04fd43b404b537a70bd5e07eb23f39634e1df794a1" exitCode=0 May 21 12:37:53.102908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.102871 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"f02996f956c2e542761bcd04fd43b404b537a70bd5e07eb23f39634e1df794a1"} May 21 12:37:53.104201 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.104176 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" event={"ID":"5943d329-fdc2-4ccd-b163-12a02cda5446","Type":"ContainerStarted","Data":"edec7100c469b15ac9937f451843f5f3d797916f9ece160a1adb0a30afde5f2f"} May 21 12:37:53.112281 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.112246 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-58.ec2.internal" podStartSLOduration=20.112235544 podStartE2EDuration="20.112235544s" podCreationTimestamp="2026-05-21 12:37:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:37:36.075658492 +0000 UTC m=+4.760760062" watchObservedRunningTime="2026-05-21 12:37:53.112235544 +0000 UTC m=+21.797337114" May 21 12:37:53.112644 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.112603 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-27qp6" podStartSLOduration=3.991375642 podStartE2EDuration="22.112591765s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.344327022 +0000 UTC m=+3.029428569" lastFinishedPulling="2026-05-21 12:37:52.465543144 +0000 UTC m=+21.150644692" observedRunningTime="2026-05-21 12:37:53.111228797 +0000 UTC m=+21.796330370" watchObservedRunningTime="2026-05-21 12:37:53.112591765 +0000 UTC m=+21.797693334" May 21 12:37:53.124677 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.124643 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z4sw5" podStartSLOduration=3.997734995 podStartE2EDuration="22.124636199s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.338624265 +0000 UTC m=+3.023725826" lastFinishedPulling="2026-05-21 12:37:52.465525469 +0000 UTC m=+21.150627030" observedRunningTime="2026-05-21 12:37:53.124541569 +0000 UTC m=+21.809643150" watchObservedRunningTime="2026-05-21 12:37:53.124636199 +0000 UTC m=+21.809737768" May 21 12:37:53.173503 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.173446 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hmdc7" podStartSLOduration=8.642863528 podStartE2EDuration="22.173430341s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.335314411 +0000 UTC m=+3.020415975" lastFinishedPulling="2026-05-21 12:37:47.865881227 +0000 UTC m=+16.550982788" observedRunningTime="2026-05-21 12:37:53.146168956 +0000 UTC m=+21.831270525" watchObservedRunningTime="2026-05-21 12:37:53.173430341 +0000 UTC m=+21.858531911" May 21 12:37:53.194259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.194215 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dtwgv" podStartSLOduration=3.062074905 podStartE2EDuration="21.194201236s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.343171086 +0000 UTC m=+3.028272648" lastFinishedPulling="2026-05-21 12:37:52.475297423 +0000 UTC m=+21.160398979" observedRunningTime="2026-05-21 12:37:53.194090073 +0000 UTC m=+21.879191644" watchObservedRunningTime="2026-05-21 12:37:53.194201236 +0000 UTC m=+21.879302807" May 21 12:37:53.212295 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.212247 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s75kb" podStartSLOduration=4.084771721 podStartE2EDuration="22.2122302s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.340015916 +0000 UTC m=+3.025117468" lastFinishedPulling="2026-05-21 12:37:52.467474385 +0000 UTC m=+21.152575947" observedRunningTime="2026-05-21 12:37:53.211743036 +0000 UTC m=+21.896844622" watchObservedRunningTime="2026-05-21 12:37:53.2122302 +0000 UTC m=+21.897331768" May 21 12:37:53.592754 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.592592 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 12:37:53.838422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.838310 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T12:37:53.592751143Z","UUID":"55a5331b-2bf4-45e9-9aa2-42d8ad6de156","Handler":null,"Name":"","Endpoint":""} May 21 12:37:53.841316 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.841290 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 12:37:53.841462 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.841326 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 12:37:53.894014 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:53.893984 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:53.894217 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:53.894108 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:54.109345 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:54.109252 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nbl8" event={"ID":"7d052e34-81d4-4691-b122-cd5db1995b69","Type":"ContainerStarted","Data":"d21638188e82bcb70af6ea29f091c55d2ed76a094f8d1febc69be6e015521740"} May 21 12:37:54.112985 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:54.112954 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"94e088e0b978ff1b77dd1610b3685f0bda060863f8d76439b2b1b4e46e17018f"} May 21 12:37:54.114890 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:54.114841 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" event={"ID":"5943d329-fdc2-4ccd-b163-12a02cda5446","Type":"ContainerStarted","Data":"cb15629ac7542d45af9abba9a3253483068f93d4e6dd33d32219387792fc8174"} May 21 12:37:54.125186 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:54.125142 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8nbl8" podStartSLOduration=9.598373807 podStartE2EDuration="23.12513032s" podCreationTimestamp="2026-05-21 12:37:31 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.339123503 +0000 UTC m=+3.024225060" lastFinishedPulling="2026-05-21 12:37:47.865880022 +0000 UTC m=+16.550981573" observedRunningTime="2026-05-21 12:37:54.124956059 +0000 UTC m=+22.810057629" watchObservedRunningTime="2026-05-21 12:37:54.12513032 +0000 UTC m=+22.810231889" May 21 12:37:54.893315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:54.893280 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:54.893536 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:54.893400 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:55.118229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:55.118183 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" event={"ID":"5943d329-fdc2-4ccd-b163-12a02cda5446","Type":"ContainerStarted","Data":"eb6569b5c9607915887d6382c5c17e78fe9ddb096753b0fa0b19948aa96e4ddd"} May 21 12:37:55.136969 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:55.136928 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-88zqm" podStartSLOduration=3.082353489 podStartE2EDuration="23.136912699s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.341103882 +0000 UTC m=+3.026205447" lastFinishedPulling="2026-05-21 12:37:54.395663099 +0000 UTC m=+23.080764657" observedRunningTime="2026-05-21 12:37:55.13674882 +0000 UTC m=+23.821850390" watchObservedRunningTime="2026-05-21 12:37:55.136912699 +0000 UTC m=+23.822014272" May 21 12:37:55.479238 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:55.479184 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:55.479932 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:55.479907 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:55.894045 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:55.893959 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:55.894200 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:55.894069 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:56.123694 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:56.123658 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"f14f8dfa0f2a270f61ea03d997e015fc506c93e94ccea343a5de07a074fb786d"} May 21 12:37:56.893649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:56.893617 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:56.893807 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:56.893773 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:57.392942 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:57.392833 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:57.393439 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:57.392975 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 21 12:37:57.393479 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:57.393466 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z4sw5" May 21 12:37:57.894215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:57.893932 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:57.894351 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:57.894284 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:37:58.129474 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.129433 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" event={"ID":"bdd29810-f9c0-4202-9431-39e430e64f4c","Type":"ContainerStarted","Data":"49380079f177f23eef3f25e7b47e56f4f9a894fc05f42d1ae9447a5e1b8c48d3"} May 21 12:37:58.129726 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.129704 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:58.131148 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.131121 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="88d16abe01170f21b3cfa35c0442137e28e814d79fcbf527cfe4218884f7f960" exitCode=0 May 21 12:37:58.131232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.131202 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"88d16abe01170f21b3cfa35c0442137e28e814d79fcbf527cfe4218884f7f960"} May 21 12:37:58.145107 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.145049 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:58.161972 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.160969 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" podStartSLOduration=7.887592136 podStartE2EDuration="26.160952563s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.33412693 +0000 UTC m=+3.019228476" lastFinishedPulling="2026-05-21 12:37:52.607487344 +0000 UTC m=+21.292588903" observedRunningTime="2026-05-21 12:37:58.160083943 +0000 UTC m=+26.845185504" watchObservedRunningTime="2026-05-21 12:37:58.160952563 +0000 UTC m=+26.846054132" May 21 12:37:58.893377 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:58.893348 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:58.893876 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:58.893488 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:59.133755 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.133725 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:59.133755 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.133760 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:59.148031 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.147883 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:37:59.451200 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.450927 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jk77d"] May 21 12:37:59.451328 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.451253 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:37:59.451374 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:59.451350 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:37:59.452645 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.452619 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dlzfk"] May 21 12:37:59.452753 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:37:59.452717 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:37:59.452806 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:37:59.452791 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:38:00.137247 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:00.137213 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="f5decc225c023438bf7eb5e15f3ec177b802c7b897b890d241cade773229b905" exitCode=0 May 21 12:38:00.137590 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:00.137253 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"f5decc225c023438bf7eb5e15f3ec177b802c7b897b890d241cade773229b905"} May 21 12:38:00.894042 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:00.894002 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:00.894229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:00.894002 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:00.894229 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:00.894112 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:38:00.894229 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:00.894218 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:38:01.140737 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:01.140705 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="1a363519913a6ea95fb939611aaac3ac65cb70d3f186aed42e6181827f07bb7c" exitCode=0 May 21 12:38:01.141229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:01.140767 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"1a363519913a6ea95fb939611aaac3ac65cb70d3f186aed42e6181827f07bb7c"} May 21 12:38:02.893310 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:02.893272 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:02.893928 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:02.893269 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:02.893928 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:02.893428 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:38:02.893928 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:02.893463 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:38:04.894099 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:04.894063 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:04.894615 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:04.894069 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:04.894615 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:04.894192 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jk77d" podUID="c21ced6c-bef8-43ac-9688-5c9c67a9de20" May 21 12:38:04.894615 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:04.894304 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:38:05.166780 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.166693 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-58.ec2.internal" event="NodeReady" May 21 12:38:05.166974 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.166834 2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 12:38:05.233245 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.233213 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mcwxl"] May 21 12:38:05.250656 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.250489 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-65b68"] May 21 12:38:05.250830 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.250814 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.253331 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.253309 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 12:38:05.253586 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.253568 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m7gww\"" May 21 12:38:05.254302 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.254047 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 12:38:05.254613 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.254597 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 12:38:05.259973 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.259791 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcwxl"] May 21 12:38:05.259973 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.259819 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65b68"] May 21 12:38:05.259973 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.259955 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65b68" May 21 12:38:05.263290 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.263262 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 12:38:05.263290 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.263265 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 12:38:05.263446 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.263298 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbjhg\"" May 21 12:38:05.330511 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.330669 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-config-volume\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.330669 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-tmp-dir\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.330669 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330653 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxh5d\" (UniqueName: \"kubernetes.io/projected/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-kube-api-access-gxh5d\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.330808 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgxbl\" (UniqueName: \"kubernetes.io/projected/0f9420ed-249b-44b5-8e42-c35ca1c34616-kube-api-access-lgxbl\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.330808 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.330751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.431959 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.431868 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.431959 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.431933 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-config-volume\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.431959 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.431956 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-tmp-dir\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.431984 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxh5d\" (UniqueName: \"kubernetes.io/projected/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-kube-api-access-gxh5d\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.431991 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.432011 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgxbl\" (UniqueName: \"kubernetes.io/projected/0f9420ed-249b-44b5-8e42-c35ca1c34616-kube-api-access-lgxbl\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.432083 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:05.932061635 +0000 UTC m=+34.617163190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.432107 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.432231 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.432220 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:05.432523 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.432252 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:05.93224101 +0000 UTC m=+34.617342564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:05.432584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.432527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-tmp-dir\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.432780 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.432758 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-config-volume\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.447419 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.447248 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxh5d\" (UniqueName: \"kubernetes.io/projected/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-kube-api-access-gxh5d\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.447548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.447340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgxbl\" (UniqueName: \"kubernetes.io/projected/0f9420ed-249b-44b5-8e42-c35ca1c34616-kube-api-access-lgxbl\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.533374 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.533336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:05.533539 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.533500 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:38:05.533593 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.533579 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:38:37.533564863 +0000 UTC m=+66.218666416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 12:38:05.734457 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.734423 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:05.734634 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.734569 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 12:38:05.734634 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.734589 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 12:38:05.734634 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.734604 2560 projected.go:194] Error preparing data for projected volume kube-api-access-kwpgg for pod openshift-network-diagnostics/network-check-target-jk77d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:38:05.734747 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.734670 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg podName:c21ced6c-bef8-43ac-9688-5c9c67a9de20 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:37.734657622 +0000 UTC m=+66.419759169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwpgg" (UniqueName: "kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg") pod "network-check-target-jk77d" (UID: "c21ced6c-bef8-43ac-9688-5c9c67a9de20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 12:38:05.936129 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.936088 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:05.936574 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:05.936178 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:05.936574 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.936245 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:05.936574 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.936282 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:05.936574 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.936312 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:06.936296355 +0000 UTC m=+35.621397901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:05.936574 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:05.936331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:06.936322135 +0000 UTC m=+35.621423687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:06.893947 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.893916 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:06.894101 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.893919 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:06.896690 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.896672 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 12:38:06.896965 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.896942 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 12:38:06.896965 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.896959 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mr26\"" May 21 12:38:06.897646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.897630 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsngm\"" May 21 12:38:06.897731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.897721 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 12:38:06.942989 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.942966 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:06.943316 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:06.943015 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:06.943316 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:06.943101 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:06.943316 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:06.943137 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:06.943316 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:06.943152 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:08.943137996 +0000 UTC m=+37.628239543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:06.943316 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:06.943201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:08.943184177 +0000 UTC m=+37.628285729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:08.155517 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:08.155487 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="18fcee62cc3c31365b0c90979078036f932092b7d56db315cd920678243cebe5" exitCode=0 May 21 12:38:08.155982 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:08.155545 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"18fcee62cc3c31365b0c90979078036f932092b7d56db315cd920678243cebe5"} May 21 12:38:08.958544 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:08.958501 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:08.958747 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:08.958602 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:08.958747 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:08.958665 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:08.958747 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:08.958731 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:08.958747 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:08.958748 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:12.958724686 +0000 UTC m=+41.643826232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:08.959017 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:08.958788 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:12.958768583 +0000 UTC m=+41.643870149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:09.159495 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:09.159462 2560 generic.go:358] "Generic (PLEG): container finished" podID="904f88a9-0132-4a79-8151-c494db2fe658" containerID="c244506c26a15451d45beda06424d3cc157a3a4356f005b2856d6df19a0a2189" exitCode=0 May 21 12:38:09.159867 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:09.159503 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerDied","Data":"c244506c26a15451d45beda06424d3cc157a3a4356f005b2856d6df19a0a2189"} May 21 12:38:10.164794 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:10.164757 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" event={"ID":"904f88a9-0132-4a79-8151-c494db2fe658","Type":"ContainerStarted","Data":"815f3c3d97db2942524ffa9f1b645c91639c14ed9ba650f0b49e09a14d4ec186"} May 21 12:38:10.188195 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:10.188148 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kfs2w" podStartSLOduration=5.487863209 podStartE2EDuration="38.188135898s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:37:34.343103076 +0000 UTC m=+3.028204623" lastFinishedPulling="2026-05-21 12:38:07.04337576 +0000 UTC m=+35.728477312" observedRunningTime="2026-05-21 12:38:10.187030684 +0000 UTC m=+38.872132252" watchObservedRunningTime="2026-05-21 12:38:10.188135898 +0000 UTC m=+38.873237466" May 21 12:38:12.987337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:12.987296 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:12.987694 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:12.987362 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:12.987694 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:12.987449 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:12.987694 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:12.987512 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:20.987496405 +0000 UTC m=+49.672597952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:12.987694 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:12.987456 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:12.987694 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:12.987587 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:20.987576345 +0000 UTC m=+49.672677897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:21.037292 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:21.037254 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:21.037759 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:21.037314 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:21.037759 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:21.037399 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:21.037759 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:21.037400 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:21.037759 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:21.037458 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:38:37.037443128 +0000 UTC m=+65.722544675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:21.037759 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:21.037471 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:38:37.037464941 +0000 UTC m=+65.722566487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:31.150828 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:31.150797 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27mmh" May 21 12:38:37.043309 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.043270 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:38:37.043799 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.043336 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:38:37.043799 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.043419 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:38:37.043799 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.043490 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:39:09.043473723 +0000 UTC m=+97.728575270 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:38:37.043799 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.043427 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:38:37.043799 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.043559 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:39:09.043548343 +0000 UTC m=+97.728649894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:38:37.547120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.547080 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:38:37.549583 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.549561 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 12:38:37.557294 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.557275 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 12:38:37.557370 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:38:37.557339 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:39:41.557317898 +0000 UTC m=+130.242419460 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : secret "metrics-daemon-secret" not found May 21 12:38:37.748622 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.748581 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:37.751232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.751207 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 12:38:37.761506 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.761486 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 12:38:37.772951 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.772927 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpgg\" (UniqueName: \"kubernetes.io/projected/c21ced6c-bef8-43ac-9688-5c9c67a9de20-kube-api-access-kwpgg\") pod \"network-check-target-jk77d\" (UID: \"c21ced6c-bef8-43ac-9688-5c9c67a9de20\") " pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:37.807203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.807125 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4mr26\"" May 21 12:38:37.815396 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:37.815375 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:38.004844 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:38.004811 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jk77d"] May 21 12:38:38.008186 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:38:38.008150 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21ced6c_bef8_43ac_9688_5c9c67a9de20.slice/crio-dc0a01587dd78151eaf7a127ad3aed0b46fa816fa924bc1cef9634a65d2c5b6c WatchSource:0}: Error finding container dc0a01587dd78151eaf7a127ad3aed0b46fa816fa924bc1cef9634a65d2c5b6c: Status 404 returned error can't find the container with id dc0a01587dd78151eaf7a127ad3aed0b46fa816fa924bc1cef9634a65d2c5b6c May 21 12:38:38.218266 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:38.218229 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jk77d" event={"ID":"c21ced6c-bef8-43ac-9688-5c9c67a9de20","Type":"ContainerStarted","Data":"dc0a01587dd78151eaf7a127ad3aed0b46fa816fa924bc1cef9634a65d2c5b6c"} May 21 12:38:41.225667 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:41.225630 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jk77d" event={"ID":"c21ced6c-bef8-43ac-9688-5c9c67a9de20","Type":"ContainerStarted","Data":"11ea02412ce85ea5b8f1429c128af737f10debdfc3a3a83434af42936204eed8"} May 21 12:38:41.226045 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:41.225757 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:38:41.241237 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:38:41.241194 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jk77d" podStartSLOduration=66.629162645 podStartE2EDuration="1m9.24118103s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:38:38.009892665 +0000 UTC m=+66.694994228" lastFinishedPulling="2026-05-21 12:38:40.621911063 +0000 UTC m=+69.307012613" observedRunningTime="2026-05-21 12:38:41.241099844 +0000 UTC m=+69.926201410" watchObservedRunningTime="2026-05-21 12:38:41.24118103 +0000 UTC m=+69.926282598" May 21 12:39:09.053434 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:09.053370 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:39:09.053894 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:09.053509 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 12:39:09.053894 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:09.053527 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:39:09.053894 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:09.053588 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert podName:0f9420ed-249b-44b5-8e42-c35ca1c34616 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:13.05356488 +0000 UTC m=+161.738666430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert") pod "ingress-canary-mcwxl" (UID: "0f9420ed-249b-44b5-8e42-c35ca1c34616") : secret "canary-serving-cert" not found May 21 12:39:09.053894 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:09.053608 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 12:39:09.053894 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:09.053661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls podName:aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd nodeName:}" failed. No retries permitted until 2026-05-21 12:40:13.053649258 +0000 UTC m=+161.738750804 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls") pod "dns-default-65b68" (UID: "aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd") : secret "dns-default-metrics-tls" not found May 21 12:39:12.230020 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:12.229984 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jk77d" May 21 12:39:41.652657 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:41.652611 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:39:41.653168 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:41.652778 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 12:39:41.653168 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:41.652849 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs podName:88e4e2e6-8519-4fb9-addc-d6a3682ed30d nodeName:}" failed. No retries permitted until 2026-05-21 12:41:43.652832395 +0000 UTC m=+252.337933947 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs") pod "network-metrics-daemon-dlzfk" (UID: "88e4e2e6-8519-4fb9-addc-d6a3682ed30d") : secret "metrics-daemon-secret" not found May 21 12:39:55.574834 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.574798 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr"] May 21 12:39:55.577614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.577597 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.580762 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.580739 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd"] May 21 12:39:55.582041 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.582020 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 12:39:55.582135 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.582075 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-td5tz\"" May 21 12:39:55.582135 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.582108 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 12:39:55.582135 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.582127 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 12:39:55.582280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.582134 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 12:39:55.583600 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.583579 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.585599 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.585580 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5flcv\"" May 21 12:39:55.586122 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.586103 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 12:39:55.586205 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.586146 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 12:39:55.586971 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.586955 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 12:39:55.587370 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.587352 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 12:39:55.594394 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.594377 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr"] May 21 12:39:55.606843 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.606819 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd"] May 21 12:39:55.646774 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.646739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33957a72-7a13-4b54-8f25-26aad0fef0d6-config\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.646977 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.646790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42zm\" (UniqueName: \"kubernetes.io/projected/ffec084d-ecb3-4345-b986-7a2e6d255a37-kube-api-access-d42zm\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.646977 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.646876 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.646977 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.646935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33957a72-7a13-4b54-8f25-26aad0fef0d6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.647138 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.646977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ffec084d-ecb3-4345-b986-7a2e6d255a37-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.647138 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.647054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bm4\" (UniqueName: \"kubernetes.io/projected/33957a72-7a13-4b54-8f25-26aad0fef0d6-kube-api-access-76bm4\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.684471 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.684428 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-68d8b964c4-xbwg7"] May 21 12:39:55.687507 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.687490 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:39:55.687658 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.687641 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.690467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.690448 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.691410 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.691395 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 12:39:55.691567 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.691549 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 12:39:55.691931 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.691918 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 12:39:55.692273 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.692253 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 12:39:55.692357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.692276 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 12:39:55.693242 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693224 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sn8hf\"" May 21 12:39:55.693421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693406 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 12:39:55.693590 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693544 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 12:39:55.693590 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693550 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 12:39:55.693734 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693550 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 12:39:55.693843 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.693815 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xr8gl\"" May 21 12:39:55.699199 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.699177 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 12:39:55.705013 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.704993 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68d8b964c4-xbwg7"] May 21 12:39:55.705770 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.705752 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:39:55.747640 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747610 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76bm4\" (UniqueName: \"kubernetes.io/projected/33957a72-7a13-4b54-8f25-26aad0fef0d6-kube-api-access-76bm4\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.747791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.747791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-stats-auth\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.747791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.747791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.747791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747782 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747805 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33957a72-7a13-4b54-8f25-26aad0fef0d6-config\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-default-certificate\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.747999 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d42zm\" (UniqueName: \"kubernetes.io/projected/ffec084d-ecb3-4345-b986-7a2e6d255a37-kube-api-access-d42zm\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbqtg\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748105 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-969lz\" (UniqueName: \"kubernetes.io/projected/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-kube-api-access-969lz\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.748193 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748211 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33957a72-7a13-4b54-8f25-26aad0fef0d6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.748243 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:39:56.248229009 +0000 UTC m=+144.933330556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:39:55.748270 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748270 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ffec084d-ecb3-4345-b986-7a2e6d255a37-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.748614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748384 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33957a72-7a13-4b54-8f25-26aad0fef0d6-config\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.748886 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.748869 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ffec084d-ecb3-4345-b986-7a2e6d255a37-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.750269 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.750254 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33957a72-7a13-4b54-8f25-26aad0fef0d6-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.757019 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.756998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bm4\" (UniqueName: \"kubernetes.io/projected/33957a72-7a13-4b54-8f25-26aad0fef0d6-kube-api-access-76bm4\") pod \"kube-storage-version-migrator-operator-565644f49-xjkbd\" (UID: \"33957a72-7a13-4b54-8f25-26aad0fef0d6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:55.757175 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.757160 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42zm\" (UniqueName: \"kubernetes.io/projected/ffec084d-ecb3-4345-b986-7a2e6d255a37-kube-api-access-d42zm\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:55.849548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849459 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.849548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849499 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-stats-auth\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.849548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849521 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.849548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849538 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849563 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.849645 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849685 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.849707 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:56.349685232 +0000 UTC m=+145.034786786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849747 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-default-certificate\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.849765 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:56.349750098 +0000 UTC m=+145.034851647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:39:55.849825 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849805 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849836 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849892 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849917 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbqtg\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849973 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850215 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.849999 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-969lz\" (UniqueName: \"kubernetes.io/projected/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-kube-api-access-969lz\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.850485 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.850221 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.850485 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.850339 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 12:39:55.850485 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.850352 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d69d57b94-mvckm: secret "image-registry-tls" not found May 21 12:39:55.850485 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:55.850396 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls podName:b0b5f193-9689-4f3f-87eb-9234225c1d1a nodeName:}" failed. No retries permitted until 2026-05-21 12:39:56.350379227 +0000 UTC m=+145.035480787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls") pod "image-registry-6d69d57b94-mvckm" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a") : secret "image-registry-tls" not found May 21 12:39:55.851112 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.851090 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.852138 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.852116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.852394 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.852371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.852510 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.852492 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-default-certificate\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.852564 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.852537 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-stats-auth\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.862027 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.861999 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-969lz\" (UniqueName: \"kubernetes.io/projected/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-kube-api-access-969lz\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:55.863110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.863079 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.864387 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.864371 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbqtg\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:55.893136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:55.893104 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" May 21 12:39:56.010690 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.010658 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd"] May 21 12:39:56.014126 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:39:56.014102 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33957a72_7a13_4b54_8f25_26aad0fef0d6.slice/crio-6dee64237a5eaa0bfe0de2f4cc0d58d5f9d64c98eee99b10e065ee49188fb625 WatchSource:0}: Error finding container 6dee64237a5eaa0bfe0de2f4cc0d58d5f9d64c98eee99b10e065ee49188fb625: Status 404 returned error can't find the container with id 6dee64237a5eaa0bfe0de2f4cc0d58d5f9d64c98eee99b10e065ee49188fb625 May 21 12:39:56.254408 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.254380 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:56.254575 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.254524 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:39:56.254618 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.254590 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:39:57.254574796 +0000 UTC m=+145.939676349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:39:56.355174 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.355136 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:56.355174 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.355175 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:56.355371 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355264 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:39:56.355371 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355305 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:57.355291744 +0000 UTC m=+146.040393290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:39:56.355371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.355302 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:56.355371 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355349 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 12:39:56.355371 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355357 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d69d57b94-mvckm: secret "image-registry-tls" not found May 21 12:39:56.355538 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355381 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls podName:b0b5f193-9689-4f3f-87eb-9234225c1d1a nodeName:}" failed. No retries permitted until 2026-05-21 12:39:57.355371396 +0000 UTC m=+146.040472943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls") pod "image-registry-6d69d57b94-mvckm" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a") : secret "image-registry-tls" not found May 21 12:39:56.355538 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:56.355410 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:57.355395557 +0000 UTC m=+146.040497104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:39:56.359186 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:56.359162 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" event={"ID":"33957a72-7a13-4b54-8f25-26aad0fef0d6","Type":"ContainerStarted","Data":"6dee64237a5eaa0bfe0de2f4cc0d58d5f9d64c98eee99b10e065ee49188fb625"} May 21 12:39:57.262728 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:57.262686 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:57.263195 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.262839 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:39:57.263195 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.262935 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:39:59.262911235 +0000 UTC m=+147.948012781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:39:57.363152 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:57.363118 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:57.363343 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:57.363237 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:57.363343 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:57.363263 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:57.363343 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363280 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 12:39:57.363343 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363300 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d69d57b94-mvckm: secret "image-registry-tls" not found May 21 12:39:57.363523 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363363 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls podName:b0b5f193-9689-4f3f-87eb-9234225c1d1a nodeName:}" failed. No retries permitted until 2026-05-21 12:39:59.36334863 +0000 UTC m=+148.048450177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls") pod "image-registry-6d69d57b94-mvckm" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a") : secret "image-registry-tls" not found May 21 12:39:57.363523 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363376 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:39:57.363523 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363389 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:59.363372951 +0000 UTC m=+148.048474519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:39:57.363523 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:57.363423 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:39:59.363408905 +0000 UTC m=+148.048510455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:39:58.364673 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:58.364586 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" event={"ID":"33957a72-7a13-4b54-8f25-26aad0fef0d6","Type":"ContainerStarted","Data":"6fcd794f499a9a3521b2111a1bc0a483e90df94b0f39ee1d8fe1648adc5f442d"} May 21 12:39:58.384213 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:58.384168 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" podStartSLOduration=1.2884328809999999 podStartE2EDuration="3.384153126s" podCreationTimestamp="2026-05-21 12:39:55 +0000 UTC" firstStartedPulling="2026-05-21 12:39:56.015804597 +0000 UTC m=+144.700906145" lastFinishedPulling="2026-05-21 12:39:58.111524843 +0000 UTC m=+146.796626390" observedRunningTime="2026-05-21 12:39:58.383439599 +0000 UTC m=+147.068541168" watchObservedRunningTime="2026-05-21 12:39:58.384153126 +0000 UTC m=+147.069254695" May 21 12:39:59.279370 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:59.279334 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:39:59.279526 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.279490 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:39:59.279574 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.279557 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.279539866 +0000 UTC m=+151.964641654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:39:59.380086 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:59.380051 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:59.380165 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:39:59.380193 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380200 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380217 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d69d57b94-mvckm: secret "image-registry-tls" not found May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380278 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls podName:b0b5f193-9689-4f3f-87eb-9234225c1d1a nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.380260211 +0000 UTC m=+152.065361778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls") pod "image-registry-6d69d57b94-mvckm" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a") : secret "image-registry-tls" not found May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380283 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380306 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.380291351 +0000 UTC m=+152.065392898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:39:59.380422 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:39:59.380334 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:03.380325478 +0000 UTC m=+152.065427025 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:40:02.983760 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.983727 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-52fh5"] May 21 12:40:02.986227 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.986211 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:02.988670 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.988641 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" May 21 12:40:02.988796 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.988737 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" May 21 12:40:02.988796 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.988765 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" May 21 12:40:02.989505 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.989481 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" May 21 12:40:02.989505 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.989494 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nll4w\"" May 21 12:40:02.997295 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:02.997273 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-52fh5"] May 21 12:40:03.107744 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.107699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fhrn\" (UniqueName: \"kubernetes.io/projected/bb3e51a7-9126-4a36-819a-a20b5ac724bc-kube-api-access-7fhrn\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.107935 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.107764 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-cabundle\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.107935 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.107871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-key\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.209047 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.209010 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-cabundle\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.209143 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.209081 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-key\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.209178 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.209153 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fhrn\" (UniqueName: \"kubernetes.io/projected/bb3e51a7-9126-4a36-819a-a20b5ac724bc-kube-api-access-7fhrn\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.209651 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.209630 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-cabundle\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.211422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.211402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bb3e51a7-9126-4a36-819a-a20b5ac724bc-signing-key\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.217685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.217658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fhrn\" (UniqueName: \"kubernetes.io/projected/bb3e51a7-9126-4a36-819a-a20b5ac724bc-kube-api-access-7fhrn\") pod \"service-ca-67d667c7d-52fh5\" (UID: \"bb3e51a7-9126-4a36-819a-a20b5ac724bc\") " pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.294469 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.294379 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-52fh5" May 21 12:40:03.310497 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.310462 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:40:03.310651 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.310608 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:40:03.310710 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.310675 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:11.310659727 +0000 UTC m=+159.995761274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:40:03.411691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.411658 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:03.411691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.411696 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.411726 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411826 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411838 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d69d57b94-mvckm: secret "image-registry-tls" not found May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411842 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:11.411820137 +0000 UTC m=+160.096921689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411913 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls podName:b0b5f193-9689-4f3f-87eb-9234225c1d1a nodeName:}" failed. No retries permitted until 2026-05-21 12:40:11.411895556 +0000 UTC m=+160.096997126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls") pod "image-registry-6d69d57b94-mvckm" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a") : secret "image-registry-tls" not found May 21 12:40:03.411926 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411918 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:40:03.412144 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:03.411961 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:11.411949326 +0000 UTC m=+160.097050880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:40:03.425394 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.425361 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-52fh5"] May 21 12:40:03.425785 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:03.425764 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27qp6_22d992f2-6055-4f49-b781-a524d13abd8d/dns-node-resolver/0.log" May 21 12:40:03.430498 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:03.430460 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3e51a7_9126_4a36_819a_a20b5ac724bc.slice/crio-eef1fa5aa6d0fc38600aa53f3068506a89eeba58071b12c386e26cb7c1343e61 WatchSource:0}: Error finding container eef1fa5aa6d0fc38600aa53f3068506a89eeba58071b12c386e26cb7c1343e61: Status 404 returned error can't find the container with id eef1fa5aa6d0fc38600aa53f3068506a89eeba58071b12c386e26cb7c1343e61 May 21 12:40:04.377347 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:04.377315 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-52fh5" event={"ID":"bb3e51a7-9126-4a36-819a-a20b5ac724bc","Type":"ContainerStarted","Data":"eef1fa5aa6d0fc38600aa53f3068506a89eeba58071b12c386e26cb7c1343e61"} May 21 12:40:04.619943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:04.619917 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmdc7_fec52138-af6f-48eb-b5e5-def92ba0826c/node-ca/0.log" May 21 12:40:05.380204 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:05.380166 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-52fh5" event={"ID":"bb3e51a7-9126-4a36-819a-a20b5ac724bc","Type":"ContainerStarted","Data":"71d9029d3b02e2f24fab471a54d3200493b7ac2850c00d1caafd8ae98b8d11e0"} May 21 12:40:05.408623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:05.408570 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-52fh5" podStartSLOduration=1.6724607219999998 podStartE2EDuration="3.408557664s" podCreationTimestamp="2026-05-21 12:40:02 +0000 UTC" firstStartedPulling="2026-05-21 12:40:03.432177019 +0000 UTC m=+152.117278565" lastFinishedPulling="2026-05-21 12:40:05.168273955 +0000 UTC m=+153.853375507" observedRunningTime="2026-05-21 12:40:05.408512307 +0000 UTC m=+154.093613875" watchObservedRunningTime="2026-05-21 12:40:05.408557664 +0000 UTC m=+154.093659233" May 21 12:40:06.219551 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:06.219524 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-xjkbd_33957a72-7a13-4b54-8f25-26aad0fef0d6/kube-storage-version-migrator-operator/0.log" May 21 12:40:08.262696 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:08.262647 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mcwxl" podUID="0f9420ed-249b-44b5-8e42-c35ca1c34616" May 21 12:40:08.271868 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:08.271827 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-65b68" podUID="aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd" May 21 12:40:08.386729 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:08.386692 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:40:09.908672 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:09.908633 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dlzfk" podUID="88e4e2e6-8519-4fb9-addc-d6a3682ed30d" May 21 12:40:11.378419 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.378376 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:40:11.378806 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:11.378501 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 12:40:11.378806 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:11.378568 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls podName:ffec084d-ecb3-4345-b986-7a2e6d255a37 nodeName:}" failed. No retries permitted until 2026-05-21 12:40:27.378554788 +0000 UTC m=+176.063656335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-4c7gr" (UID: "ffec084d-ecb3-4345-b986-7a2e6d255a37") : secret "cluster-monitoring-operator-tls" not found May 21 12:40:11.479024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.478968 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:11.479212 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.479043 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:11.479212 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.479091 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:11.479212 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:11.479136 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:27.479114114 +0000 UTC m=+176.164215680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : configmap references non-existent config key: service-ca.crt May 21 12:40:11.479212 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:11.479179 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 12:40:11.479365 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:11.479220 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs podName:4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c nodeName:}" failed. No retries permitted until 2026-05-21 12:40:27.479210915 +0000 UTC m=+176.164312467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs") pod "router-default-68d8b964c4-xbwg7" (UID: "4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c") : secret "router-metrics-certs-default" not found May 21 12:40:11.481479 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.481460 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"image-registry-6d69d57b94-mvckm\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:11.602913 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.602871 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:11.730010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:11.729787 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:40:11.733745 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:11.733713 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b5f193_9689_4f3f_87eb_9234225c1d1a.slice/crio-e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4 WatchSource:0}: Error finding container e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4: Status 404 returned error can't find the container with id e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4 May 21 12:40:12.401315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:12.401275 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" event={"ID":"b0b5f193-9689-4f3f-87eb-9234225c1d1a","Type":"ContainerStarted","Data":"cd131b8ec700bef53fffbc4dc65f5d3c2357d4465f13d38a11bc46ff3cd320ad"} May 21 12:40:12.401315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:12.401317 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" event={"ID":"b0b5f193-9689-4f3f-87eb-9234225c1d1a","Type":"ContainerStarted","Data":"e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4"} May 21 12:40:12.401840 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:12.401457 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:12.421213 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:12.421162 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" podStartSLOduration=17.421149502 podStartE2EDuration="17.421149502s" podCreationTimestamp="2026-05-21 12:39:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:40:12.42017264 +0000 UTC m=+161.105274209" watchObservedRunningTime="2026-05-21 12:40:12.421149502 +0000 UTC m=+161.106251071" May 21 12:40:13.091956 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.091916 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:40:13.092121 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.091974 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:40:13.094192 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.094169 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd-metrics-tls\") pod \"dns-default-65b68\" (UID: \"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd\") " pod="openshift-dns/dns-default-65b68" May 21 12:40:13.094327 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.094310 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f9420ed-249b-44b5-8e42-c35ca1c34616-cert\") pod \"ingress-canary-mcwxl\" (UID: \"0f9420ed-249b-44b5-8e42-c35ca1c34616\") " pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:40:13.190519 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.190488 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m7gww\"" May 21 12:40:13.198515 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.198485 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcwxl" May 21 12:40:13.323765 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.323730 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcwxl"] May 21 12:40:13.327263 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:13.327231 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9420ed_249b_44b5_8e42_c35ca1c34616.slice/crio-041fcb224a21bdec9b36d892a83db967ee3d80981392467e23d0ee6bb7dab5f0 WatchSource:0}: Error finding container 041fcb224a21bdec9b36d892a83db967ee3d80981392467e23d0ee6bb7dab5f0: Status 404 returned error can't find the container with id 041fcb224a21bdec9b36d892a83db967ee3d80981392467e23d0ee6bb7dab5f0 May 21 12:40:13.404595 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:13.404504 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcwxl" event={"ID":"0f9420ed-249b-44b5-8e42-c35ca1c34616","Type":"ContainerStarted","Data":"041fcb224a21bdec9b36d892a83db967ee3d80981392467e23d0ee6bb7dab5f0"} May 21 12:40:15.408467 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:15.408425 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcwxl" event={"ID":"0f9420ed-249b-44b5-8e42-c35ca1c34616","Type":"ContainerStarted","Data":"f5f2b702670c54fe8b951fef633b0a70350ce3eb8711123df9e1854a7d376227"} May 21 12:40:15.428879 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:15.428666 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mcwxl" podStartSLOduration=128.413750551 podStartE2EDuration="2m10.428647559s" podCreationTimestamp="2026-05-21 12:38:05 +0000 UTC" firstStartedPulling="2026-05-21 12:40:13.329144856 +0000 UTC m=+162.014246403" lastFinishedPulling="2026-05-21 12:40:15.344041861 +0000 UTC m=+164.029143411" observedRunningTime="2026-05-21 12:40:15.427538896 +0000 UTC m=+164.112640464" watchObservedRunningTime="2026-05-21 12:40:15.428647559 +0000 UTC m=+164.113749129" May 21 12:40:19.896152 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:19.896124 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65b68" May 21 12:40:19.901255 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:19.901238 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbjhg\"" May 21 12:40:19.907264 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:19.907238 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-65b68" May 21 12:40:20.024581 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:20.024550 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-65b68"] May 21 12:40:20.027404 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:20.027367 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5f3cb9_3916_44b9_9fb6_3e745f0f58bd.slice/crio-cff2fd00e24d6c7c410ac52dd42f7412e3bf8eeadaef708f47cd3069f564edb9 WatchSource:0}: Error finding container cff2fd00e24d6c7c410ac52dd42f7412e3bf8eeadaef708f47cd3069f564edb9: Status 404 returned error can't find the container with id cff2fd00e24d6c7c410ac52dd42f7412e3bf8eeadaef708f47cd3069f564edb9 May 21 12:40:20.418764 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:20.418725 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65b68" event={"ID":"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd","Type":"ContainerStarted","Data":"cff2fd00e24d6c7c410ac52dd42f7412e3bf8eeadaef708f47cd3069f564edb9"} May 21 12:40:21.423142 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:21.423116 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65b68" event={"ID":"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd","Type":"ContainerStarted","Data":"b490a600bdd4ff814f6fc8dd8c84c389de5f597035413ef26a0aefbfeaea9867"} May 21 12:40:21.423506 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:21.423149 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-65b68" event={"ID":"aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd","Type":"ContainerStarted","Data":"fd74782c7708c1dab5a6edbe4c8706a6c6ce0bd864ed2aac11d8bf59d2b5154a"} May 21 12:40:21.423506 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:21.423231 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-65b68" May 21 12:40:21.445168 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:21.445123 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-65b68" podStartSLOduration=135.230244403 podStartE2EDuration="2m16.445109199s" podCreationTimestamp="2026-05-21 12:38:05 +0000 UTC" firstStartedPulling="2026-05-21 12:40:20.029142907 +0000 UTC m=+168.714244453" lastFinishedPulling="2026-05-21 12:40:21.244007684 +0000 UTC m=+169.929109249" observedRunningTime="2026-05-21 12:40:21.444053186 +0000 UTC m=+170.129154755" watchObservedRunningTime="2026-05-21 12:40:21.445109199 +0000 UTC m=+170.130210765" May 21 12:40:21.894556 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:21.894522 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:40:23.225701 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.225669 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gvgpq"] May 21 12:40:23.229013 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.228990 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.230363 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.230342 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-pgzrs"] May 21 12:40:23.232979 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.232962 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:23.234803 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.234781 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 12:40:23.234914 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.234826 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmq2h\"" May 21 12:40:23.234914 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.234805 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 12:40:23.235046 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.235022 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 12:40:23.235102 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.235065 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 12:40:23.237116 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.237098 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 21 12:40:23.237221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.237121 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kzvzz\"" May 21 12:40:23.237726 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.237710 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 21 12:40:23.246628 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.246604 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:40:23.249361 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.249341 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvgpq"] May 21 12:40:23.250042 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.250023 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-pgzrs"] May 21 12:40:23.376402 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376368 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.376402 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376407 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-crio-socket\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.376620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcswm\" (UniqueName: \"kubernetes.io/projected/e76f0f6f-f40d-44af-addd-fc8ecc15748e-kube-api-access-xcswm\") pod \"downloads-57bd96b888-pgzrs\" (UID: \"e76f0f6f-f40d-44af-addd-fc8ecc15748e\") " pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:23.376620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376561 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.376620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-data-volume\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.376717 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.376635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krv6j\" (UniqueName: \"kubernetes.io/projected/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-api-access-krv6j\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477084 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.476996 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477084 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477042 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-data-volume\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477084 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477060 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krv6j\" (UniqueName: \"kubernetes.io/projected/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-api-access-krv6j\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477338 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477090 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477338 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477112 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-crio-socket\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477338 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477132 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcswm\" (UniqueName: \"kubernetes.io/projected/e76f0f6f-f40d-44af-addd-fc8ecc15748e-kube-api-access-xcswm\") pod \"downloads-57bd96b888-pgzrs\" (UID: \"e76f0f6f-f40d-44af-addd-fc8ecc15748e\") " pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:23.477338 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477262 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-crio-socket\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477473 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477420 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-data-volume\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.477662 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.477635 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.479388 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.479367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.492970 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.492942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcswm\" (UniqueName: \"kubernetes.io/projected/e76f0f6f-f40d-44af-addd-fc8ecc15748e-kube-api-access-xcswm\") pod \"downloads-57bd96b888-pgzrs\" (UID: \"e76f0f6f-f40d-44af-addd-fc8ecc15748e\") " pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:23.494911 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.494894 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krv6j\" (UniqueName: \"kubernetes.io/projected/2aecd2e5-52f8-40e2-b3b8-f6e59283db5f-kube-api-access-krv6j\") pod \"insights-runtime-extractor-gvgpq\" (UID: \"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f\") " pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.539017 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.538985 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvgpq" May 21 12:40:23.544810 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.544775 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:23.678453 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.678416 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-pgzrs"] May 21 12:40:23.687635 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:23.687520 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76f0f6f_f40d_44af_addd_fc8ecc15748e.slice/crio-b31245f9dddc893f1ca06bb6dfc1e78c145c9b7c0c9572b8740982f03874c88b WatchSource:0}: Error finding container b31245f9dddc893f1ca06bb6dfc1e78c145c9b7c0c9572b8740982f03874c88b: Status 404 returned error can't find the container with id b31245f9dddc893f1ca06bb6dfc1e78c145c9b7c0c9572b8740982f03874c88b May 21 12:40:23.703042 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:23.702993 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvgpq"] May 21 12:40:23.706097 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:23.706074 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aecd2e5_52f8_40e2_b3b8_f6e59283db5f.slice/crio-bc747e1a75f2041fe9c4ab926201c7d0ea381caa3d4e37262df126034a2d20b0 WatchSource:0}: Error finding container bc747e1a75f2041fe9c4ab926201c7d0ea381caa3d4e37262df126034a2d20b0: Status 404 returned error can't find the container with id bc747e1a75f2041fe9c4ab926201c7d0ea381caa3d4e37262df126034a2d20b0 May 21 12:40:24.435445 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:24.435405 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvgpq" event={"ID":"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f","Type":"ContainerStarted","Data":"a5e0904f75ddec5f0a73696c54303b31c8330b10a42a99a9b7299466ffe8ae8e"} May 21 12:40:24.435445 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:24.435451 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvgpq" event={"ID":"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f","Type":"ContainerStarted","Data":"bc747e1a75f2041fe9c4ab926201c7d0ea381caa3d4e37262df126034a2d20b0"} May 21 12:40:24.436513 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:24.436482 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-pgzrs" event={"ID":"e76f0f6f-f40d-44af-addd-fc8ecc15748e","Type":"ContainerStarted","Data":"b31245f9dddc893f1ca06bb6dfc1e78c145c9b7c0c9572b8740982f03874c88b"} May 21 12:40:25.441678 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:25.441484 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvgpq" event={"ID":"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f","Type":"ContainerStarted","Data":"d9c6d8f2813c45e42e6ad04f38691adc54ba3eb317c2b5d39b1b73af62cc48f0"} May 21 12:40:26.450750 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:26.450715 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvgpq" event={"ID":"2aecd2e5-52f8-40e2-b3b8-f6e59283db5f","Type":"ContainerStarted","Data":"c13f0bd6c8e848dff4224b94aae79dd2c27f1337119e0fe49637ce52a38f52b5"} May 21 12:40:26.470837 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:26.470743 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gvgpq" podStartSLOduration=1.017199866 podStartE2EDuration="3.47072892s" podCreationTimestamp="2026-05-21 12:40:23 +0000 UTC" firstStartedPulling="2026-05-21 12:40:23.760173665 +0000 UTC m=+172.445275214" lastFinishedPulling="2026-05-21 12:40:26.213702707 +0000 UTC m=+174.898804268" observedRunningTime="2026-05-21 12:40:26.469498944 +0000 UTC m=+175.154600510" watchObservedRunningTime="2026-05-21 12:40:26.47072892 +0000 UTC m=+175.155830488" May 21 12:40:27.409165 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.409129 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:40:27.411831 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.411794 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ffec084d-ecb3-4345-b986-7a2e6d255a37-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-4c7gr\" (UID: \"ffec084d-ecb3-4345-b986-7a2e6d255a37\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:40:27.510136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.510086 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:27.510496 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.510169 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:27.510672 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.510648 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-service-ca-bundle\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:27.512376 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.512359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c-metrics-certs\") pod \"router-default-68d8b964c4-xbwg7\" (UID: \"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c\") " pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:27.687541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.687400 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" May 21 12:40:27.797247 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.797209 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:27.826010 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.825983 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr"] May 21 12:40:27.828932 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:27.828908 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffec084d_ecb3_4345_b986_7a2e6d255a37.slice/crio-36a46c3a1713d487acc6f314cf5ea0ddf7a29e0991b606ed8b698e3abd5433ce WatchSource:0}: Error finding container 36a46c3a1713d487acc6f314cf5ea0ddf7a29e0991b606ed8b698e3abd5433ce: Status 404 returned error can't find the container with id 36a46c3a1713d487acc6f314cf5ea0ddf7a29e0991b606ed8b698e3abd5433ce May 21 12:40:27.947353 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:27.947284 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-68d8b964c4-xbwg7"] May 21 12:40:27.950574 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:27.950546 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9c4b1b_2224_4d86_a39d_3b07ddcd9f6c.slice/crio-a29e6804628f99d8d5714c846cacc5d77432167ec4e74ea6803af264c77c9156 WatchSource:0}: Error finding container a29e6804628f99d8d5714c846cacc5d77432167ec4e74ea6803af264c77c9156: Status 404 returned error can't find the container with id a29e6804628f99d8d5714c846cacc5d77432167ec4e74ea6803af264c77c9156 May 21 12:40:28.458132 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.458058 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" event={"ID":"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c","Type":"ContainerStarted","Data":"33ff01a2a7be007f90e1268ad39891c07fd9f60f2d2e8e62c27dbbb316b71eeb"} May 21 12:40:28.458132 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.458105 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" event={"ID":"4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c","Type":"ContainerStarted","Data":"a29e6804628f99d8d5714c846cacc5d77432167ec4e74ea6803af264c77c9156"} May 21 12:40:28.459479 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.459434 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" event={"ID":"ffec084d-ecb3-4345-b986-7a2e6d255a37","Type":"ContainerStarted","Data":"36a46c3a1713d487acc6f314cf5ea0ddf7a29e0991b606ed8b698e3abd5433ce"} May 21 12:40:28.479024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.478973 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" podStartSLOduration=33.478956783 podStartE2EDuration="33.478956783s" podCreationTimestamp="2026-05-21 12:39:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:40:28.478809162 +0000 UTC m=+177.163910732" watchObservedRunningTime="2026-05-21 12:40:28.478956783 +0000 UTC m=+177.164058352" May 21 12:40:28.798357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.798227 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:28.801209 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:28.801186 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:29.462539 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:29.462505 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:29.464542 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:29.464477 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-68d8b964c4-xbwg7" May 21 12:40:30.137777 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.137744 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c"] May 21 12:40:30.140895 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.140872 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:30.149727 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.149650 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8xcxc\"" May 21 12:40:30.149910 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.149883 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 12:40:30.157501 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.157464 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c"] May 21 12:40:30.235920 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.235881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c\" (UID: \"ae672da6-69ba-4e79-a4ea-788b5037067e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:30.337184 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.337151 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c\" (UID: \"ae672da6-69ba-4e79-a4ea-788b5037067e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:30.337351 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:30.337284 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found May 21 12:40:30.337415 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:40:30.337354 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates podName:ae672da6-69ba-4e79-a4ea-788b5037067e nodeName:}" failed. No retries permitted until 2026-05-21 12:40:30.837334796 +0000 UTC m=+179.522436347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" (UID: "ae672da6-69ba-4e79-a4ea-788b5037067e") : secret "prometheus-operator-admission-webhook-tls" not found May 21 12:40:30.467639 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.467598 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" event={"ID":"ffec084d-ecb3-4345-b986-7a2e6d255a37","Type":"ContainerStarted","Data":"c871c0d0ce396d037b3f95fe0460424fa1035f5e84bedd424c1d8af990cbfe41"} May 21 12:40:30.483686 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.483628 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-4c7gr" podStartSLOduration=33.736881743 podStartE2EDuration="35.483609488s" podCreationTimestamp="2026-05-21 12:39:55 +0000 UTC" firstStartedPulling="2026-05-21 12:40:27.830650095 +0000 UTC m=+176.515751642" lastFinishedPulling="2026-05-21 12:40:29.577377829 +0000 UTC m=+178.262479387" observedRunningTime="2026-05-21 12:40:30.48337286 +0000 UTC m=+179.168474431" watchObservedRunningTime="2026-05-21 12:40:30.483609488 +0000 UTC m=+179.168711058" May 21 12:40:30.842940 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.842834 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c\" (UID: \"ae672da6-69ba-4e79-a4ea-788b5037067e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:30.845558 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:30.845530 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ae672da6-69ba-4e79-a4ea-788b5037067e-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c\" (UID: \"ae672da6-69ba-4e79-a4ea-788b5037067e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:31.051127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:31.051089 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:31.192614 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:31.192579 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c"] May 21 12:40:31.196929 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:31.196900 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae672da6_69ba_4e79_a4ea_788b5037067e.slice/crio-545144c510a964c2c510154054766e757836348495791782ac98ba342ac7ed44 WatchSource:0}: Error finding container 545144c510a964c2c510154054766e757836348495791782ac98ba342ac7ed44: Status 404 returned error can't find the container with id 545144c510a964c2c510154054766e757836348495791782ac98ba342ac7ed44 May 21 12:40:31.428694 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:31.428603 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-65b68" May 21 12:40:31.471702 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:31.471662 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" event={"ID":"ae672da6-69ba-4e79-a4ea-788b5037067e","Type":"ContainerStarted","Data":"545144c510a964c2c510154054766e757836348495791782ac98ba342ac7ed44"} May 21 12:40:32.475479 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:32.475449 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" event={"ID":"ae672da6-69ba-4e79-a4ea-788b5037067e","Type":"ContainerStarted","Data":"07d59821c46b3e880e977604da1e266f3bb7af7b39a631cb2a40180dc3531587"} May 21 12:40:32.475822 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:32.475776 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:32.476829 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:32.476801 2560 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.14:8443/healthz\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= May 21 12:40:32.476967 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:32.476873 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" podUID="ae672da6-69ba-4e79-a4ea-788b5037067e" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.14:8443/healthz\": dial tcp 10.134.0.14:8443: connect: connection refused" May 21 12:40:32.491686 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:32.491640 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" podStartSLOduration=1.290072738 podStartE2EDuration="2.491626469s" podCreationTimestamp="2026-05-21 12:40:30 +0000 UTC" firstStartedPulling="2026-05-21 12:40:31.199050069 +0000 UTC m=+179.884151631" lastFinishedPulling="2026-05-21 12:40:32.400603799 +0000 UTC m=+181.085705362" observedRunningTime="2026-05-21 12:40:32.49067854 +0000 UTC m=+181.175780111" watchObservedRunningTime="2026-05-21 12:40:32.491626469 +0000 UTC m=+181.176728037" May 21 12:40:33.252580 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:33.252548 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:33.484085 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:33.484051 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c" May 21 12:40:36.421218 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.421179 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:40:36.425679 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.425654 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.428224 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.428204 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 21 12:40:36.428344 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.428288 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sprtg\"" May 21 12:40:36.428404 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.428345 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 21 12:40:36.429023 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.429003 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 21 12:40:36.429190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.429011 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 21 12:40:36.429190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.429065 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 21 12:40:36.440097 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.440073 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:40:36.594422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594381 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.594422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.594646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcq5\" (UniqueName: \"kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.594646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.594646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.594777 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.594650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.695972 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.695890 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcq5\" (UniqueName: \"kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.695972 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.695934 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.695972 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.695968 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.696241 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.695992 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.696241 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.696166 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.696241 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.696202 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.697584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.697483 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.697584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.697554 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.697584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.697554 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.698797 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.698773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.698924 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.698906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.705050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.705027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcq5\" (UniqueName: \"kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5\") pod \"console-657c478b9f-984fj\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:36.736849 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:36.736820 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:39.653667 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.653550 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px"] May 21 12:40:39.657129 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.657021 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.659496 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.659377 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 12:40:39.659715 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.659700 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 12:40:39.660721 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.660588 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 12:40:39.660721 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.660606 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-njb6q\"" May 21 12:40:39.660905 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.660817 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 12:40:39.670127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.670101 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px"] May 21 12:40:39.674289 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.674270 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z9msx"] May 21 12:40:39.676999 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.676980 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.679720 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.679514 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rnt62\"" May 21 12:40:39.679720 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.679690 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 12:40:39.679883 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.679753 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 12:40:39.680379 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.680043 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 12:40:39.719486 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-metrics-client-ca\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.719648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719529 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b0ef243-afa5-452e-a341-a3a88d858311-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.719648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-root\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719588 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.719802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-sys\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-tls\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68c82\" (UniqueName: \"kubernetes.io/projected/a77b8301-77d7-4375-9e6c-5fb22292ae63-kube-api-access-68c82\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-textfile\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-wtmp\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719990 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.719990 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719840 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smb8c\" (UniqueName: \"kubernetes.io/projected/8b0ef243-afa5-452e-a341-a3a88d858311-kube-api-access-smb8c\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.719990 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.719990 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.719931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.820545 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820509 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-metrics-client-ca\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820561 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.820713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820592 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b0ef243-afa5-452e-a341-a3a88d858311-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.820713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820630 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-root\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820658 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820694 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820720 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-sys\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820744 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-tls\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820775 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68c82\" (UniqueName: \"kubernetes.io/projected/a77b8301-77d7-4375-9e6c-5fb22292ae63-kube-api-access-68c82\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820804 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-textfile\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820829 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-wtmp\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820887 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.820938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-smb8c\" (UniqueName: \"kubernetes.io/projected/8b0ef243-afa5-452e-a341-a3a88d858311-kube-api-access-smb8c\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.821203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.821203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.820986 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.821203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821083 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b0ef243-afa5-452e-a341-a3a88d858311-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.821203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821180 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-metrics-client-ca\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.821430 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821406 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-root\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.821741 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.821817 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821770 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-accelerators-collector-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.822079 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821955 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-wtmp\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.822079 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.821973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a77b8301-77d7-4375-9e6c-5fb22292ae63-sys\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.822576 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.822494 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.822754 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.822643 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-textfile\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.823755 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.823732 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.824156 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.824131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.824225 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.824162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b0ef243-afa5-452e-a341-a3a88d858311-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.825553 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.825529 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a77b8301-77d7-4375-9e6c-5fb22292ae63-node-exporter-tls\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.830028 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.830006 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68c82\" (UniqueName: \"kubernetes.io/projected/a77b8301-77d7-4375-9e6c-5fb22292ae63-kube-api-access-68c82\") pod \"node-exporter-z9msx\" (UID: \"a77b8301-77d7-4375-9e6c-5fb22292ae63\") " pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:39.830789 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.830739 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smb8c\" (UniqueName: \"kubernetes.io/projected/8b0ef243-afa5-452e-a341-a3a88d858311-kube-api-access-smb8c\") pod \"kube-state-metrics-54fd6bc5c4-9s4px\" (UID: \"8b0ef243-afa5-452e-a341-a3a88d858311\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.970525 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.970493 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" May 21 12:40:39.988930 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:39.988905 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z9msx" May 21 12:40:40.712611 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.712575 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:40:40.716348 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.716325 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.722129 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.722053 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 12:40:40.722248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.722124 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 12:40:40.722248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.722124 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 12:40:40.722524 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.722495 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 12:40:40.722607 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.722546 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 12:40:40.723056 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.723036 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 12:40:40.723799 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.723772 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 12:40:40.723912 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.723774 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 12:40:40.725243 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.725222 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 12:40:40.726584 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.726564 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9b7wq\"" May 21 12:40:40.727925 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.727902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728022 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.727946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728022 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.727976 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728022 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728041 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728288 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728288 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728288 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvvr\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728451 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728315 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728451 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728451 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.728451 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.728426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.736989 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.736946 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:40:40.829142 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829107 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.829300 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829152 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvvr\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.829300 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829187 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.829300 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829213 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.829300 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829242 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.829300 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829284 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829589 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829637 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829668 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829699 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829739 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829767 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.829809 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.830231 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.830285 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.830806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.830721 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.832735 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.832710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836006 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.835924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836006 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.835967 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836389 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.836347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836606 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.836555 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836726 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.836713 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.836918 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.836871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.837353 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.837299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.838348 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.838323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:40.839843 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:40.839820 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvvr\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr\") pod \"alertmanager-main-0\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:41.028714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.028633 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:40:41.281471 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:41.281440 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77b8301_77d7_4375_9e6c_5fb22292ae63.slice/crio-afae125830670d0b36bc40950b0617e2c1a5fe62c8d43efaa5c78443c5fe239f WatchSource:0}: Error finding container afae125830670d0b36bc40950b0617e2c1a5fe62c8d43efaa5c78443c5fe239f: Status 404 returned error can't find the container with id afae125830670d0b36bc40950b0617e2c1a5fe62c8d43efaa5c78443c5fe239f May 21 12:40:41.476451 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.476393 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:40:41.478478 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.478451 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:40:41.479756 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:41.479722 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240080fc_2410_46b5_a34d_65afcc509a9d.slice/crio-bef9aea8ae66e696c309a6c57c4f5cee45c5104ce98919aa461c4455fc16d2d7 WatchSource:0}: Error finding container bef9aea8ae66e696c309a6c57c4f5cee45c5104ce98919aa461c4455fc16d2d7: Status 404 returned error can't find the container with id bef9aea8ae66e696c309a6c57c4f5cee45c5104ce98919aa461c4455fc16d2d7 May 21 12:40:41.481423 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:41.481400 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee8d222_acb0_41b1_91e1_d94229e15e69.slice/crio-87be99c4faeb8e47f619865150681c2c24237d2606a6f9e4bf64f4eecd615c09 WatchSource:0}: Error finding container 87be99c4faeb8e47f619865150681c2c24237d2606a6f9e4bf64f4eecd615c09: Status 404 returned error can't find the container with id 87be99c4faeb8e47f619865150681c2c24237d2606a6f9e4bf64f4eecd615c09 May 21 12:40:41.495417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.495395 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px"] May 21 12:40:41.498024 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:41.497998 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0ef243_afa5_452e_a341_a3a88d858311.slice/crio-8493f07ec2575f6c443f71e5f02d365763a2a4abb0f2b56e1ff9770a017f8c6d WatchSource:0}: Error finding container 8493f07ec2575f6c443f71e5f02d365763a2a4abb0f2b56e1ff9770a017f8c6d: Status 404 returned error can't find the container with id 8493f07ec2575f6c443f71e5f02d365763a2a4abb0f2b56e1ff9770a017f8c6d May 21 12:40:41.501254 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.501226 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c478b9f-984fj" event={"ID":"8ee8d222-acb0-41b1-91e1-d94229e15e69","Type":"ContainerStarted","Data":"87be99c4faeb8e47f619865150681c2c24237d2606a6f9e4bf64f4eecd615c09"} May 21 12:40:41.502448 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.502422 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9msx" event={"ID":"a77b8301-77d7-4375-9e6c-5fb22292ae63","Type":"ContainerStarted","Data":"afae125830670d0b36bc40950b0617e2c1a5fe62c8d43efaa5c78443c5fe239f"} May 21 12:40:41.503492 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.503474 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"bef9aea8ae66e696c309a6c57c4f5cee45c5104ce98919aa461c4455fc16d2d7"} May 21 12:40:41.504529 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.504507 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-pgzrs" event={"ID":"e76f0f6f-f40d-44af-addd-fc8ecc15748e","Type":"ContainerStarted","Data":"f3565f35069227fb5933f0c2117e182f555e469ea13375115b30423345a96b0c"} May 21 12:40:41.504820 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.504798 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:41.505829 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.505802 2560 patch_prober.go:28] interesting pod/downloads-57bd96b888-pgzrs container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused" start-of-body= May 21 12:40:41.505923 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.505838 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-pgzrs" podUID="e76f0f6f-f40d-44af-addd-fc8ecc15748e" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.13:8080/\": dial tcp 10.134.0.13:8080: connect: connection refused" May 21 12:40:41.553675 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:41.553562 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-pgzrs" podStartSLOduration=0.857993245 podStartE2EDuration="18.553548487s" podCreationTimestamp="2026-05-21 12:40:23 +0000 UTC" firstStartedPulling="2026-05-21 12:40:23.689593681 +0000 UTC m=+172.374695227" lastFinishedPulling="2026-05-21 12:40:41.385148904 +0000 UTC m=+190.070250469" observedRunningTime="2026-05-21 12:40:41.553206847 +0000 UTC m=+190.238308416" watchObservedRunningTime="2026-05-21 12:40:41.553548487 +0000 UTC m=+190.238650054" May 21 12:40:42.511384 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.511324 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" event={"ID":"8b0ef243-afa5-452e-a341-a3a88d858311","Type":"ContainerStarted","Data":"8493f07ec2575f6c443f71e5f02d365763a2a4abb0f2b56e1ff9770a017f8c6d"} May 21 12:40:42.527590 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.527533 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-pgzrs" May 21 12:40:42.581884 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.581841 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z"] May 21 12:40:42.589466 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.588800 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.592734 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.592391 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 21 12:40:42.593428 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.593194 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-968fpglrgkju5\"" May 21 12:40:42.594351 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.593787 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 21 12:40:42.594351 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.594023 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 21 12:40:42.594351 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.594218 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cv7pc\"" May 21 12:40:42.595118 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.594711 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 21 12:40:42.595118 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.594914 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 21 12:40:42.600937 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.600872 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z"] May 21 12:40:42.652327 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.652287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssw7p\" (UniqueName: \"kubernetes.io/projected/dea271eb-56f1-478f-8716-5cdcd632c55e-kube-api-access-ssw7p\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.652553 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.652536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea271eb-56f1-478f-8716-5cdcd632c55e-metrics-client-ca\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.652691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.652675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.652812 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.652800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-grpc-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.652939 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.652922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.653071 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.653054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.653206 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.653189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.653321 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.653307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754317 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754367 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754414 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754443 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754502 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssw7p\" (UniqueName: \"kubernetes.io/projected/dea271eb-56f1-478f-8716-5cdcd632c55e-kube-api-access-ssw7p\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754534 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea271eb-56f1-478f-8716-5cdcd632c55e-metrics-client-ca\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754581 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.754708 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.754615 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-grpc-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.756679 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.756624 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea271eb-56f1-478f-8716-5cdcd632c55e-metrics-client-ca\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.768577 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.768514 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.771301 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.771240 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.772238 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.772198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.772774 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.772722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.773450 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.773426 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-grpc-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.774088 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.774045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssw7p\" (UniqueName: \"kubernetes.io/projected/dea271eb-56f1-478f-8716-5cdcd632c55e-kube-api-access-ssw7p\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.776263 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.776223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dea271eb-56f1-478f-8716-5cdcd632c55e-secret-thanos-querier-tls\") pod \"thanos-querier-55c4cb47c7-f8w6z\" (UID: \"dea271eb-56f1-478f-8716-5cdcd632c55e\") " pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:42.905944 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:42.905425 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:43.167844 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:43.167469 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z"] May 21 12:40:43.517882 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:43.516971 2560 generic.go:358] "Generic (PLEG): container finished" podID="a77b8301-77d7-4375-9e6c-5fb22292ae63" containerID="1acbf5b680c9749a78ece31c5afb2eacc418ab9e0af8e57e7c23eb6d971ab440" exitCode=0 May 21 12:40:43.517882 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:43.517615 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9msx" event={"ID":"a77b8301-77d7-4375-9e6c-5fb22292ae63","Type":"ContainerDied","Data":"1acbf5b680c9749a78ece31c5afb2eacc418ab9e0af8e57e7c23eb6d971ab440"} May 21 12:40:43.693921 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:43.693870 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea271eb_56f1_478f_8716_5cdcd632c55e.slice/crio-4b6f870872edf755c6f2002070b295012ba44afbd1e00821c21f6d99fb0701b6 WatchSource:0}: Error finding container 4b6f870872edf755c6f2002070b295012ba44afbd1e00821c21f6d99fb0701b6: Status 404 returned error can't find the container with id 4b6f870872edf755c6f2002070b295012ba44afbd1e00821c21f6d99fb0701b6 May 21 12:40:44.107049 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.107018 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d66cf5584-96fjt"] May 21 12:40:44.118501 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.118473 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.122021 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.121735 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-70jjjmlooli1p\"" May 21 12:40:44.122021 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.121987 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 21 12:40:44.122203 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.122175 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 21 12:40:44.122341 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.122315 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d66cf5584-96fjt"] May 21 12:40:44.122486 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.122347 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 21 12:40:44.122622 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.122574 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 21 12:40:44.122701 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.122633 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5grz7\"" May 21 12:40:44.171184 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-client-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171365 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171365 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-tls\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171484 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-metrics-server-audit-profiles\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171484 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp5hp\" (UniqueName: \"kubernetes.io/projected/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-kube-api-access-sp5hp\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171484 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-audit-log\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.171601 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.171498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-client-certs\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272318 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272287 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-client-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272528 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272342 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272528 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272417 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-tls\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272528 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272449 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-metrics-server-audit-profiles\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272528 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272479 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sp5hp\" (UniqueName: \"kubernetes.io/projected/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-kube-api-access-sp5hp\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272528 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272523 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-audit-log\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.272781 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.272555 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-client-certs\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.273340 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.273283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-audit-log\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.274374 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.274328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-metrics-server-audit-profiles\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.275448 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.275405 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-client-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.275601 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.275576 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-client-certs\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.275672 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.275610 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-secret-metrics-server-tls\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.275903 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.275883 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.285812 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.285790 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp5hp\" (UniqueName: \"kubernetes.io/projected/74a4969f-85b1-47ca-b0f0-ce5d8be28d65-kube-api-access-sp5hp\") pod \"metrics-server-d66cf5584-96fjt\" (UID: \"74a4969f-85b1-47ca-b0f0-ce5d8be28d65\") " pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.344231 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.344193 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj"] May 21 12:40:44.370457 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.370381 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj"] May 21 12:40:44.370622 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.370547 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:44.375052 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.373762 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" May 21 12:40:44.375052 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.374073 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-rlrwh\"" May 21 12:40:44.431886 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.431690 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:40:44.475065 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.475001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd306f5-7e41-497a-95a5-4ee4da7d4054-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-jfgjj\" (UID: \"2fd306f5-7e41-497a-95a5-4ee4da7d4054\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:44.521801 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.521757 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"4b6f870872edf755c6f2002070b295012ba44afbd1e00821c21f6d99fb0701b6"} May 21 12:40:44.575526 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.575485 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd306f5-7e41-497a-95a5-4ee4da7d4054-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-jfgjj\" (UID: \"2fd306f5-7e41-497a-95a5-4ee4da7d4054\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:44.579036 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.578715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2fd306f5-7e41-497a-95a5-4ee4da7d4054-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-jfgjj\" (UID: \"2fd306f5-7e41-497a-95a5-4ee4da7d4054\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:44.684117 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:44.684007 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:45.465713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:45.465673 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:40:45.977797 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:45.977751 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:40:45.998104 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:45.998078 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.000898 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.000876 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 12:40:46.001044 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.001018 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 12:40:46.002229 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002204 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4hqqq\"" May 21 12:40:46.002340 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002284 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 12:40:46.002340 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002284 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f355p41r5e0kc\"" May 21 12:40:46.002455 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002417 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 12:40:46.002573 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002551 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 12:40:46.002641 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002597 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 12:40:46.002697 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002682 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 12:40:46.002748 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002700 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 12:40:46.002748 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.002725 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 12:40:46.008222 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.008193 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 12:40:46.013629 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.013604 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 12:40:46.030106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.026221 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:40:46.035718 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.035692 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 12:40:46.090548 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090485 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.090801 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npnbd\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090891 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.090971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091154 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.091609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.091276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195751 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195666 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195751 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195736 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195769 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195799 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npnbd\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195834 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195875 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195902 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.195954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195928 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.195975 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196004 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196030 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196065 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196098 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196133 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196170 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196198 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196248 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196235 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.196690 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.196274 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.201714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.197002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.201714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.200646 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.201714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.200950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.201714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.201337 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.202913 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.202334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.202913 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.202608 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.203070 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.202975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.206511 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.204708 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.206511 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.206250 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.207326 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.207278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.213580 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.209599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.220936 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.220784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.220936 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.220812 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.221523 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.221443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.222202 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.222159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npnbd\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.223492 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.223435 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.224768 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.224731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.231906 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.231833 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.280133 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.279636 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj"] May 21 12:40:46.309758 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.309719 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:40:46.327682 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.327627 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d66cf5584-96fjt"] May 21 12:40:46.338358 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:40:46.338312 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a4969f_85b1_47ca_b0f0_ce5d8be28d65.slice/crio-30c6c9464c299e89da31c38abbe075f6dd91d6badd4aeda6240b82ef3d6886e6 WatchSource:0}: Error finding container 30c6c9464c299e89da31c38abbe075f6dd91d6badd4aeda6240b82ef3d6886e6: Status 404 returned error can't find the container with id 30c6c9464c299e89da31c38abbe075f6dd91d6badd4aeda6240b82ef3d6886e6 May 21 12:40:46.540246 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.539454 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9msx" event={"ID":"a77b8301-77d7-4375-9e6c-5fb22292ae63","Type":"ContainerStarted","Data":"ab9f80806b1305b5adb317a8921d3f573786d1286f64450a30e86821a7e3581e"} May 21 12:40:46.540246 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.539495 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z9msx" event={"ID":"a77b8301-77d7-4375-9e6c-5fb22292ae63","Type":"ContainerStarted","Data":"58c6d89c6106726eec0d8f34c343cf1477fcdd4a6265f16a848ff7523cae1d84"} May 21 12:40:46.541269 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.541201 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" event={"ID":"74a4969f-85b1-47ca-b0f0-ce5d8be28d65","Type":"ContainerStarted","Data":"30c6c9464c299e89da31c38abbe075f6dd91d6badd4aeda6240b82ef3d6886e6"} May 21 12:40:46.544496 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.544444 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8"} May 21 12:40:46.544738 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.543020 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8" exitCode=0 May 21 12:40:46.568666 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.568166 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c478b9f-984fj" event={"ID":"8ee8d222-acb0-41b1-91e1-d94229e15e69","Type":"ContainerStarted","Data":"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f"} May 21 12:40:46.573437 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.573406 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" event={"ID":"8b0ef243-afa5-452e-a341-a3a88d858311","Type":"ContainerStarted","Data":"558915b31289fd71322a09f849077f01168cece644887374c2cdc0d120cc3474"} May 21 12:40:46.573553 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.573446 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" event={"ID":"8b0ef243-afa5-452e-a341-a3a88d858311","Type":"ContainerStarted","Data":"c537272f6dddc5ac3e80a62470b48d09fbee7a57acd4e37bee9d6c9c878b26c8"} May 21 12:40:46.578876 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.578105 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" event={"ID":"2fd306f5-7e41-497a-95a5-4ee4da7d4054","Type":"ContainerStarted","Data":"6f5ec4024b21c93ad3a178d79c63a5d03479e1c2815139631264ef9900c0babf"} May 21 12:40:46.583779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.579575 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z9msx" podStartSLOduration=6.404751841 podStartE2EDuration="7.579559285s" podCreationTimestamp="2026-05-21 12:40:39 +0000 UTC" firstStartedPulling="2026-05-21 12:40:41.312448712 +0000 UTC m=+189.997550259" lastFinishedPulling="2026-05-21 12:40:42.487256142 +0000 UTC m=+191.172357703" observedRunningTime="2026-05-21 12:40:46.569066048 +0000 UTC m=+195.254167618" watchObservedRunningTime="2026-05-21 12:40:46.579559285 +0000 UTC m=+195.264660855" May 21 12:40:46.583779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.580572 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:40:46.595737 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.593977 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-657c478b9f-984fj" podStartSLOduration=5.998761095 podStartE2EDuration="10.593960798s" podCreationTimestamp="2026-05-21 12:40:36 +0000 UTC" firstStartedPulling="2026-05-21 12:40:41.483771471 +0000 UTC m=+190.168873021" lastFinishedPulling="2026-05-21 12:40:46.07897116 +0000 UTC m=+194.764072724" observedRunningTime="2026-05-21 12:40:46.593428385 +0000 UTC m=+195.278529955" watchObservedRunningTime="2026-05-21 12:40:46.593960798 +0000 UTC m=+195.279062369" May 21 12:40:46.737554 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:46.737497 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657c478b9f-984fj" May 21 12:40:47.587791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:47.586606 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd" exitCode=0 May 21 12:40:47.587791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:47.586728 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd"} May 21 12:40:47.587791 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:47.586761 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"8a4e6bcc002a13b6e77f0a0de8e6d864f775735440372f0c098c2a6941cdf600"} May 21 12:40:47.592703 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:47.592677 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" event={"ID":"8b0ef243-afa5-452e-a341-a3a88d858311","Type":"ContainerStarted","Data":"4b9c39aa0570338aeabf72bf7505c890f499533cdb257e2b557c30f5e4662f10"} May 21 12:40:47.659362 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:47.658247 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9s4px" podStartSLOduration=4.085713482 podStartE2EDuration="8.65822734s" podCreationTimestamp="2026-05-21 12:40:39 +0000 UTC" firstStartedPulling="2026-05-21 12:40:41.500377711 +0000 UTC m=+190.185479258" lastFinishedPulling="2026-05-21 12:40:46.072891561 +0000 UTC m=+194.757993116" observedRunningTime="2026-05-21 12:40:47.655944278 +0000 UTC m=+196.341045848" watchObservedRunningTime="2026-05-21 12:40:47.65822734 +0000 UTC m=+196.343328910" May 21 12:40:48.266776 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:48.266729 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" podUID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" containerName="registry" containerID="cri-o://cd131b8ec700bef53fffbc4dc65f5d3c2357d4465f13d38a11bc46ff3cd320ad" gracePeriod=30 May 21 12:40:48.597123 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:48.596961 2560 generic.go:358] "Generic (PLEG): container finished" podID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" containerID="cd131b8ec700bef53fffbc4dc65f5d3c2357d4465f13d38a11bc46ff3cd320ad" exitCode=0 May 21 12:40:48.597123 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:48.597000 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" event={"ID":"b0b5f193-9689-4f3f-87eb-9234225c1d1a","Type":"ContainerDied","Data":"cd131b8ec700bef53fffbc4dc65f5d3c2357d4465f13d38a11bc46ff3cd320ad"} May 21 12:40:50.605836 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.605806 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" event={"ID":"b0b5f193-9689-4f3f-87eb-9234225c1d1a","Type":"ContainerDied","Data":"e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4"} May 21 12:40:50.606232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.605842 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e820ef2708829cd3adbdc0a5afe1235f9bdc26aee530330922055182b2fb54e4" May 21 12:40:50.613193 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.613174 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:50.658985 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.658966 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659073 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659003 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659073 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659066 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659259 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659241 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659274 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbqtg\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659309 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659412 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659366 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:40:50.659465 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659436 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659553 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659469 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca\") pod \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\" (UID: \"b0b5f193-9689-4f3f-87eb-9234225c1d1a\") " May 21 12:40:50.659904 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.659871 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-certificates\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.660056 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.660030 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:40:50.661628 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.661597 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:40:50.661628 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.661613 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:40:50.662080 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.662051 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:40:50.662165 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.662076 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg" (OuterVolumeSpecName: "kube-api-access-sbqtg") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "kube-api-access-sbqtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:40:50.662165 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.662057 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:40:50.668728 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.668705 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b0b5f193-9689-4f3f-87eb-9234225c1d1a" (UID: "b0b5f193-9689-4f3f-87eb-9234225c1d1a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 12:40:50.761371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761344 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-installation-pull-secrets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761374 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b0b5f193-9689-4f3f-87eb-9234225c1d1a-image-registry-private-configuration\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761386 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-registry-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761400 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbqtg\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-kube-api-access-sbqtg\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761412 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0b5f193-9689-4f3f-87eb-9234225c1d1a-bound-sa-token\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761424 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b0b5f193-9689-4f3f-87eb-9234225c1d1a-ca-trust-extracted\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:50.761482 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:50.761435 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b0b5f193-9689-4f3f-87eb-9234225c1d1a-trusted-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:40:51.610959 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.610904 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" event={"ID":"2fd306f5-7e41-497a-95a5-4ee4da7d4054","Type":"ContainerStarted","Data":"9beb37e56e5158aee75ebd02d4ce1eee209b7ea5b9c52f89f928e4a7db82c8a9"} May 21 12:40:51.611387 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.611166 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:51.612581 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.612548 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" event={"ID":"74a4969f-85b1-47ca-b0f0-ce5d8be28d65","Type":"ContainerStarted","Data":"bea90b9c03a58eccc79ee3e54a3c51d7ff73a63d0afd33ffc18b8885b986d3f8"} May 21 12:40:51.614094 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.614068 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"86aab1d9a7837cb9d12c5993d20d7726b72360d6d535afa29da56d1e1152a0fb"} May 21 12:40:51.614197 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.614166 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d69d57b94-mvckm" May 21 12:40:51.616817 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.616789 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" May 21 12:40:51.631822 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.631112 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-jfgjj" podStartSLOduration=3.2805545289999998 podStartE2EDuration="7.631097751s" podCreationTimestamp="2026-05-21 12:40:44 +0000 UTC" firstStartedPulling="2026-05-21 12:40:46.304402605 +0000 UTC m=+194.989504167" lastFinishedPulling="2026-05-21 12:40:50.654945825 +0000 UTC m=+199.340047389" observedRunningTime="2026-05-21 12:40:51.630388531 +0000 UTC m=+200.315490186" watchObservedRunningTime="2026-05-21 12:40:51.631097751 +0000 UTC m=+200.316199321" May 21 12:40:51.657616 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.657567 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" podStartSLOduration=3.359680288 podStartE2EDuration="7.657555422s" podCreationTimestamp="2026-05-21 12:40:44 +0000 UTC" firstStartedPulling="2026-05-21 12:40:46.35374517 +0000 UTC m=+195.038846724" lastFinishedPulling="2026-05-21 12:40:50.651620291 +0000 UTC m=+199.336721858" observedRunningTime="2026-05-21 12:40:51.656736392 +0000 UTC m=+200.341837961" watchObservedRunningTime="2026-05-21 12:40:51.657555422 +0000 UTC m=+200.342656991" May 21 12:40:51.671893 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.671847 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:40:51.677047 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.677025 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d69d57b94-mvckm"] May 21 12:40:51.897562 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:51.897477 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" path="/var/lib/kubelet/pods/b0b5f193-9689-4f3f-87eb-9234225c1d1a/volumes" May 21 12:40:52.629566 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.629251 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50"} May 21 12:40:52.629566 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.629293 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6"} May 21 12:40:52.629566 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.629303 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c"} May 21 12:40:52.629566 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.629312 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744"} May 21 12:40:52.632065 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.632039 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"b7e87934c9ebc9bffe6c54c8ab016938ca93675e32a0fd02daee4004f06e324a"} May 21 12:40:52.632253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.632236 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"5fd7f29a1d313dcb39c4805eb8ccbc1c5671b7e6264091e7b32de1ef0d21e3ac"} May 21 12:40:52.634623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.634600 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d"} May 21 12:40:52.634740 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.634628 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a"} May 21 12:40:52.634740 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:52.634638 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631"} May 21 12:40:53.640905 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:53.640874 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4"} May 21 12:40:53.643581 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:53.643555 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef"} May 21 12:40:53.643748 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:53.643585 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88"} May 21 12:40:53.643748 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:53.643595 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerStarted","Data":"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1"} May 21 12:40:53.696221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:53.693716 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.059351306 podStartE2EDuration="8.693699123s" podCreationTimestamp="2026-05-21 12:40:45 +0000 UTC" firstStartedPulling="2026-05-21 12:40:47.59438533 +0000 UTC m=+196.279486882" lastFinishedPulling="2026-05-21 12:40:52.228733139 +0000 UTC m=+200.913834699" observedRunningTime="2026-05-21 12:40:53.692502572 +0000 UTC m=+202.377604141" watchObservedRunningTime="2026-05-21 12:40:53.693699123 +0000 UTC m=+202.378800693" May 21 12:40:54.649939 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.649901 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerStarted","Data":"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9"} May 21 12:40:54.652471 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.652448 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"3920f3a4ea0d3ba06496b3e355a0ffb750fcf114d9a7a0206193a7999fde92b3"} May 21 12:40:54.652573 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.652477 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"78af4bbb06311698e9719516fec1c7f6730a5863fbbc17cb0601b916bf2bc750"} May 21 12:40:54.652573 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.652487 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" event={"ID":"dea271eb-56f1-478f-8716-5cdcd632c55e","Type":"ContainerStarted","Data":"59d1ff72c0bc598d58c97a087e303c93d80eb563cf5adc3379162d755f85e96a"} May 21 12:40:54.652644 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.652597 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:40:54.681905 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.681824 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.548024556 podStartE2EDuration="14.6817956s" podCreationTimestamp="2026-05-21 12:40:40 +0000 UTC" firstStartedPulling="2026-05-21 12:40:41.482342379 +0000 UTC m=+190.167443946" lastFinishedPulling="2026-05-21 12:40:53.616113439 +0000 UTC m=+202.301214990" observedRunningTime="2026-05-21 12:40:54.677682531 +0000 UTC m=+203.362784100" watchObservedRunningTime="2026-05-21 12:40:54.6817956 +0000 UTC m=+203.366897175" May 21 12:40:54.703123 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:54.703059 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" podStartSLOduration=2.7835757880000003 podStartE2EDuration="12.703041481s" podCreationTimestamp="2026-05-21 12:40:42 +0000 UTC" firstStartedPulling="2026-05-21 12:40:43.696014902 +0000 UTC m=+192.381116460" lastFinishedPulling="2026-05-21 12:40:53.615480606 +0000 UTC m=+202.300582153" observedRunningTime="2026-05-21 12:40:54.701586479 +0000 UTC m=+203.386688048" watchObservedRunningTime="2026-05-21 12:40:54.703041481 +0000 UTC m=+203.388143053" May 21 12:40:56.309963 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:40:56.309924 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:41:00.660957 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:00.660928 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55c4cb47c7-f8w6z" May 21 12:41:04.432712 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:04.432678 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:41:04.433096 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:04.432757 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:41:11.619310 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.619270 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-657c478b9f-984fj" podUID="8ee8d222-acb0-41b1-91e1-d94229e15e69" containerName="console" containerID="cri-o://762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f" gracePeriod=15 May 21 12:41:11.867509 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.867487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657c478b9f-984fj_8ee8d222-acb0-41b1-91e1-d94229e15e69/console/0.log" May 21 12:41:11.867634 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.867556 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c478b9f-984fj" May 21 12:41:11.962073 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962049 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpcq5\" (UniqueName: \"kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962107 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962178 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962221 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962197 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962389 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962227 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962389 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962243 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config\") pod \"8ee8d222-acb0-41b1-91e1-d94229e15e69\" (UID: \"8ee8d222-acb0-41b1-91e1-d94229e15e69\") " May 21 12:41:11.962609 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962575 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config" (OuterVolumeSpecName: "console-config") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:41:11.962715 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962598 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:41:11.962715 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.962625 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:41:11.964338 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.964310 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:41:11.964417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.964357 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:41:11.964453 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:11.964426 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5" (OuterVolumeSpecName: "kube-api-access-wpcq5") pod "8ee8d222-acb0-41b1-91e1-d94229e15e69" (UID: "8ee8d222-acb0-41b1-91e1-d94229e15e69"). InnerVolumeSpecName "kube-api-access-wpcq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:41:12.063190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063140 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-oauth-serving-cert\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.063190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063184 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-serving-cert\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.063190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063197 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-service-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.063190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063206 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-oauth-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.063440 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063216 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpcq5\" (UniqueName: \"kubernetes.io/projected/8ee8d222-acb0-41b1-91e1-d94229e15e69-kube-api-access-wpcq5\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.063440 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.063226 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee8d222-acb0-41b1-91e1-d94229e15e69-console-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:41:12.705092 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705062 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-657c478b9f-984fj_8ee8d222-acb0-41b1-91e1-d94229e15e69/console/0.log" May 21 12:41:12.705533 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705100 2560 generic.go:358] "Generic (PLEG): container finished" podID="8ee8d222-acb0-41b1-91e1-d94229e15e69" containerID="762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f" exitCode=2 May 21 12:41:12.705533 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705173 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657c478b9f-984fj" May 21 12:41:12.705533 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705181 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c478b9f-984fj" event={"ID":"8ee8d222-acb0-41b1-91e1-d94229e15e69","Type":"ContainerDied","Data":"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f"} May 21 12:41:12.705533 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705207 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657c478b9f-984fj" event={"ID":"8ee8d222-acb0-41b1-91e1-d94229e15e69","Type":"ContainerDied","Data":"87be99c4faeb8e47f619865150681c2c24237d2606a6f9e4bf64f4eecd615c09"} May 21 12:41:12.705533 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.705221 2560 scope.go:117] "RemoveContainer" containerID="762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f" May 21 12:41:12.713675 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.713657 2560 scope.go:117] "RemoveContainer" containerID="762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f" May 21 12:41:12.713936 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:41:12.713912 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f\": container with ID starting with 762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f not found: ID does not exist" containerID="762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f" May 21 12:41:12.714034 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.713941 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f"} err="failed to get container status \"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f\": rpc error: code = NotFound desc = could not find container \"762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f\": container with ID starting with 762c1bf1b786bc584e75608dd01f63c57fc37f3363f1537ef257fba34ae0a12f not found: ID does not exist" May 21 12:41:12.725919 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.725895 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:41:12.730572 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:12.730551 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657c478b9f-984fj"] May 21 12:41:13.901529 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:13.901494 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee8d222-acb0-41b1-91e1-d94229e15e69" path="/var/lib/kubelet/pods/8ee8d222-acb0-41b1-91e1-d94229e15e69/volumes" May 21 12:41:24.437481 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:24.437450 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:41:24.441333 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:24.441309 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d66cf5584-96fjt" May 21 12:41:29.757200 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:29.757166 2560 generic.go:358] "Generic (PLEG): container finished" podID="33957a72-7a13-4b54-8f25-26aad0fef0d6" containerID="6fcd794f499a9a3521b2111a1bc0a483e90df94b0f39ee1d8fe1648adc5f442d" exitCode=0 May 21 12:41:29.757663 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:29.757218 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" event={"ID":"33957a72-7a13-4b54-8f25-26aad0fef0d6","Type":"ContainerDied","Data":"6fcd794f499a9a3521b2111a1bc0a483e90df94b0f39ee1d8fe1648adc5f442d"} May 21 12:41:29.757663 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:29.757555 2560 scope.go:117] "RemoveContainer" containerID="6fcd794f499a9a3521b2111a1bc0a483e90df94b0f39ee1d8fe1648adc5f442d" May 21 12:41:30.762816 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:30.762785 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-xjkbd" event={"ID":"33957a72-7a13-4b54-8f25-26aad0fef0d6","Type":"ContainerStarted","Data":"90b2d7a2bda40678778ec1e395f635c74ee91b99f0c398c90456a3eeaeeb577a"} May 21 12:41:43.730988 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:43.730942 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:41:43.733188 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:43.733156 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88e4e2e6-8519-4fb9-addc-d6a3682ed30d-metrics-certs\") pod \"network-metrics-daemon-dlzfk\" (UID: \"88e4e2e6-8519-4fb9-addc-d6a3682ed30d\") " pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:41:43.797676 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:43.797647 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsngm\"" May 21 12:41:43.805051 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:43.805027 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dlzfk" May 21 12:41:43.937794 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:43.937759 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dlzfk"] May 21 12:41:43.941146 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:41:43.941119 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e4e2e6_8519_4fb9_addc_d6a3682ed30d.slice/crio-3ee72861138bf8401d0f93822f8fe7ea5f618951b6070ee477786b2c94b81dbc WatchSource:0}: Error finding container 3ee72861138bf8401d0f93822f8fe7ea5f618951b6070ee477786b2c94b81dbc: Status 404 returned error can't find the container with id 3ee72861138bf8401d0f93822f8fe7ea5f618951b6070ee477786b2c94b81dbc May 21 12:41:44.810653 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:44.810618 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlzfk" event={"ID":"88e4e2e6-8519-4fb9-addc-d6a3682ed30d","Type":"ContainerStarted","Data":"3ee72861138bf8401d0f93822f8fe7ea5f618951b6070ee477786b2c94b81dbc"} May 21 12:41:45.815032 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:45.814998 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlzfk" event={"ID":"88e4e2e6-8519-4fb9-addc-d6a3682ed30d","Type":"ContainerStarted","Data":"63dfabc7da6d91c8b8deba37d5ba8808f95ad4939cfb2818e5b69a85fc5f361e"} May 21 12:41:45.815032 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:45.815034 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dlzfk" event={"ID":"88e4e2e6-8519-4fb9-addc-d6a3682ed30d","Type":"ContainerStarted","Data":"36903849c03f63aa077cf4d23ea79a052feaa7a6c0db3b6db2f85d78775bea0b"} May 21 12:41:45.834982 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:45.834927 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dlzfk" podStartSLOduration=252.86647529 podStartE2EDuration="4m13.834914127s" podCreationTimestamp="2026-05-21 12:37:32 +0000 UTC" firstStartedPulling="2026-05-21 12:41:43.943118679 +0000 UTC m=+252.628220228" lastFinishedPulling="2026-05-21 12:41:44.911557518 +0000 UTC m=+253.596659065" observedRunningTime="2026-05-21 12:41:45.83227021 +0000 UTC m=+254.517371778" watchObservedRunningTime="2026-05-21 12:41:45.834914127 +0000 UTC m=+254.520015696" May 21 12:41:46.310513 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:46.310472 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:41:46.325931 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:46.325905 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:41:46.832465 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:41:46.832438 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:00.173094 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173014 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:00.173570 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173449 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="alertmanager" containerID="cri-o://c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744" gracePeriod=120 May 21 12:42:00.173570 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173501 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-metric" containerID="cri-o://38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4" gracePeriod=120 May 21 12:42:00.173685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173549 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="prom-label-proxy" containerID="cri-o://a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9" gracePeriod=120 May 21 12:42:00.173685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173584 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="config-reloader" containerID="cri-o://818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c" gracePeriod=120 May 21 12:42:00.173685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173603 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy" containerID="cri-o://0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50" gracePeriod=120 May 21 12:42:00.173685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.173562 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-web" containerID="cri-o://1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6" gracePeriod=120 May 21 12:42:00.861039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861007 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9" exitCode=0 May 21 12:42:00.861039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861035 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4" exitCode=0 May 21 12:42:00.861039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861042 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50" exitCode=0 May 21 12:42:00.861039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861049 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c" exitCode=0 May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861054 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744" exitCode=0 May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861079 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9"} May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861120 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4"} May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861136 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50"} May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861148 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c"} May 21 12:42:00.861314 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:00.861160 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744"} May 21 12:42:01.423164 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.423141 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:01.597369 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597278 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597369 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597336 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597369 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597356 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597376 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597396 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597412 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597436 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597462 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597518 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597555 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597582 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.597649 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597611 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.598132 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597673 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzvvr\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr\") pod \"240080fc-2410-46b5-a34d-65afcc509a9d\" (UID: \"240080fc-2410-46b5-a34d-65afcc509a9d\") " May 21 12:42:01.598132 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597798 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:01.598132 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.597988 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-metrics-client-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.598556 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.598525 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 12:42:01.598643 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.598547 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:01.600344 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.600303 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume" (OuterVolumeSpecName: "config-volume") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.600488 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.600435 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:42:01.600872 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.600812 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.601173 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.601145 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.601277 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.601232 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out" (OuterVolumeSpecName: "config-out") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 12:42:01.601337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.601305 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.601392 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.601326 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.601900 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.601877 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr" (OuterVolumeSpecName: "kube-api-access-tzvvr") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "kube-api-access-tzvvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:42:01.605980 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.605899 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.612622 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.612595 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config" (OuterVolumeSpecName: "web-config") pod "240080fc-2410-46b5-a34d-65afcc509a9d" (UID: "240080fc-2410-46b5-a34d-65afcc509a9d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:01.699176 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699138 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-tls-assets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699176 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699172 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699176 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699183 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-web-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699192 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-cluster-tls-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699202 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-config-volume\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699210 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-main-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699220 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699229 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-alertmanager-main-db\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699238 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/240080fc-2410-46b5-a34d-65afcc509a9d-config-out\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699247 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699256 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzvvr\" (UniqueName: \"kubernetes.io/projected/240080fc-2410-46b5-a34d-65afcc509a9d-kube-api-access-tzvvr\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.699417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.699264 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/240080fc-2410-46b5-a34d-65afcc509a9d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:01.866620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.866540 2560 generic.go:358] "Generic (PLEG): container finished" podID="240080fc-2410-46b5-a34d-65afcc509a9d" containerID="1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6" exitCode=0 May 21 12:42:01.866620 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.866577 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6"} May 21 12:42:01.866812 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.866627 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"240080fc-2410-46b5-a34d-65afcc509a9d","Type":"ContainerDied","Data":"bef9aea8ae66e696c309a6c57c4f5cee45c5104ce98919aa461c4455fc16d2d7"} May 21 12:42:01.866812 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.866648 2560 scope.go:117] "RemoveContainer" containerID="a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9" May 21 12:42:01.866812 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.866651 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:01.877187 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.877152 2560 scope.go:117] "RemoveContainer" containerID="38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4" May 21 12:42:01.885923 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.885819 2560 scope.go:117] "RemoveContainer" containerID="0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50" May 21 12:42:01.894545 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.894524 2560 scope.go:117] "RemoveContainer" containerID="1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6" May 21 12:42:01.901060 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.901036 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:01.901198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.901066 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:01.903473 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.903452 2560 scope.go:117] "RemoveContainer" containerID="818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c" May 21 12:42:01.910684 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.910664 2560 scope.go:117] "RemoveContainer" containerID="c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744" May 21 12:42:01.917740 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.917718 2560 scope.go:117] "RemoveContainer" containerID="5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8" May 21 12:42:01.925059 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925039 2560 scope.go:117] "RemoveContainer" containerID="a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9" May 21 12:42:01.925360 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.925337 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9\": container with ID starting with a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9 not found: ID does not exist" containerID="a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9" May 21 12:42:01.925410 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925370 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9"} err="failed to get container status \"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9\": rpc error: code = NotFound desc = could not find container \"a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9\": container with ID starting with a672d4fea070688fed8ec0fcb471038044a11d56060c3f50d09ca6589442bcd9 not found: ID does not exist" May 21 12:42:01.925410 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925390 2560 scope.go:117] "RemoveContainer" containerID="38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4" May 21 12:42:01.925653 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.925636 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4\": container with ID starting with 38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4 not found: ID does not exist" containerID="38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4" May 21 12:42:01.925695 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925659 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4"} err="failed to get container status \"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4\": rpc error: code = NotFound desc = could not find container \"38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4\": container with ID starting with 38b6accd482e35d7567f5db1b1eafdfea9848124880f539580a2620b77bb1dc4 not found: ID does not exist" May 21 12:42:01.925695 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925675 2560 scope.go:117] "RemoveContainer" containerID="0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50" May 21 12:42:01.925933 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.925914 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50\": container with ID starting with 0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50 not found: ID does not exist" containerID="0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50" May 21 12:42:01.925981 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925937 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50"} err="failed to get container status \"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50\": rpc error: code = NotFound desc = could not find container \"0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50\": container with ID starting with 0308d22090a9f3acac5653194e471ed2cbed4c19bf54274d2eb404acda56cb50 not found: ID does not exist" May 21 12:42:01.925981 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.925952 2560 scope.go:117] "RemoveContainer" containerID="1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6" May 21 12:42:01.926202 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.926181 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6\": container with ID starting with 1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6 not found: ID does not exist" containerID="1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6" May 21 12:42:01.926306 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926204 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6"} err="failed to get container status \"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6\": rpc error: code = NotFound desc = could not find container \"1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6\": container with ID starting with 1b176fbf4e93da00ef04c9f348ea34fa7c132fb733c1fa7bf3bb17548165a0a6 not found: ID does not exist" May 21 12:42:01.926306 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926219 2560 scope.go:117] "RemoveContainer" containerID="818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c" May 21 12:42:01.926424 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.926408 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c\": container with ID starting with 818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c not found: ID does not exist" containerID="818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c" May 21 12:42:01.926463 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926430 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c"} err="failed to get container status \"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c\": rpc error: code = NotFound desc = could not find container \"818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c\": container with ID starting with 818cfdb8a74ae794ac7d160c0c576e4429d90c60eec0126f7eda65cfbf735d8c not found: ID does not exist" May 21 12:42:01.926463 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926444 2560 scope.go:117] "RemoveContainer" containerID="c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744" May 21 12:42:01.926623 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.926608 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744\": container with ID starting with c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744 not found: ID does not exist" containerID="c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744" May 21 12:42:01.926667 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926626 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744"} err="failed to get container status \"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744\": rpc error: code = NotFound desc = could not find container \"c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744\": container with ID starting with c52c45934e35aabc1053cb9e81b9b080894b29553ef7edc5d7b43434d6b03744 not found: ID does not exist" May 21 12:42:01.926667 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926637 2560 scope.go:117] "RemoveContainer" containerID="5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8" May 21 12:42:01.926977 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:01.926848 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8\": container with ID starting with 5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8 not found: ID does not exist" containerID="5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8" May 21 12:42:01.927042 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.926983 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8"} err="failed to get container status \"5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8\": rpc error: code = NotFound desc = could not find container \"5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8\": container with ID starting with 5908cf6c155c264f3eb3d3df7f15e6b023facc117479fa675fc968ace9ea2aa8 not found: ID does not exist" May 21 12:42:01.930317 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930293 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:01.930605 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930593 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="alertmanager" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="alertmanager" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930617 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="prom-label-proxy" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930622 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="prom-label-proxy" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930631 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="init-config-reloader" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930636 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="init-config-reloader" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930644 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="config-reloader" May 21 12:42:01.930646 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930649 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="config-reloader" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930657 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930662 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930674 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee8d222-acb0-41b1-91e1-d94229e15e69" containerName="console" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930679 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee8d222-acb0-41b1-91e1-d94229e15e69" containerName="console" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930686 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-web" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930691 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-web" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930699 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-metric" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930703 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-metric" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930711 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" containerName="registry" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930716 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" containerName="registry" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930761 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="alertmanager" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930770 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="config-reloader" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930781 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="prom-label-proxy" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930791 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b0b5f193-9689-4f3f-87eb-9234225c1d1a" containerName="registry" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930799 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930808 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-web" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930817 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" containerName="kube-rbac-proxy-metric" May 21 12:42:01.930842 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.930828 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ee8d222-acb0-41b1-91e1-d94229e15e69" containerName="console" May 21 12:42:01.934532 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.934514 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:01.936998 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.936972 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 21 12:42:01.937110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.936972 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 21 12:42:01.937110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937031 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9b7wq\"" May 21 12:42:01.937110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937099 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 21 12:42:01.937265 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937060 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 21 12:42:01.937265 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937102 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 21 12:42:01.937512 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937496 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 21 12:42:01.937598 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937556 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 21 12:42:01.937661 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.937626 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 21 12:42:01.942462 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.942433 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 21 12:42:01.953162 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:01.953132 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:02.102422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-out\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102422 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-web-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcncj\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-kube-api-access-hcncj\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102623 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102746 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102746 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102746 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102703 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102746 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102746 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102743 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102909 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.102909 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.102833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204328 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204227 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204328 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204271 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204328 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204296 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204328 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204315 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204353 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-out\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204372 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204401 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-web-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204429 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcncj\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-kube-api-access-hcncj\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204463 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204496 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204522 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204549 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.204660 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204569 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.205135 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.204909 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.205231 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.205208 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.205867 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.205827 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207452 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207427 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207574 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-out\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-web-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207648 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207752 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.207923 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.207906 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.208253 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.208238 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.209369 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.209347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.214252 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.214228 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcncj\" (UniqueName: \"kubernetes.io/projected/f78ace98-fb3f-41d3-b1d2-e2625f356fd8-kube-api-access-hcncj\") pod \"alertmanager-main-0\" (UID: \"f78ace98-fb3f-41d3-b1d2-e2625f356fd8\") " pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.245040 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.245000 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 21 12:42:02.402838 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.402794 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 21 12:42:02.406762 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:42:02.406733 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78ace98_fb3f_41d3_b1d2_e2625f356fd8.slice/crio-a72a6d262a731a1e71a865034aacffc5bfbe4e35e231a3ce0a4ee26f7fcf7a6d WatchSource:0}: Error finding container a72a6d262a731a1e71a865034aacffc5bfbe4e35e231a3ce0a4ee26f7fcf7a6d: Status 404 returned error can't find the container with id a72a6d262a731a1e71a865034aacffc5bfbe4e35e231a3ce0a4ee26f7fcf7a6d May 21 12:42:02.871550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.871463 2560 generic.go:358] "Generic (PLEG): container finished" podID="f78ace98-fb3f-41d3-b1d2-e2625f356fd8" containerID="cb8688005419a0fa764cf5a8881b16cff61c44144d1ff531c1b7ea4e5af58dc8" exitCode=0 May 21 12:42:02.871550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.871510 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerDied","Data":"cb8688005419a0fa764cf5a8881b16cff61c44144d1ff531c1b7ea4e5af58dc8"} May 21 12:42:02.871550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:02.871546 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"a72a6d262a731a1e71a865034aacffc5bfbe4e35e231a3ce0a4ee26f7fcf7a6d"} May 21 12:42:03.877350 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877317 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"c127bee540535a6967101d7e4b325ec031eb45a1649e7bd6becb5e5ad52923ae"} May 21 12:42:03.877350 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877350 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"805e00632c4c74734d4340730a576e6ccdd291184b667a4888f0d7bcc132994a"} May 21 12:42:03.877745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877359 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"5bfc1d632e7d564fbb7b98c515cfd6a9482908a151747c036dc5e1d1892b2dd1"} May 21 12:42:03.877745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877368 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"c8659afc9b5c205646c383a06c7716d67b8ad2252360f281dc8b944f9de23ab4"} May 21 12:42:03.877745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877376 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"07a4fa7275d6fdc7ca35a3b0d124497b208798aa055b2441d0b32cde79c60938"} May 21 12:42:03.877745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.877384 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f78ace98-fb3f-41d3-b1d2-e2625f356fd8","Type":"ContainerStarted","Data":"3860bc9b165afc6f01ed0521e91f04964293ce78b69fc0959b7288780116d4b5"} May 21 12:42:03.897324 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.897291 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="240080fc-2410-46b5-a34d-65afcc509a9d" path="/var/lib/kubelet/pods/240080fc-2410-46b5-a34d-65afcc509a9d/volumes" May 21 12:42:03.905290 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:03.905237 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.905221491 podStartE2EDuration="2.905221491s" podCreationTimestamp="2026-05-21 12:42:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:42:03.90350723 +0000 UTC m=+272.588608825" watchObservedRunningTime="2026-05-21 12:42:03.905221491 +0000 UTC m=+272.590323060" May 21 12:42:04.378315 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378275 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:04.378779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378682 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" containerID="cri-o://db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" gracePeriod=600 May 21 12:42:04.378779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378713 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy" containerID="cri-o://1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88" gracePeriod=600 May 21 12:42:04.378779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378738 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-web" containerID="cri-o://050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1" gracePeriod=600 May 21 12:42:04.378779 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378769 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef" gracePeriod=600 May 21 12:42:04.379153 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378719 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="thanos-sidecar" containerID="cri-o://18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d" gracePeriod=600 May 21 12:42:04.379153 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.378741 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="config-reloader" containerID="cri-o://0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a" gracePeriod=600 May 21 12:42:04.883322 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883289 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1" exitCode=0 May 21 12:42:04.883322 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883316 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d" exitCode=0 May 21 12:42:04.883322 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883322 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a" exitCode=0 May 21 12:42:04.883747 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883362 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1"} May 21 12:42:04.883747 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883395 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d"} May 21 12:42:04.883747 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:04.883408 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a"} May 21 12:42:05.889024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:05.888989 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef" exitCode=0 May 21 12:42:05.889024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:05.889016 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88" exitCode=0 May 21 12:42:05.889417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:05.889057 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef"} May 21 12:42:05.889417 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:05.889089 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88"} May 21 12:42:06.819827 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:06.819787 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:06.820739 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:06.820706 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:06.821521 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:06.821494 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:06.821620 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:06.821538 2560 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" probeResult="unknown" May 21 12:42:11.819661 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:11.819620 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:11.820558 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:11.820531 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:11.821315 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:11.821292 2560 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] May 21 12:42:11.821400 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:11.821324 2560 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" probeResult="unknown" May 21 12:42:12.417063 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.417036 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.491680 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491582 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.491680 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491619 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npnbd\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.491680 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491642 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.491680 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491664 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.491680 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491680 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491705 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491738 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491766 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491794 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491817 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491844 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491902 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491937 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.491968 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492005 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492050 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492049 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492104 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492136 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0\") pod \"954e1d92-c55b-49a6-9d10-42dae0d322ac\" (UID: \"954e1d92-c55b-49a6-9d10-42dae0d322ac\") " May 21 12:42:12.492541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492164 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:12.492541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.492394 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.494012 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.493048 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:12.494012 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.493319 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:12.494012 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.493743 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:12.494012 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.493932 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:42:12.494355 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.494170 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 12:42:12.495630 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.495587 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config" (OuterVolumeSpecName: "config") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.496183 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.496152 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.496263 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.496180 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd" (OuterVolumeSpecName: "kube-api-access-npnbd") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "kube-api-access-npnbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:42:12.497004 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.496977 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out" (OuterVolumeSpecName: "config-out") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 12:42:12.497289 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.497255 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.497550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.497515 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.497775 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.497739 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:42:12.497908 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.497767 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.497976 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.497905 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.498130 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.498103 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.498647 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.498622 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.509399 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.509370 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config" (OuterVolumeSpecName: "web-config") pod "954e1d92-c55b-49a6-9d10-42dae0d322ac" (UID: "954e1d92-c55b-49a6-9d10-42dae0d322ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:42:12.593064 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593026 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593064 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593058 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593064 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593069 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593081 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-tls-assets\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593090 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593100 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-db\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593109 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-metrics-client-certs\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593118 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-grpc-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593126 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593134 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-metrics-client-ca\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593142 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/954e1d92-c55b-49a6-9d10-42dae0d322ac-config-out\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593153 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593161 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-kube-rbac-proxy\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593170 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-web-config\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593178 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/954e1d92-c55b-49a6-9d10-42dae0d322ac-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593186 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/954e1d92-c55b-49a6-9d10-42dae0d322ac-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.593280 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.593195 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npnbd\" (UniqueName: \"kubernetes.io/projected/954e1d92-c55b-49a6-9d10-42dae0d322ac-kube-api-access-npnbd\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:42:12.911724 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.911644 2560 generic.go:358] "Generic (PLEG): container finished" podID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" exitCode=0 May 21 12:42:12.911724 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.911704 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631"} May 21 12:42:12.912120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.911731 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"954e1d92-c55b-49a6-9d10-42dae0d322ac","Type":"ContainerDied","Data":"8a4e6bcc002a13b6e77f0a0de8e6d864f775735440372f0c098c2a6941cdf600"} May 21 12:42:12.912120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.911747 2560 scope.go:117] "RemoveContainer" containerID="6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef" May 21 12:42:12.912120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.911755 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.919669 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.919646 2560 scope.go:117] "RemoveContainer" containerID="1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88" May 21 12:42:12.926232 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.926211 2560 scope.go:117] "RemoveContainer" containerID="050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1" May 21 12:42:12.932382 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.932365 2560 scope.go:117] "RemoveContainer" containerID="18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d" May 21 12:42:12.936995 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.936976 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:12.939134 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.939120 2560 scope.go:117] "RemoveContainer" containerID="0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a" May 21 12:42:12.945214 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.945199 2560 scope.go:117] "RemoveContainer" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" May 21 12:42:12.952262 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.952236 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:12.952476 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.952460 2560 scope.go:117] "RemoveContainer" containerID="8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd" May 21 12:42:12.958541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.958524 2560 scope.go:117] "RemoveContainer" containerID="6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef" May 21 12:42:12.958813 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.958790 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef\": container with ID starting with 6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef not found: ID does not exist" containerID="6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef" May 21 12:42:12.958883 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.958827 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef"} err="failed to get container status \"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef\": rpc error: code = NotFound desc = could not find container \"6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef\": container with ID starting with 6f46add2c8549ecb39119d9de3936413a12ce5f98edb90da4b8eeda66bf31eef not found: ID does not exist" May 21 12:42:12.958883 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.958868 2560 scope.go:117] "RemoveContainer" containerID="1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88" May 21 12:42:12.959132 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.959114 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88\": container with ID starting with 1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88 not found: ID does not exist" containerID="1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88" May 21 12:42:12.959171 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959138 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88"} err="failed to get container status \"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88\": rpc error: code = NotFound desc = could not find container \"1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88\": container with ID starting with 1d715654b8925bad38462c98bdfdcb7b5791d122b4079b002052ea9cc86c6d88 not found: ID does not exist" May 21 12:42:12.959171 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959156 2560 scope.go:117] "RemoveContainer" containerID="050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1" May 21 12:42:12.959388 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.959370 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1\": container with ID starting with 050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1 not found: ID does not exist" containerID="050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1" May 21 12:42:12.959435 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959392 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1"} err="failed to get container status \"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1\": rpc error: code = NotFound desc = could not find container \"050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1\": container with ID starting with 050f0fc459e659707edd2189e124dde98f08b4373d3958b343acd464429b5fa1 not found: ID does not exist" May 21 12:42:12.959435 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959406 2560 scope.go:117] "RemoveContainer" containerID="18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d" May 21 12:42:12.959598 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.959584 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d\": container with ID starting with 18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d not found: ID does not exist" containerID="18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d" May 21 12:42:12.959633 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959601 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d"} err="failed to get container status \"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d\": rpc error: code = NotFound desc = could not find container \"18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d\": container with ID starting with 18140ac83b03618f16158de136ffb36a201d91ce0458910465f7c91cf47b819d not found: ID does not exist" May 21 12:42:12.959633 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959614 2560 scope.go:117] "RemoveContainer" containerID="0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a" May 21 12:42:12.959816 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.959802 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a\": container with ID starting with 0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a not found: ID does not exist" containerID="0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a" May 21 12:42:12.959868 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959819 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a"} err="failed to get container status \"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a\": rpc error: code = NotFound desc = could not find container \"0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a\": container with ID starting with 0a8653c62a77f2903f12198da43b480a4c66914f024624a0913c82d3df11895a not found: ID does not exist" May 21 12:42:12.959868 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.959832 2560 scope.go:117] "RemoveContainer" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" May 21 12:42:12.960057 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.960040 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631\": container with ID starting with db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631 not found: ID does not exist" containerID="db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631" May 21 12:42:12.960109 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.960059 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631"} err="failed to get container status \"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631\": rpc error: code = NotFound desc = could not find container \"db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631\": container with ID starting with db2903ce4e9f551ec008a92c4040b6d4a09a03ac1a6d487a58d2c13ca72b7631 not found: ID does not exist" May 21 12:42:12.960109 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.960070 2560 scope.go:117] "RemoveContainer" containerID="8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd" May 21 12:42:12.960295 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:42:12.960280 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd\": container with ID starting with 8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd not found: ID does not exist" containerID="8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd" May 21 12:42:12.960341 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.960299 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd"} err="failed to get container status \"8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd\": rpc error: code = NotFound desc = could not find container \"8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd\": container with ID starting with 8a15991621d2c4cc84777f7ff88d4a22e5e2fe2979c3214a278cfd9087d78bcd not found: ID does not exist" May 21 12:42:12.984169 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984137 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:12.984579 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984564 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="init-config-reloader" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984582 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="init-config-reloader" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984598 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984607 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984617 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="config-reloader" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984626 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="config-reloader" May 21 12:42:12.984637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984635 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="thanos-sidecar" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984643 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="thanos-sidecar" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984652 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-thanos" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984660 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-thanos" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984673 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-web" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984681 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-web" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984703 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984711 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984773 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="config-reloader" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984786 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-thanos" May 21 12:42:12.984802 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984798 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy-web" May 21 12:42:12.985078 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984808 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="prometheus" May 21 12:42:12.985078 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984821 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="thanos-sidecar" May 21 12:42:12.985078 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.984831 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" containerName="kube-rbac-proxy" May 21 12:42:12.988954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.988931 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.994806 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.994785 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 21 12:42:12.995088 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995066 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 21 12:42:12.995289 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995272 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 21 12:42:12.995550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995390 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 21 12:42:12.995550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995307 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f355p41r5e0kc\"" May 21 12:42:12.995550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995351 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 21 12:42:12.995550 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995359 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4hqqq\"" May 21 12:42:12.995803 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995755 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 21 12:42:12.995883 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995833 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 21 12:42:12.995999 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.995979 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 21 12:42:12.996364 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996343 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 21 12:42:12.996621 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj9rx\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-kube-api-access-rj9rx\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996820 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.996954 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996922 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.996966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997048 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997120 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997106 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:12.997356 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:12.997129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.000769 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.000751 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 21 12:42:13.002611 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.002595 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 21 12:42:13.005813 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.005793 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 21 12:42:13.007439 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.007420 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:13.097703 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097672 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097703 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097706 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097934 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097725 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rj9rx\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-kube-api-access-rj9rx\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097934 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097918 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097995 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097940 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097995 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097970 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.097995 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.097992 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098009 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098038 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098062 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098102 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098136 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098132 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098158 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098180 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098208 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098254 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098280 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.098371 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.098331 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.099228 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.099198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.099771 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.099734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.100227 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.100173 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.100227 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.100196 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.100494 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.100467 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.101152 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.101128 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-web-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102017 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b53426a7-d4ee-4d78-b297-55766fa6674c-config-out\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102026 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b53426a7-d4ee-4d78-b297-55766fa6674c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102498 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102469 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-config\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102767 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102734 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102767 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102964 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102761 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.102964 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.102874 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.103095 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.103077 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.103155 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.103114 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.103308 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.103291 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.103669 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.103653 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b53426a7-d4ee-4d78-b297-55766fa6674c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.107227 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.107210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj9rx\" (UniqueName: \"kubernetes.io/projected/b53426a7-d4ee-4d78-b297-55766fa6674c-kube-api-access-rj9rx\") pod \"prometheus-k8s-0\" (UID: \"b53426a7-d4ee-4d78-b297-55766fa6674c\") " pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.298113 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.298084 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:13.432015 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.431980 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 21 12:42:13.435687 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:42:13.435661 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53426a7_d4ee_4d78_b297_55766fa6674c.slice/crio-3aa7e649416bdd61cf2af0144e0d918c3688f1d8127d6081404169eb491ddf76 WatchSource:0}: Error finding container 3aa7e649416bdd61cf2af0144e0d918c3688f1d8127d6081404169eb491ddf76: Status 404 returned error can't find the container with id 3aa7e649416bdd61cf2af0144e0d918c3688f1d8127d6081404169eb491ddf76 May 21 12:42:13.899924 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.899823 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="954e1d92-c55b-49a6-9d10-42dae0d322ac" path="/var/lib/kubelet/pods/954e1d92-c55b-49a6-9d10-42dae0d322ac/volumes" May 21 12:42:13.916519 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.916484 2560 generic.go:358] "Generic (PLEG): container finished" podID="b53426a7-d4ee-4d78-b297-55766fa6674c" containerID="4ddcae4d36bc2c0dd99fb6f4e5755571225bfd3d693085d4eb12b7c35cee6980" exitCode=0 May 21 12:42:13.916872 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.916523 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerDied","Data":"4ddcae4d36bc2c0dd99fb6f4e5755571225bfd3d693085d4eb12b7c35cee6980"} May 21 12:42:13.916872 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:13.916542 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"3aa7e649416bdd61cf2af0144e0d918c3688f1d8127d6081404169eb491ddf76"} May 21 12:42:14.922535 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922499 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"a65d9732fce626a6b15d1c6a09aaadab61f4a23774d73218b1ced2e6c65d0951"} May 21 12:42:14.922535 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922538 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"8776165d5d6abeb3d3c721fa3ebc885cc9a841925a5bc06b3797962c423ccf32"} May 21 12:42:14.923039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922548 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"84556f824bb69fcefb4147c612240ccd3eebd0ad299230beb6eab39cce687671"} May 21 12:42:14.923039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922556 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"1f59c4cfaf7fe1ab6f9fa5ca626fe62ff9fc2d7b9475e5311e3d78ec12b3a1bc"} May 21 12:42:14.923039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922564 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"909e4c722af66f565c835492686ff65fca13e245864c75019d92aed7557ce4af"} May 21 12:42:14.923039 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.922574 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b53426a7-d4ee-4d78-b297-55766fa6674c","Type":"ContainerStarted","Data":"98861f1c9a9e6f75f2e0f09511c83ab2bd473840bed4c5aa1eb5082f7cfc0a0b"} May 21 12:42:14.956939 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:14.956882 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.956837573 podStartE2EDuration="2.956837573s" podCreationTimestamp="2026-05-21 12:42:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 12:42:14.954264924 +0000 UTC m=+283.639366508" watchObservedRunningTime="2026-05-21 12:42:14.956837573 +0000 UTC m=+283.641939143" May 21 12:42:18.298832 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:18.298794 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:42:31.795787 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:31.795758 2560 kubelet.go:1628] "Image garbage collection succeeded" May 21 12:42:37.258685 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.258645 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5z4lr"] May 21 12:42:37.261244 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.261228 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.265541 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.265523 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 12:42:37.272570 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.272548 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5z4lr"] May 21 12:42:37.412432 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.412388 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-dbus\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.412603 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.412449 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-kubelet-config\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.412603 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.412499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18fb1e14-c911-4786-9bc1-74856f71b2ae-original-pull-secret\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.512944 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.512835 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-kubelet-config\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.512944 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.512937 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18fb1e14-c911-4786-9bc1-74856f71b2ae-original-pull-secret\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.513117 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.512969 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-kubelet-config\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.513117 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.512979 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-dbus\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.513184 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.513118 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18fb1e14-c911-4786-9bc1-74856f71b2ae-dbus\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.515153 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.515126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18fb1e14-c911-4786-9bc1-74856f71b2ae-original-pull-secret\") pod \"global-pull-secret-syncer-5z4lr\" (UID: \"18fb1e14-c911-4786-9bc1-74856f71b2ae\") " pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.570291 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.570264 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5z4lr" May 21 12:42:37.704176 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.704145 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5z4lr"] May 21 12:42:37.709358 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:42:37.709320 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fb1e14_c911_4786_9bc1_74856f71b2ae.slice/crio-9404378d05548d7eb52ec9cffb44cefab7086f5ca469a1924886cf41eb432e13 WatchSource:0}: Error finding container 9404378d05548d7eb52ec9cffb44cefab7086f5ca469a1924886cf41eb432e13: Status 404 returned error can't find the container with id 9404378d05548d7eb52ec9cffb44cefab7086f5ca469a1924886cf41eb432e13 May 21 12:42:37.710989 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.710968 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 12:42:37.989313 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:37.989280 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5z4lr" event={"ID":"18fb1e14-c911-4786-9bc1-74856f71b2ae","Type":"ContainerStarted","Data":"9404378d05548d7eb52ec9cffb44cefab7086f5ca469a1924886cf41eb432e13"} May 21 12:42:42.003745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:42.003702 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5z4lr" event={"ID":"18fb1e14-c911-4786-9bc1-74856f71b2ae","Type":"ContainerStarted","Data":"f6f34f957eb86006c26cae962a8967be5b73f99bc2c7693f2c7df83430a37314"} May 21 12:42:42.026110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:42:42.026059 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5z4lr" podStartSLOduration=1.051310002 podStartE2EDuration="5.026041502s" podCreationTimestamp="2026-05-21 12:42:37 +0000 UTC" firstStartedPulling="2026-05-21 12:42:37.711091812 +0000 UTC m=+306.396193358" lastFinishedPulling="2026-05-21 12:42:41.685823298 +0000 UTC m=+310.370924858" observedRunningTime="2026-05-21 12:42:42.025290289 +0000 UTC m=+310.710391860" watchObservedRunningTime="2026-05-21 12:42:42.026041502 +0000 UTC m=+310.711143072" May 21 12:43:13.298913 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:43:13.298847 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:43:13.314202 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:43:13.314177 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:43:14.113600 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:43:14.113565 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 21 12:44:01.525651 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.525613 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk"] May 21 12:44:01.528942 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.528907 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.532401 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.532375 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgw88\"" May 21 12:44:01.532535 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.532432 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 12:44:01.532535 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.532479 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 12:44:01.532780 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.532760 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 12:44:01.532902 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.532883 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 12:44:01.552938 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.552903 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk"] May 21 12:44:01.621327 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.621291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.621493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.621341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74d9k\" (UniqueName: \"kubernetes.io/projected/a62d0320-d5e0-498e-a459-e8debb3204da-kube-api-access-74d9k\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.621493 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.621377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.721972 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.721930 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74d9k\" (UniqueName: \"kubernetes.io/projected/a62d0320-d5e0-498e-a459-e8debb3204da-kube-api-access-74d9k\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.722162 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.721990 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.722162 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.722048 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.724511 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.724482 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-webhook-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.724621 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.724520 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a62d0320-d5e0-498e-a459-e8debb3204da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.731036 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.731005 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74d9k\" (UniqueName: \"kubernetes.io/projected/a62d0320-d5e0-498e-a459-e8debb3204da-kube-api-access-74d9k\") pod \"opendatahub-operator-controller-manager-84556f689c-fhglk\" (UID: \"a62d0320-d5e0-498e-a459-e8debb3204da\") " pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:01.840217 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:01.840126 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:02.035576 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:02.035547 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk"] May 21 12:44:02.038008 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:44:02.037981 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62d0320_d5e0_498e_a459_e8debb3204da.slice/crio-3acb25a0c7b55613cb4bd948559738945f696beba2ff6fc12c7cb802fa0df853 WatchSource:0}: Error finding container 3acb25a0c7b55613cb4bd948559738945f696beba2ff6fc12c7cb802fa0df853: Status 404 returned error can't find the container with id 3acb25a0c7b55613cb4bd948559738945f696beba2ff6fc12c7cb802fa0df853 May 21 12:44:02.237825 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:02.237789 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" event={"ID":"a62d0320-d5e0-498e-a459-e8debb3204da","Type":"ContainerStarted","Data":"3acb25a0c7b55613cb4bd948559738945f696beba2ff6fc12c7cb802fa0df853"} May 21 12:44:05.251929 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.251887 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" event={"ID":"a62d0320-d5e0-498e-a459-e8debb3204da","Type":"ContainerStarted","Data":"26ef35356e6b38a327b1452ed42560322ad7f7632ae2c8f8d2c86e8c05035f7a"} May 21 12:44:05.252296 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.252002 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:05.283146 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.283101 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" podStartSLOduration=1.743277881 podStartE2EDuration="4.283087626s" podCreationTimestamp="2026-05-21 12:44:01 +0000 UTC" firstStartedPulling="2026-05-21 12:44:02.040330818 +0000 UTC m=+390.725432364" lastFinishedPulling="2026-05-21 12:44:04.580140548 +0000 UTC m=+393.265242109" observedRunningTime="2026-05-21 12:44:05.28190325 +0000 UTC m=+393.967004820" watchObservedRunningTime="2026-05-21 12:44:05.283087626 +0000 UTC m=+393.968189195" May 21 12:44:05.787921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.787887 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-557877f599-jtrbz"] May 21 12:44:05.791413 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.791394 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.794004 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.793981 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pz9rz\"" May 21 12:44:05.794114 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.794050 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 21 12:44:05.794114 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.794053 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 21 12:44:05.794224 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.794163 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 21 12:44:05.797961 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.797760 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 21 12:44:05.800516 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.800500 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 21 12:44:05.815106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.815084 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-557877f599-jtrbz"] May 21 12:44:05.860032 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.860007 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs67l\" (UniqueName: \"kubernetes.io/projected/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-kube-api-access-cs67l\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.860141 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.860064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-manager-config\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.860141 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.860117 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.860211 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.860151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-metrics-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.960906 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.960873 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-metrics-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.961075 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.960925 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cs67l\" (UniqueName: \"kubernetes.io/projected/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-kube-api-access-cs67l\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.961075 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.960984 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-manager-config\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.961075 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.961030 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.961604 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.961579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-manager-config\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.963265 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.963245 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-metrics-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.963345 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.963286 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-cert\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:05.981554 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:05.981532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs67l\" (UniqueName: \"kubernetes.io/projected/9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af-kube-api-access-cs67l\") pod \"lws-controller-manager-557877f599-jtrbz\" (UID: \"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af\") " pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:06.100651 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:06.100569 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:06.243108 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:06.243072 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-557877f599-jtrbz"] May 21 12:44:06.246220 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:44:06.246194 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b48bbbe_4f6f_4190_bb4d_ed6cc42c87af.slice/crio-5295cbe5a6cb784fe9138b091c356ac65bedb074090b716f06c98045cdbb3e8b WatchSource:0}: Error finding container 5295cbe5a6cb784fe9138b091c356ac65bedb074090b716f06c98045cdbb3e8b: Status 404 returned error can't find the container with id 5295cbe5a6cb784fe9138b091c356ac65bedb074090b716f06c98045cdbb3e8b May 21 12:44:06.255901 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:06.255878 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" event={"ID":"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af","Type":"ContainerStarted","Data":"5295cbe5a6cb784fe9138b091c356ac65bedb074090b716f06c98045cdbb3e8b"} May 21 12:44:09.268896 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:09.268801 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" event={"ID":"9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af","Type":"ContainerStarted","Data":"da6fb8eff9a54cf0e252ef3d44824905a8867792bbd5a6d65b4ca67bd37db139"} May 21 12:44:09.269227 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:09.268910 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:09.289352 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:09.289298 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" podStartSLOduration=1.8646845170000002 podStartE2EDuration="4.289282921s" podCreationTimestamp="2026-05-21 12:44:05 +0000 UTC" firstStartedPulling="2026-05-21 12:44:06.248040003 +0000 UTC m=+394.933141549" lastFinishedPulling="2026-05-21 12:44:08.672638406 +0000 UTC m=+397.357739953" observedRunningTime="2026-05-21 12:44:09.287882139 +0000 UTC m=+397.972983703" watchObservedRunningTime="2026-05-21 12:44:09.289282921 +0000 UTC m=+397.974384488" May 21 12:44:16.258701 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:16.258667 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84556f689c-fhglk" May 21 12:44:19.183594 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.183558 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7"] May 21 12:44:19.187105 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.187083 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.189800 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.189775 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 12:44:19.190637 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.190622 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ptzpn\"" May 21 12:44:19.190733 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.190623 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 12:44:19.210343 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.210316 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7"] May 21 12:44:19.280985 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.280945 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dfns\" (UniqueName: \"kubernetes.io/projected/97c3fdfa-9135-4083-9993-a2871dc09069-kube-api-access-2dfns\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.281141 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.281059 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c3fdfa-9135-4083-9993-a2871dc09069-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.281141 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.281078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97c3fdfa-9135-4083-9993-a2871dc09069-tmp\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.382515 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.382478 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dfns\" (UniqueName: \"kubernetes.io/projected/97c3fdfa-9135-4083-9993-a2871dc09069-kube-api-access-2dfns\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.382690 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.382565 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c3fdfa-9135-4083-9993-a2871dc09069-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.382690 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.382582 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97c3fdfa-9135-4083-9993-a2871dc09069-tmp\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.384771 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.384737 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97c3fdfa-9135-4083-9993-a2871dc09069-tmp\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.384996 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.384979 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97c3fdfa-9135-4083-9993-a2871dc09069-tls-certs\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.399592 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.399571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dfns\" (UniqueName: \"kubernetes.io/projected/97c3fdfa-9135-4083-9993-a2871dc09069-kube-api-access-2dfns\") pod \"kube-auth-proxy-7485fd7bf5-gdpf7\" (UID: \"97c3fdfa-9135-4083-9993-a2871dc09069\") " pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.496070 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.496041 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" May 21 12:44:19.631651 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:19.631619 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7"] May 21 12:44:19.633078 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:44:19.633053 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c3fdfa_9135_4083_9993_a2871dc09069.slice/crio-061088c7a0f0185a2272dcfbcb01f27be300f6f54c7fadad6abf96ab557d1123 WatchSource:0}: Error finding container 061088c7a0f0185a2272dcfbcb01f27be300f6f54c7fadad6abf96ab557d1123: Status 404 returned error can't find the container with id 061088c7a0f0185a2272dcfbcb01f27be300f6f54c7fadad6abf96ab557d1123 May 21 12:44:20.274921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:20.274887 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-557877f599-jtrbz" May 21 12:44:20.305564 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:20.305528 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" event={"ID":"97c3fdfa-9135-4083-9993-a2871dc09069","Type":"ContainerStarted","Data":"061088c7a0f0185a2272dcfbcb01f27be300f6f54c7fadad6abf96ab557d1123"} May 21 12:44:24.320288 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:24.320246 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" event={"ID":"97c3fdfa-9135-4083-9993-a2871dc09069","Type":"ContainerStarted","Data":"aab73ceb55af26b735c312075b3c67951fbe53595ba5885b44d279fa8f4fa4e5"} May 21 12:44:24.339254 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:44:24.339208 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7485fd7bf5-gdpf7" podStartSLOduration=1.525329944 podStartE2EDuration="5.339194286s" podCreationTimestamp="2026-05-21 12:44:19 +0000 UTC" firstStartedPulling="2026-05-21 12:44:19.634776223 +0000 UTC m=+408.319877770" lastFinishedPulling="2026-05-21 12:44:23.448640562 +0000 UTC m=+412.133742112" observedRunningTime="2026-05-21 12:44:24.338982977 +0000 UTC m=+413.024084548" watchObservedRunningTime="2026-05-21 12:44:24.339194286 +0000 UTC m=+413.024295925" May 21 12:45:58.063744 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.063709 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj"] May 21 12:45:58.066894 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.066874 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.069195 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.069171 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" May 21 12:45:58.069593 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.069569 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" May 21 12:45:58.069727 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.069614 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 12:45:58.070177 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.070142 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-67dfr\"" May 21 12:45:58.070484 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.070468 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 12:45:58.074286 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.074260 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj"] May 21 12:45:58.168421 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.168385 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.168583 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.168519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.168583 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.168565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6tqb\" (UniqueName: \"kubernetes.io/projected/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-kube-api-access-q6tqb\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.270040 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.270004 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.270200 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.270042 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6tqb\" (UniqueName: \"kubernetes.io/projected/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-kube-api-access-q6tqb\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.270200 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.270078 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.270200 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:45:58.270146 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found May 21 12:45:58.270314 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:45:58.270215 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert podName:58f9a889-c2ec-4237-a9d6-307a8f6ba7c7 nodeName:}" failed. No retries permitted until 2026-05-21 12:45:58.770196799 +0000 UTC m=+507.455298353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-6flsj" (UID: "58f9a889-c2ec-4237-a9d6-307a8f6ba7c7") : secret "plugin-serving-cert" not found May 21 12:45:58.270750 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.270733 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.279449 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.279428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6tqb\" (UniqueName: \"kubernetes.io/projected/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-kube-api-access-q6tqb\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.774562 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.774529 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.776942 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.776912 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/58f9a889-c2ec-4237-a9d6-307a8f6ba7c7-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-6flsj\" (UID: \"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:58.987348 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:58.987314 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" May 21 12:45:59.119556 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:59.119438 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj"] May 21 12:45:59.121846 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:45:59.121820 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58f9a889_c2ec_4237_a9d6_307a8f6ba7c7.slice/crio-d22a511d57bed74e2d8c68a53bd3c934a4e2ed23f3e2eefae714c3f667561e02 WatchSource:0}: Error finding container d22a511d57bed74e2d8c68a53bd3c934a4e2ed23f3e2eefae714c3f667561e02: Status 404 returned error can't find the container with id d22a511d57bed74e2d8c68a53bd3c934a4e2ed23f3e2eefae714c3f667561e02 May 21 12:45:59.625943 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:45:59.625908 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" event={"ID":"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7","Type":"ContainerStarted","Data":"d22a511d57bed74e2d8c68a53bd3c934a4e2ed23f3e2eefae714c3f667561e02"} May 21 12:46:21.710472 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:21.710441 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" event={"ID":"58f9a889-c2ec-4237-a9d6-307a8f6ba7c7","Type":"ContainerStarted","Data":"a62671b171d711cc32c7a852ed5d0bf9c1309fcbbf9d15a9964f4d04054f9805"} May 21 12:46:31.821329 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:31.821298 2560 scope.go:117] "RemoveContainer" containerID="cd131b8ec700bef53fffbc4dc65f5d3c2357d4465f13d38a11bc46ff3cd320ad" May 21 12:46:42.313783 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.313722 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-6flsj" podStartSLOduration=21.835796262 podStartE2EDuration="44.313701881s" podCreationTimestamp="2026-05-21 12:45:58 +0000 UTC" firstStartedPulling="2026-05-21 12:45:59.12321244 +0000 UTC m=+507.808313990" lastFinishedPulling="2026-05-21 12:46:21.601118062 +0000 UTC m=+530.286219609" observedRunningTime="2026-05-21 12:46:21.735543802 +0000 UTC m=+530.420645370" watchObservedRunningTime="2026-05-21 12:46:42.313701881 +0000 UTC m=+550.998803450" May 21 12:46:42.314731 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.314695 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:42.332663 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.332635 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:42.332809 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.332741 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.335627 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.335608 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 12:46:42.417490 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.417459 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:42.484247 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.484212 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v545z\" (UniqueName: \"kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.484405 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.484258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.585099 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.585007 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v545z\" (UniqueName: \"kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.585099 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.585060 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.585606 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.585587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.593659 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.593632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v545z\" (UniqueName: \"kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z\") pod \"limitador-limitador-7d549b5b-h9dzd\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.642491 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.642451 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:42.776200 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:42.776176 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:42.778713 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:46:42.778675 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf0bb0f_3616_4ef9_b43c_aeeb1a07d8b6.slice/crio-0d685bd5306cb8f8b8baef34c96cf472cc188226be3f6a36bf1c1a0c2015c600 WatchSource:0}: Error finding container 0d685bd5306cb8f8b8baef34c96cf472cc188226be3f6a36bf1c1a0c2015c600: Status 404 returned error can't find the container with id 0d685bd5306cb8f8b8baef34c96cf472cc188226be3f6a36bf1c1a0c2015c600 May 21 12:46:43.713686 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.713645 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:46:43.727887 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.727846 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:46:43.728052 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.727972 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:46:43.731183 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.731093 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-87pqn\"" May 21 12:46:43.785924 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.785881 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" event={"ID":"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6","Type":"ContainerStarted","Data":"0d685bd5306cb8f8b8baef34c96cf472cc188226be3f6a36bf1c1a0c2015c600"} May 21 12:46:43.896323 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.896288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn2hk\" (UniqueName: \"kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk\") pod \"authorino-7498df8756-bp8zj\" (UID: \"03cea59b-12ca-4945-9869-a66cb271c7cb\") " pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:46:43.996994 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:43.996912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fn2hk\" (UniqueName: \"kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk\") pod \"authorino-7498df8756-bp8zj\" (UID: \"03cea59b-12ca-4945-9869-a66cb271c7cb\") " pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:46:44.005357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:44.005328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn2hk\" (UniqueName: \"kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk\") pod \"authorino-7498df8756-bp8zj\" (UID: \"03cea59b-12ca-4945-9869-a66cb271c7cb\") " pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:46:44.041782 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:44.041750 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:46:44.172798 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:44.172771 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:46:45.179867 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:46:45.179823 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03cea59b_12ca_4945_9869_a66cb271c7cb.slice/crio-feedafce6e6a6a383c5d36c20e83e79adcf268cc72dbaed3ba45ba2f643632d1 WatchSource:0}: Error finding container feedafce6e6a6a383c5d36c20e83e79adcf268cc72dbaed3ba45ba2f643632d1: Status 404 returned error can't find the container with id feedafce6e6a6a383c5d36c20e83e79adcf268cc72dbaed3ba45ba2f643632d1 May 21 12:46:45.794194 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:45.794149 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bp8zj" event={"ID":"03cea59b-12ca-4945-9869-a66cb271c7cb","Type":"ContainerStarted","Data":"feedafce6e6a6a383c5d36c20e83e79adcf268cc72dbaed3ba45ba2f643632d1"} May 21 12:46:46.799818 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:46.799777 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" event={"ID":"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6","Type":"ContainerStarted","Data":"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3"} May 21 12:46:46.800639 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:46.800584 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:46.818321 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:46.818226 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" podStartSLOduration=1.31869884 podStartE2EDuration="4.818207717s" podCreationTimestamp="2026-05-21 12:46:42 +0000 UTC" firstStartedPulling="2026-05-21 12:46:42.780864513 +0000 UTC m=+551.465966073" lastFinishedPulling="2026-05-21 12:46:46.280373398 +0000 UTC m=+554.965474950" observedRunningTime="2026-05-21 12:46:46.81716357 +0000 UTC m=+555.502265139" watchObservedRunningTime="2026-05-21 12:46:46.818207717 +0000 UTC m=+555.503309289" May 21 12:46:49.811948 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:49.811904 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bp8zj" event={"ID":"03cea59b-12ca-4945-9869-a66cb271c7cb","Type":"ContainerStarted","Data":"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637"} May 21 12:46:49.828589 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:49.828544 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-bp8zj" podStartSLOduration=2.394494814 podStartE2EDuration="6.828531308s" podCreationTimestamp="2026-05-21 12:46:43 +0000 UTC" firstStartedPulling="2026-05-21 12:46:45.181150264 +0000 UTC m=+553.866251811" lastFinishedPulling="2026-05-21 12:46:49.615186753 +0000 UTC m=+558.300288305" observedRunningTime="2026-05-21 12:46:49.82727235 +0000 UTC m=+558.512373920" watchObservedRunningTime="2026-05-21 12:46:49.828531308 +0000 UTC m=+558.513632887" May 21 12:46:56.902492 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:56.902455 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:56.902956 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:56.902676 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" podUID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" containerName="limitador" containerID="cri-o://a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3" gracePeriod=30 May 21 12:46:56.903330 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:56.903286 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:57.448378 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.448355 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:57.494720 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.494657 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v545z\" (UniqueName: \"kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z\") pod \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " May 21 12:46:57.494720 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.494706 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file\") pod \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\" (UID: \"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6\") " May 21 12:46:57.495095 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.495072 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file" (OuterVolumeSpecName: "config-file") pod "ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" (UID: "ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 12:46:57.496818 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.496791 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z" (OuterVolumeSpecName: "kube-api-access-v545z") pod "ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" (UID: "ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6"). InnerVolumeSpecName "kube-api-access-v545z". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:46:57.595453 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.595421 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-config-file\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:46:57.595453 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.595447 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v545z\" (UniqueName: \"kubernetes.io/projected/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6-kube-api-access-v545z\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:46:57.838297 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.838211 2560 generic.go:358] "Generic (PLEG): container finished" podID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" containerID="a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3" exitCode=0 May 21 12:46:57.838297 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.838279 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" May 21 12:46:57.838514 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.838307 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" event={"ID":"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6","Type":"ContainerDied","Data":"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3"} May 21 12:46:57.838514 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.838353 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-h9dzd" event={"ID":"ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6","Type":"ContainerDied","Data":"0d685bd5306cb8f8b8baef34c96cf472cc188226be3f6a36bf1c1a0c2015c600"} May 21 12:46:57.838514 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.838373 2560 scope.go:117] "RemoveContainer" containerID="a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3" May 21 12:46:57.846672 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.846657 2560 scope.go:117] "RemoveContainer" containerID="a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3" May 21 12:46:57.846927 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:46:57.846910 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3\": container with ID starting with a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3 not found: ID does not exist" containerID="a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3" May 21 12:46:57.846987 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.846934 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3"} err="failed to get container status \"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3\": rpc error: code = NotFound desc = could not find container \"a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3\": container with ID starting with a46c9d8f78c113551e85344d9916672dfc06c113fa5aa6e14bdeff86e6062cb3 not found: ID does not exist" May 21 12:46:57.863217 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.863190 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:57.867900 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.867878 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-h9dzd"] May 21 12:46:57.898137 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:57.898112 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" path="/var/lib/kubelet/pods/ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6/volumes" May 21 12:46:58.280778 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.280744 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-lms5w"] May 21 12:46:58.281386 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.281364 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" containerName="limitador" May 21 12:46:58.281445 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.281391 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" containerName="limitador" May 21 12:46:58.281490 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.281479 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddf0bb0f-3616-4ef9-b43c-aeeb1a07d8b6" containerName="limitador" May 21 12:46:58.284546 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.284526 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.287176 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.287148 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6dzjj\"" May 21 12:46:58.287307 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.287194 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 12:46:58.292361 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.292034 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-lms5w"] May 21 12:46:58.300278 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.300253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbhj6\" (UniqueName: \"kubernetes.io/projected/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-kube-api-access-fbhj6\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.300397 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.300297 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-data\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.401088 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.401039 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-data\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.401239 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.401144 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbhj6\" (UniqueName: \"kubernetes.io/projected/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-kube-api-access-fbhj6\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.401410 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.401392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-data\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.409679 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.409659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbhj6\" (UniqueName: \"kubernetes.io/projected/6db71d8b-f1ae-47db-a60d-0fd8b0c2441b-kube-api-access-fbhj6\") pod \"postgres-68c4fbbd6f-lms5w\" (UID: \"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b\") " pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.596110 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.596022 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:46:58.723106 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.723083 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-lms5w"] May 21 12:46:58.725177 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:46:58.725137 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db71d8b_f1ae_47db_a60d_0fd8b0c2441b.slice/crio-622c89859248619f477ac1d1e03a947bf8d912de50ac3f3056c26cc964bb37f1 WatchSource:0}: Error finding container 622c89859248619f477ac1d1e03a947bf8d912de50ac3f3056c26cc964bb37f1: Status 404 returned error can't find the container with id 622c89859248619f477ac1d1e03a947bf8d912de50ac3f3056c26cc964bb37f1 May 21 12:46:58.842993 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:46:58.842959 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-lms5w" event={"ID":"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b","Type":"ContainerStarted","Data":"622c89859248619f477ac1d1e03a947bf8d912de50ac3f3056c26cc964bb37f1"} May 21 12:47:03.862325 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:03.862284 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-lms5w" event={"ID":"6db71d8b-f1ae-47db-a60d-0fd8b0c2441b","Type":"ContainerStarted","Data":"9ec9dbafb372863c5735480398b23a740234b4e1fbe183d589f8ac1bc2b120f4"} May 21 12:47:03.862721 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:03.862391 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:47:03.880107 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:03.880058 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-lms5w" podStartSLOduration=1.185523109 podStartE2EDuration="5.880046006s" podCreationTimestamp="2026-05-21 12:46:58 +0000 UTC" firstStartedPulling="2026-05-21 12:46:58.726442461 +0000 UTC m=+567.411544009" lastFinishedPulling="2026-05-21 12:47:03.420965359 +0000 UTC m=+572.106066906" observedRunningTime="2026-05-21 12:47:03.877577092 +0000 UTC m=+572.562678663" watchObservedRunningTime="2026-05-21 12:47:03.880046006 +0000 UTC m=+572.565147574" May 21 12:47:09.893942 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:09.893912 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-lms5w" May 21 12:47:10.654291 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.654253 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w6w47"] May 21 12:47:10.657448 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.657428 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.659942 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.659914 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 12:47:10.666539 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.666517 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w6w47"] May 21 12:47:10.710617 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.710583 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w6w47"] May 21 12:47:10.710848 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:47:10.710829 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ldfpd tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-w6w47" podUID="1f7bc860-e7aa-45e9-86fd-f967153ee0ff" May 21 12:47:10.716186 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.716163 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfpd\" (UniqueName: \"kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.716276 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.716219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.734085 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.734056 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:47:10.737286 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.737270 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.745024 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.744997 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:47:10.816678 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.816628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjbj\" (UniqueName: \"kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.816678 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.816685 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfpd\" (UniqueName: \"kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.816946 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.816803 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.816946 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.816892 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.819214 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.819194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.825059 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.825029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfpd\" (UniqueName: \"kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd\") pod \"authorino-56fdd757f5-w6w47\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.886818 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.886789 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.891836 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.891811 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:10.917882 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.917774 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjbj\" (UniqueName: \"kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.917882 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.917867 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.920180 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.920162 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:10.926088 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:10.926065 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjbj\" (UniqueName: \"kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj\") pod \"authorino-6c6cf799c7-crfvs\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:11.019198 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.019147 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert\") pod \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " May 21 12:47:11.019400 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.019238 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldfpd\" (UniqueName: \"kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd\") pod \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\" (UID: \"1f7bc860-e7aa-45e9-86fd-f967153ee0ff\") " May 21 12:47:11.021337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.021305 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd" (OuterVolumeSpecName: "kube-api-access-ldfpd") pod "1f7bc860-e7aa-45e9-86fd-f967153ee0ff" (UID: "1f7bc860-e7aa-45e9-86fd-f967153ee0ff"). InnerVolumeSpecName "kube-api-access-ldfpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:47:11.021337 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.021320 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1f7bc860-e7aa-45e9-86fd-f967153ee0ff" (UID: "1f7bc860-e7aa-45e9-86fd-f967153ee0ff"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:47:11.046460 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.046428 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:47:11.120179 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.120148 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-tls-cert\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:47:11.120179 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.120177 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldfpd\" (UniqueName: \"kubernetes.io/projected/1f7bc860-e7aa-45e9-86fd-f967153ee0ff-kube-api-access-ldfpd\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:47:11.175400 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.175369 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:47:11.177465 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:47:11.177433 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd7a307_dd84_4c0c_bebe_72baa4bad6d0.slice/crio-4068abf52116126212bcaee125df32e9a4030786a2a85ad41c89f583ac6b3b5d WatchSource:0}: Error finding container 4068abf52116126212bcaee125df32e9a4030786a2a85ad41c89f583ac6b3b5d: Status 404 returned error can't find the container with id 4068abf52116126212bcaee125df32e9a4030786a2a85ad41c89f583ac6b3b5d May 21 12:47:11.891175 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.891126 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" event={"ID":"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0","Type":"ContainerStarted","Data":"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01"} May 21 12:47:11.891175 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.891180 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" event={"ID":"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0","Type":"ContainerStarted","Data":"4068abf52116126212bcaee125df32e9a4030786a2a85ad41c89f583ac6b3b5d"} May 21 12:47:11.891384 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.891156 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-w6w47" May 21 12:47:11.907820 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.907773 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" podStartSLOduration=1.38321756 podStartE2EDuration="1.907760441s" podCreationTimestamp="2026-05-21 12:47:10 +0000 UTC" firstStartedPulling="2026-05-21 12:47:11.178703842 +0000 UTC m=+579.863805390" lastFinishedPulling="2026-05-21 12:47:11.70324672 +0000 UTC m=+580.388348271" observedRunningTime="2026-05-21 12:47:11.90638602 +0000 UTC m=+580.591487591" watchObservedRunningTime="2026-05-21 12:47:11.907760441 +0000 UTC m=+580.592862022" May 21 12:47:11.932223 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.932184 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w6w47"] May 21 12:47:11.940160 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.939636 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:47:11.941879 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.941831 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-w6w47"] May 21 12:47:11.941987 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:11.941921 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-bp8zj" podUID="03cea59b-12ca-4945-9869-a66cb271c7cb" containerName="authorino" containerID="cri-o://d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637" gracePeriod=30 May 21 12:47:12.186309 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.186286 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:47:12.231349 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.231268 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn2hk\" (UniqueName: \"kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk\") pod \"03cea59b-12ca-4945-9869-a66cb271c7cb\" (UID: \"03cea59b-12ca-4945-9869-a66cb271c7cb\") " May 21 12:47:12.233225 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.233200 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk" (OuterVolumeSpecName: "kube-api-access-fn2hk") pod "03cea59b-12ca-4945-9869-a66cb271c7cb" (UID: "03cea59b-12ca-4945-9869-a66cb271c7cb"). InnerVolumeSpecName "kube-api-access-fn2hk". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:47:12.332551 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.332511 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn2hk\" (UniqueName: \"kubernetes.io/projected/03cea59b-12ca-4945-9869-a66cb271c7cb-kube-api-access-fn2hk\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:47:12.898506 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.896483 2560 generic.go:358] "Generic (PLEG): container finished" podID="03cea59b-12ca-4945-9869-a66cb271c7cb" containerID="d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637" exitCode=0 May 21 12:47:12.898506 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.896923 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-bp8zj" May 21 12:47:12.898743 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.898512 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bp8zj" event={"ID":"03cea59b-12ca-4945-9869-a66cb271c7cb","Type":"ContainerDied","Data":"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637"} May 21 12:47:12.898743 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.898549 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-bp8zj" event={"ID":"03cea59b-12ca-4945-9869-a66cb271c7cb","Type":"ContainerDied","Data":"feedafce6e6a6a383c5d36c20e83e79adcf268cc72dbaed3ba45ba2f643632d1"} May 21 12:47:12.898743 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.898568 2560 scope.go:117] "RemoveContainer" containerID="d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637" May 21 12:47:12.907411 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.907390 2560 scope.go:117] "RemoveContainer" containerID="d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637" May 21 12:47:12.907637 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:47:12.907619 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637\": container with ID starting with d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637 not found: ID does not exist" containerID="d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637" May 21 12:47:12.907697 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.907643 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637"} err="failed to get container status \"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637\": rpc error: code = NotFound desc = could not find container \"d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637\": container with ID starting with d908dc1b4f82ded4e9b584024af83a6328ed08a2ab8c1a130a37e3db2fb9e637 not found: ID does not exist" May 21 12:47:12.919575 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.919547 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:47:12.923667 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:12.923645 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-bp8zj"] May 21 12:47:13.898569 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:13.898514 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03cea59b-12ca-4945-9869-a66cb271c7cb" path="/var/lib/kubelet/pods/03cea59b-12ca-4945-9869-a66cb271c7cb/volumes" May 21 12:47:13.899097 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:13.899079 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7bc860-e7aa-45e9-86fd-f967153ee0ff" path="/var/lib/kubelet/pods/1f7bc860-e7aa-45e9-86fd-f967153ee0ff/volumes" May 21 12:47:49.278724 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.278690 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-65b9d67f5d-lflm9"] May 21 12:47:49.281188 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.279225 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03cea59b-12ca-4945-9869-a66cb271c7cb" containerName="authorino" May 21 12:47:49.281188 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.279241 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="03cea59b-12ca-4945-9869-a66cb271c7cb" containerName="authorino" May 21 12:47:49.281188 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.279343 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="03cea59b-12ca-4945-9869-a66cb271c7cb" containerName="authorino" May 21 12:47:49.282534 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.282518 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.285814 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.285796 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 12:47:49.285926 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.285813 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 12:47:49.286065 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.286052 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-knjrx\"" May 21 12:47:49.293379 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.293357 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-65b9d67f5d-lflm9"] May 21 12:47:49.345955 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.345915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.346142 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.345998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjsc9\" (UniqueName: \"kubernetes.io/projected/2e290ae1-f808-4180-9528-2ac8f7367a4d-kube-api-access-fjsc9\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.447449 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.447409 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjsc9\" (UniqueName: \"kubernetes.io/projected/2e290ae1-f808-4180-9528-2ac8f7367a4d-kube-api-access-fjsc9\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.447628 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.447506 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.447703 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:47:49.447625 2560 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 21 12:47:49.447756 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:47:49.447708 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls podName:2e290ae1-f808-4180-9528-2ac8f7367a4d nodeName:}" failed. No retries permitted until 2026-05-21 12:47:49.947683793 +0000 UTC m=+618.632785343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls") pod "maas-api-65b9d67f5d-lflm9" (UID: "2e290ae1-f808-4180-9528-2ac8f7367a4d") : secret "maas-api-serving-cert" not found May 21 12:47:49.457190 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.457155 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjsc9\" (UniqueName: \"kubernetes.io/projected/2e290ae1-f808-4180-9528-2ac8f7367a4d-kube-api-access-fjsc9\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.951592 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.951551 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:49.953893 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:49.953849 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e290ae1-f808-4180-9528-2ac8f7367a4d-maas-api-tls\") pod \"maas-api-65b9d67f5d-lflm9\" (UID: \"2e290ae1-f808-4180-9528-2ac8f7367a4d\") " pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:50.192964 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:50.192926 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:50.346562 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:50.346479 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-65b9d67f5d-lflm9"] May 21 12:47:50.348949 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:47:50.348918 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e290ae1_f808_4180_9528_2ac8f7367a4d.slice/crio-a827753be882f69eb96293f9977d3d33668a194848665a399d8b277840f86a40 WatchSource:0}: Error finding container a827753be882f69eb96293f9977d3d33668a194848665a399d8b277840f86a40: Status 404 returned error can't find the container with id a827753be882f69eb96293f9977d3d33668a194848665a399d8b277840f86a40 May 21 12:47:50.350264 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:50.350248 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 12:47:51.025745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:51.025689 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-65b9d67f5d-lflm9" event={"ID":"2e290ae1-f808-4180-9528-2ac8f7367a4d","Type":"ContainerStarted","Data":"a827753be882f69eb96293f9977d3d33668a194848665a399d8b277840f86a40"} May 21 12:47:53.033712 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:53.033679 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-65b9d67f5d-lflm9" event={"ID":"2e290ae1-f808-4180-9528-2ac8f7367a4d","Type":"ContainerStarted","Data":"d047a95312ab399690c71e0a7ffcb93cbf51a2ab617af0607bf5beeeb8fc5134"} May 21 12:47:53.034163 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:53.033790 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:47:53.061798 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:53.061752 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-65b9d67f5d-lflm9" podStartSLOduration=1.9033362 podStartE2EDuration="4.061736836s" podCreationTimestamp="2026-05-21 12:47:49 +0000 UTC" firstStartedPulling="2026-05-21 12:47:50.350365107 +0000 UTC m=+619.035466653" lastFinishedPulling="2026-05-21 12:47:52.508765739 +0000 UTC m=+621.193867289" observedRunningTime="2026-05-21 12:47:53.059833511 +0000 UTC m=+621.744935080" watchObservedRunningTime="2026-05-21 12:47:53.061736836 +0000 UTC m=+621.746838405" May 21 12:47:59.042678 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:47:59.042650 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-65b9d67f5d-lflm9" May 21 12:48:31.557772 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.557710 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7"] May 21 12:48:31.562599 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.562581 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.570677 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.570656 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 12:48:31.570820 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.570804 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9lqrk\"" May 21 12:48:31.571663 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.571645 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 12:48:31.572134 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.572120 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 12:48:31.611662 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.611637 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7"] May 21 12:48:31.719745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.719745 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.720026 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.720026 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719848 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.720026 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rcnd\" (UniqueName: \"kubernetes.io/projected/9eaf641d-d549-4121-99b6-b4982a680005-kube-api-access-9rcnd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.720026 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.719983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eaf641d-d549-4121-99b6-b4982a680005-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.820920 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.820814 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.820920 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.820875 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.820945 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.820970 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.820996 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rcnd\" (UniqueName: \"kubernetes.io/projected/9eaf641d-d549-4121-99b6-b4982a680005-kube-api-access-9rcnd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821127 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.821015 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eaf641d-d549-4121-99b6-b4982a680005-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.821275 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821357 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.821289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.821465 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.821416 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.823099 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.823080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9eaf641d-d549-4121-99b6-b4982a680005-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.830389 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.830368 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 12:48:31.833483 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.833466 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9eaf641d-d549-4121-99b6-b4982a680005-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.841568 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.841546 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 12:48:31.853261 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.853240 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 12:48:31.860747 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.860722 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rcnd\" (UniqueName: \"kubernetes.io/projected/9eaf641d-d549-4121-99b6-b4982a680005-kube-api-access-9rcnd\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7\" (UID: \"9eaf641d-d549-4121-99b6-b4982a680005\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:31.877714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.877693 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9lqrk\"" May 21 12:48:31.883265 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:31.883244 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:32.024900 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:32.024744 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7"] May 21 12:48:32.027542 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:48:32.027519 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eaf641d_d549_4121_99b6_b4982a680005.slice/crio-944a4a0a0cf38a4864ad9206a23eaacb6be1b73e54162c297c673ebbd3879596 WatchSource:0}: Error finding container 944a4a0a0cf38a4864ad9206a23eaacb6be1b73e54162c297c673ebbd3879596: Status 404 returned error can't find the container with id 944a4a0a0cf38a4864ad9206a23eaacb6be1b73e54162c297c673ebbd3879596 May 21 12:48:32.168726 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:32.168634 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" event={"ID":"9eaf641d-d549-4121-99b6-b4982a680005","Type":"ContainerStarted","Data":"944a4a0a0cf38a4864ad9206a23eaacb6be1b73e54162c297c673ebbd3879596"} May 21 12:48:37.190324 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:37.190282 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" event={"ID":"9eaf641d-d549-4121-99b6-b4982a680005","Type":"ContainerStarted","Data":"1c9baac5883121f901ded0db737fc4e79ecd0c5a3d377e0ff7949492a2ddc0b0"} May 21 12:48:43.215306 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:43.215268 2560 generic.go:358] "Generic (PLEG): container finished" podID="9eaf641d-d549-4121-99b6-b4982a680005" containerID="1c9baac5883121f901ded0db737fc4e79ecd0c5a3d377e0ff7949492a2ddc0b0" exitCode=0 May 21 12:48:43.215816 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:43.215342 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" event={"ID":"9eaf641d-d549-4121-99b6-b4982a680005","Type":"ContainerDied","Data":"1c9baac5883121f901ded0db737fc4e79ecd0c5a3d377e0ff7949492a2ddc0b0"} May 21 12:48:45.224343 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:45.224311 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" event={"ID":"9eaf641d-d549-4121-99b6-b4982a680005","Type":"ContainerStarted","Data":"d4bb8973107dcd0b5658b3c16359363fd7c6ae7c7edcea7d3744cb1ac0b12988"} May 21 12:48:45.224714 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:45.224503 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:48:45.248288 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:45.248228 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" podStartSLOduration=1.849041083 podStartE2EDuration="14.248185577s" podCreationTimestamp="2026-05-21 12:48:31 +0000 UTC" firstStartedPulling="2026-05-21 12:48:32.029264549 +0000 UTC m=+660.714366096" lastFinishedPulling="2026-05-21 12:48:44.42840904 +0000 UTC m=+673.113510590" observedRunningTime="2026-05-21 12:48:45.246747986 +0000 UTC m=+673.931849556" watchObservedRunningTime="2026-05-21 12:48:45.248185577 +0000 UTC m=+673.933287146" May 21 12:48:56.241133 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:48:56.241101 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7" May 21 12:49:30.721199 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.721118 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9f46bfd44-vd2j9"] May 21 12:49:30.723778 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.723760 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.756464 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.756428 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f46bfd44-vd2j9"] May 21 12:49:30.769559 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.769522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z7gt\" (UniqueName: \"kubernetes.io/projected/3e5e97a5-a55b-485c-aafb-597f50c358ea-kube-api-access-5z7gt\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.769691 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.769587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e5e97a5-a55b-485c-aafb-597f50c358ea-tls-cert\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.870701 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.870667 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z7gt\" (UniqueName: \"kubernetes.io/projected/3e5e97a5-a55b-485c-aafb-597f50c358ea-kube-api-access-5z7gt\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.870876 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.870721 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e5e97a5-a55b-485c-aafb-597f50c358ea-tls-cert\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.873108 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.873084 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3e5e97a5-a55b-485c-aafb-597f50c358ea-tls-cert\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:30.883726 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:30.883698 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z7gt\" (UniqueName: \"kubernetes.io/projected/3e5e97a5-a55b-485c-aafb-597f50c358ea-kube-api-access-5z7gt\") pod \"authorino-9f46bfd44-vd2j9\" (UID: \"3e5e97a5-a55b-485c-aafb-597f50c358ea\") " pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:31.032540 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:31.032460 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9f46bfd44-vd2j9" May 21 12:49:31.182236 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:31.182204 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9f46bfd44-vd2j9"] May 21 12:49:31.184090 ip-10-0-142-58 kubenswrapper[2560]: W0521 12:49:31.184062 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e5e97a5_a55b_485c_aafb_597f50c358ea.slice/crio-c4e1aec68b1e40e9240764ff574e89beba353af9cc9838bddc39ad018cbc68e6 WatchSource:0}: Error finding container c4e1aec68b1e40e9240764ff574e89beba353af9cc9838bddc39ad018cbc68e6: Status 404 returned error can't find the container with id c4e1aec68b1e40e9240764ff574e89beba353af9cc9838bddc39ad018cbc68e6 May 21 12:49:31.378569 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:31.378480 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f46bfd44-vd2j9" event={"ID":"3e5e97a5-a55b-485c-aafb-597f50c358ea","Type":"ContainerStarted","Data":"c4e1aec68b1e40e9240764ff574e89beba353af9cc9838bddc39ad018cbc68e6"} May 21 12:49:32.383125 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.383088 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9f46bfd44-vd2j9" event={"ID":"3e5e97a5-a55b-485c-aafb-597f50c358ea","Type":"ContainerStarted","Data":"dcae9e60f7275f11a9618148ec388d19199a7d58c8bc8ef7d2487cc041427a59"} May 21 12:49:32.471103 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.471033 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-9f46bfd44-vd2j9" podStartSLOduration=2.077777951 podStartE2EDuration="2.471014865s" podCreationTimestamp="2026-05-21 12:49:30 +0000 UTC" firstStartedPulling="2026-05-21 12:49:31.185281816 +0000 UTC m=+719.870383365" lastFinishedPulling="2026-05-21 12:49:31.578518729 +0000 UTC m=+720.263620279" observedRunningTime="2026-05-21 12:49:32.469843621 +0000 UTC m=+721.154945190" watchObservedRunningTime="2026-05-21 12:49:32.471014865 +0000 UTC m=+721.156116434" May 21 12:49:32.563894 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.563828 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:49:32.564083 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.564059 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" podUID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" containerName="authorino" containerID="cri-o://48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01" gracePeriod=30 May 21 12:49:32.811320 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.811296 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:49:32.888895 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.888840 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkjbj\" (UniqueName: \"kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj\") pod \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " May 21 12:49:32.889092 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.888921 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert\") pod \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\" (UID: \"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0\") " May 21 12:49:32.891008 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.890985 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj" (OuterVolumeSpecName: "kube-api-access-rkjbj") pod "bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" (UID: "bcd7a307-dd84-4c0c-bebe-72baa4bad6d0"). InnerVolumeSpecName "kube-api-access-rkjbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 12:49:32.900921 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.900886 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" (UID: "bcd7a307-dd84-4c0c-bebe-72baa4bad6d0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 12:49:32.989640 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.989610 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkjbj\" (UniqueName: \"kubernetes.io/projected/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-kube-api-access-rkjbj\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:49:32.989640 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:32.989638 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0-tls-cert\") on node \"ip-10-0-142-58.ec2.internal\" DevicePath \"\"" May 21 12:49:33.388034 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.387950 2560 generic.go:358] "Generic (PLEG): container finished" podID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" containerID="48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01" exitCode=0 May 21 12:49:33.388034 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.388004 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" May 21 12:49:33.388477 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.388037 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" event={"ID":"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0","Type":"ContainerDied","Data":"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01"} May 21 12:49:33.388477 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.388076 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c6cf799c7-crfvs" event={"ID":"bcd7a307-dd84-4c0c-bebe-72baa4bad6d0","Type":"ContainerDied","Data":"4068abf52116126212bcaee125df32e9a4030786a2a85ad41c89f583ac6b3b5d"} May 21 12:49:33.388477 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.388098 2560 scope.go:117] "RemoveContainer" containerID="48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01" May 21 12:49:33.399379 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.399360 2560 scope.go:117] "RemoveContainer" containerID="48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01" May 21 12:49:33.399631 ip-10-0-142-58 kubenswrapper[2560]: E0521 12:49:33.399612 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01\": container with ID starting with 48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01 not found: ID does not exist" containerID="48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01" May 21 12:49:33.399713 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.399643 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01"} err="failed to get container status \"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01\": rpc error: code = NotFound desc = could not find container \"48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01\": container with ID starting with 48749934d3d8824fd5247094fdf90d45524f66e589ad96eeed9464e0151a4e01 not found: ID does not exist" May 21 12:49:33.418753 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.418731 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:49:33.422578 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.422560 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c6cf799c7-crfvs"] May 21 12:49:33.898353 ip-10-0-142-58 kubenswrapper[2560]: I0521 12:49:33.898320 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" path="/var/lib/kubelet/pods/bcd7a307-dd84-4c0c-bebe-72baa4bad6d0/volumes" May 21 13:12:07.464569 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:07.464455 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f46bfd44-vd2j9_3e5e97a5-a55b-485c-aafb-597f50c358ea/authorino/0.log" May 21 13:12:12.262935 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:12.262897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-65b9d67f5d-lflm9_2e290ae1-f808-4180-9528-2ac8f7367a4d/maas-api/0.log" May 21 13:12:12.763072 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:12.763033 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84556f689c-fhglk_a62d0320-d5e0-498e-a459-e8debb3204da/manager/0.log" May 21 13:12:13.155015 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:13.154932 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-lms5w_6db71d8b-f1ae-47db-a60d-0fd8b0c2441b/postgres/0.log" May 21 13:12:14.460726 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:14.460682 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f46bfd44-vd2j9_3e5e97a5-a55b-485c-aafb-597f50c358ea/authorino/0.log" May 21 13:12:14.820082 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:14.819997 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-6flsj_58f9a889-c2ec-4237-a9d6-307a8f6ba7c7/kuadrant-console-plugin/0.log" May 21 13:12:15.899612 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:15.899553 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7485fd7bf5-gdpf7_97c3fdfa-9135-4083-9993-a2871dc09069/kube-auth-proxy/0.log" May 21 13:12:16.360103 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:16.360071 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68d8b964c4-xbwg7_4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c/router/0.log" May 21 13:12:16.701510 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:16.701424 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7_9eaf641d-d549-4121-99b6-b4982a680005/storage-initializer/0.log" May 21 13:12:16.712259 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:16.712235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-7g5b7_9eaf641d-d549-4121-99b6-b4982a680005/main/0.log" May 21 13:12:21.286073 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.286037 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dx5f/must-gather-kfpzl"] May 21 13:12:21.286438 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.286389 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" containerName="authorino" May 21 13:12:21.286438 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.286402 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" containerName="authorino" May 21 13:12:21.286508 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.286498 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcd7a307-dd84-4c0c-bebe-72baa4bad6d0" containerName="authorino" May 21 13:12:21.289341 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.289321 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.294091 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.294064 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dx5f\"/\"kube-root-ca.crt\"" May 21 13:12:21.294212 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.294132 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8dx5f\"/\"default-dockercfg-jq2jw\"" May 21 13:12:21.295148 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.295127 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8dx5f\"/\"openshift-service-ca.crt\"" May 21 13:12:21.317071 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.317040 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/must-gather-kfpzl"] May 21 13:12:21.382283 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.382255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jg8\" (UniqueName: \"kubernetes.io/projected/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-kube-api-access-77jg8\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.382441 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.382292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-must-gather-output\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.483065 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.483027 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77jg8\" (UniqueName: \"kubernetes.io/projected/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-kube-api-access-77jg8\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.483256 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.483078 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-must-gather-output\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.483430 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.483411 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-must-gather-output\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.493911 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.493885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jg8\" (UniqueName: \"kubernetes.io/projected/b107c5a9-5c17-4b82-84fb-8d69b5b596b1-kube-api-access-77jg8\") pod \"must-gather-kfpzl\" (UID: \"b107c5a9-5c17-4b82-84fb-8d69b5b596b1\") " pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.598948 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.598838 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" May 21 13:12:21.734883 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.734838 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/must-gather-kfpzl"] May 21 13:12:21.738977 ip-10-0-142-58 kubenswrapper[2560]: W0521 13:12:21.738950 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb107c5a9_5c17_4b82_84fb_8d69b5b596b1.slice/crio-81118fdc108a9a6fedae509dece88912724dec39d5e30750c7118202b300c3b9 WatchSource:0}: Error finding container 81118fdc108a9a6fedae509dece88912724dec39d5e30750c7118202b300c3b9: Status 404 returned error can't find the container with id 81118fdc108a9a6fedae509dece88912724dec39d5e30750c7118202b300c3b9 May 21 13:12:21.740701 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:21.740681 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:12:22.080671 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:22.080636 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" event={"ID":"b107c5a9-5c17-4b82-84fb-8d69b5b596b1","Type":"ContainerStarted","Data":"81118fdc108a9a6fedae509dece88912724dec39d5e30750c7118202b300c3b9"} May 21 13:12:23.087395 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:23.087302 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" event={"ID":"b107c5a9-5c17-4b82-84fb-8d69b5b596b1","Type":"ContainerStarted","Data":"7134d2fbf460658c26cbfd94219b8085836f34bd5a27df838cb0e6a590dbe975"} May 21 13:12:23.087395 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:23.087346 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" event={"ID":"b107c5a9-5c17-4b82-84fb-8d69b5b596b1","Type":"ContainerStarted","Data":"8c54f3a2ae429ae44ea863914177eb68fae330c4350440ee24065ddbcd2aaac5"} May 21 13:12:23.127933 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:23.127870 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dx5f/must-gather-kfpzl" podStartSLOduration=1.12690264 podStartE2EDuration="2.127832593s" podCreationTimestamp="2026-05-21 13:12:21 +0000 UTC" firstStartedPulling="2026-05-21 13:12:21.740896144 +0000 UTC m=+2090.425997710" lastFinishedPulling="2026-05-21 13:12:22.741826112 +0000 UTC m=+2091.426927663" observedRunningTime="2026-05-21 13:12:23.124483286 +0000 UTC m=+2091.809584848" watchObservedRunningTime="2026-05-21 13:12:23.127832593 +0000 UTC m=+2091.812934168" May 21 13:12:24.415695 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:24.415655 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5z4lr_18fb1e14-c911-4786-9bc1-74856f71b2ae/global-pull-secret-syncer/0.log" May 21 13:12:24.725752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:24.725711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z4sw5_4cb0f40a-752f-498e-be8a-b9336e0b0a75/konnectivity-agent/0.log" May 21 13:12:24.803379 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:24.803352 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-58.ec2.internal_391d98783aa1857a5924aebc07bb2d6b/haproxy/0.log" May 21 13:12:28.980243 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:28.980205 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9f46bfd44-vd2j9_3e5e97a5-a55b-485c-aafb-597f50c358ea/authorino/0.log" May 21 13:12:29.194039 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:29.194008 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-6flsj_58f9a889-c2ec-4237-a9d6-307a8f6ba7c7/kuadrant-console-plugin/0.log" May 21 13:12:30.931758 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:30.931678 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/alertmanager/0.log" May 21 13:12:30.961083 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:30.961055 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/config-reloader/0.log" May 21 13:12:30.991988 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:30.991958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/kube-rbac-proxy-web/0.log" May 21 13:12:31.031522 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.031486 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/kube-rbac-proxy/0.log" May 21 13:12:31.065749 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.065708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/kube-rbac-proxy-metric/0.log" May 21 13:12:31.111123 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.111099 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/prom-label-proxy/0.log" May 21 13:12:31.139400 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.139360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f78ace98-fb3f-41d3-b1d2-e2625f356fd8/init-config-reloader/0.log" May 21 13:12:31.182582 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.182498 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-4c7gr_ffec084d-ecb3-4345-b986-7a2e6d255a37/cluster-monitoring-operator/0.log" May 21 13:12:31.220048 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.220019 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9s4px_8b0ef243-afa5-452e-a341-a3a88d858311/kube-state-metrics/0.log" May 21 13:12:31.239801 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.239771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9s4px_8b0ef243-afa5-452e-a341-a3a88d858311/kube-rbac-proxy-main/0.log" May 21 13:12:31.265693 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.265658 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9s4px_8b0ef243-afa5-452e-a341-a3a88d858311/kube-rbac-proxy-self/0.log" May 21 13:12:31.296806 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.296782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d66cf5584-96fjt_74a4969f-85b1-47ca-b0f0-ce5d8be28d65/metrics-server/0.log" May 21 13:12:31.342575 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.342529 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-jfgjj_2fd306f5-7e41-497a-95a5-4ee4da7d4054/monitoring-plugin/0.log" May 21 13:12:31.550154 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.550125 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9msx_a77b8301-77d7-4375-9e6c-5fb22292ae63/node-exporter/0.log" May 21 13:12:31.579230 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.579204 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9msx_a77b8301-77d7-4375-9e6c-5fb22292ae63/kube-rbac-proxy/0.log" May 21 13:12:31.624922 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.624894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z9msx_a77b8301-77d7-4375-9e6c-5fb22292ae63/init-textfile/0.log" May 21 13:12:31.791639 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.791563 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/prometheus/0.log" May 21 13:12:31.832014 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.831986 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/config-reloader/0.log" May 21 13:12:31.875879 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.875840 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/thanos-sidecar/0.log" May 21 13:12:31.907581 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.907556 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/kube-rbac-proxy-web/0.log" May 21 13:12:31.940632 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.940605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/kube-rbac-proxy/0.log" May 21 13:12:31.970648 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.970614 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/kube-rbac-proxy-thanos/0.log" May 21 13:12:31.994819 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:31.994792 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b53426a7-d4ee-4d78-b297-55766fa6674c/init-config-reloader/0.log" May 21 13:12:32.085135 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.085050 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-c9f2c_ae672da6-69ba-4e79-a4ea-788b5037067e/prometheus-operator-admission-webhook/0.log" May 21 13:12:32.236292 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.236244 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/thanos-query/0.log" May 21 13:12:32.265823 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.265793 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/kube-rbac-proxy-web/0.log" May 21 13:12:32.308823 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.308796 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/kube-rbac-proxy/0.log" May 21 13:12:32.340609 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.340542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/prom-label-proxy/0.log" May 21 13:12:32.386042 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.386014 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/kube-rbac-proxy-rules/0.log" May 21 13:12:32.416137 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:32.416108 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55c4cb47c7-f8w6z_dea271eb-56f1-478f-8716-5cdcd632c55e/kube-rbac-proxy-metrics/0.log" May 21 13:12:33.016289 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.016252 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8"] May 21 13:12:33.021313 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.021282 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.037044 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.037018 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8"] May 21 13:12:33.116168 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.116136 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-sys\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.116358 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.116174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-podres\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.116358 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.116309 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvvp4\" (UniqueName: \"kubernetes.io/projected/731627b1-ab89-4dee-adb9-9b931c55afc5-kube-api-access-vvvp4\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.116481 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.116375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-lib-modules\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.116481 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.116434 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-proc\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217566 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217515 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-lib-modules\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217585 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-proc\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217627 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-sys\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217659 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-podres\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-lib-modules\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217729 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-sys\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217736 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvvp4\" (UniqueName: \"kubernetes.io/projected/731627b1-ab89-4dee-adb9-9b931c55afc5-kube-api-access-vvvp4\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.217752 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-proc\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.218059 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.217874 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731627b1-ab89-4dee-adb9-9b931c55afc5-podres\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.227346 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.227319 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvvp4\" (UniqueName: \"kubernetes.io/projected/731627b1-ab89-4dee-adb9-9b931c55afc5-kube-api-access-vvvp4\") pod \"perf-node-gather-daemonset-m4ll8\" (UID: \"731627b1-ab89-4dee-adb9-9b931c55afc5\") " pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.336700 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.336612 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:33.501890 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:33.501835 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8"] May 21 13:12:33.503317 ip-10-0-142-58 kubenswrapper[2560]: W0521 13:12:33.503285 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod731627b1_ab89_4dee_adb9_9b931c55afc5.slice/crio-cb556ead4d3146b2c1c2d11c943caa2b35be55ebcbedf85c1bc9941dc5f1805e WatchSource:0}: Error finding container cb556ead4d3146b2c1c2d11c943caa2b35be55ebcbedf85c1bc9941dc5f1805e: Status 404 returned error can't find the container with id cb556ead4d3146b2c1c2d11c943caa2b35be55ebcbedf85c1bc9941dc5f1805e May 21 13:12:34.135770 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:34.135728 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" event={"ID":"731627b1-ab89-4dee-adb9-9b931c55afc5","Type":"ContainerStarted","Data":"701d6b026dd019481254d63f928c4fec4131e70f75eb862dae57f351198248e3"} May 21 13:12:34.135770 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:34.135776 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" event={"ID":"731627b1-ab89-4dee-adb9-9b931c55afc5","Type":"ContainerStarted","Data":"cb556ead4d3146b2c1c2d11c943caa2b35be55ebcbedf85c1bc9941dc5f1805e"} May 21 13:12:34.136309 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:34.136127 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:34.155520 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:34.155462 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" podStartSLOduration=2.15544153 podStartE2EDuration="2.15544153s" podCreationTimestamp="2026-05-21 13:12:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:12:34.154140726 +0000 UTC m=+2102.839242297" watchObservedRunningTime="2026-05-21 13:12:34.15544153 +0000 UTC m=+2102.840543100" May 21 13:12:34.649720 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:34.649692 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-pgzrs_e76f0f6f-f40d-44af-addd-fc8ecc15748e/download-server/0.log" May 21 13:12:35.864710 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:35.864681 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65b68_aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd/dns/0.log" May 21 13:12:35.902072 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:35.902044 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-65b68_aa5f3cb9-3916-44b9-9fb6-3e745f0f58bd/kube-rbac-proxy/0.log" May 21 13:12:36.072935 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:36.072907 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-27qp6_22d992f2-6055-4f49-b781-a524d13abd8d/dns-node-resolver/0.log" May 21 13:12:36.681982 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:36.681948 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmdc7_fec52138-af6f-48eb-b5e5-def92ba0826c/node-ca/0.log" May 21 13:12:37.767980 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:37.767948 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7485fd7bf5-gdpf7_97c3fdfa-9135-4083-9993-a2871dc09069/kube-auth-proxy/0.log" May 21 13:12:37.951666 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:37.951640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-68d8b964c4-xbwg7_4e9c4b1b-2224-4d86-a39d-3b07ddcd9f6c/router/0.log" May 21 13:12:38.594532 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:38.594503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcwxl_0f9420ed-249b-44b5-8e42-c35ca1c34616/serve-healthcheck-canary/0.log" May 21 13:12:39.160488 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:39.160462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvgpq_2aecd2e5-52f8-40e2-b3b8-f6e59283db5f/kube-rbac-proxy/0.log" May 21 13:12:39.187245 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:39.187219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvgpq_2aecd2e5-52f8-40e2-b3b8-f6e59283db5f/exporter/0.log" May 21 13:12:39.217212 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:39.217187 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvgpq_2aecd2e5-52f8-40e2-b3b8-f6e59283db5f/extractor/0.log" May 21 13:12:40.150704 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:40.150678 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8dx5f/perf-node-gather-daemonset-m4ll8" May 21 13:12:41.528646 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:41.528618 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-65b9d67f5d-lflm9_2e290ae1-f808-4180-9528-2ac8f7367a4d/maas-api/0.log" May 21 13:12:41.756048 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:41.756021 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84556f689c-fhglk_a62d0320-d5e0-498e-a459-e8debb3204da/manager/0.log" May 21 13:12:41.893507 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:41.893476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-lms5w_6db71d8b-f1ae-47db-a60d-0fd8b0c2441b/postgres/0.log" May 21 13:12:43.345915 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:43.345831 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-557877f599-jtrbz_9b48bbbe-4f6f-4190-bb4d-ed6cc42c87af/manager/0.log" May 21 13:12:48.321124 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:48.321091 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-xjkbd_33957a72-7a13-4b54-8f25-26aad0fef0d6/kube-storage-version-migrator-operator/1.log" May 21 13:12:48.321830 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:48.321799 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-xjkbd_33957a72-7a13-4b54-8f25-26aad0fef0d6/kube-storage-version-migrator-operator/0.log" May 21 13:12:50.010284 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:50.010248 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfs2w_904f88a9-0132-4a79-8151-c494db2fe658/kube-multus-additional-cni-plugins/0.log" May 21 13:12:50.037205 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:50.037179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfs2w_904f88a9-0132-4a79-8151-c494db2fe658/egress-router-binary-copy/0.log" May 21 13:12:50.065170 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:50.065129 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfs2w_904f88a9-0132-4a79-8151-c494db2fe658/cni-plugins/0.log" May 21 13:12:50.091780 ip-10-0-142-58 kubenswrapper[2560]: I0521 13:12:50.091744 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kfs2w_904f88a9-0132-4a79-8151-c494db2fe658/bond-cni-plugin/0.log"